Max level shown:
1 [ Nov 7 22:40:25 Enabled. ]
2 [ Nov 7 22:40:25 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 7 22:40:25 Method "start" exited with status 0. ]
4 [ Nov 7 22:40:25 Rereading configuration. ]
5 [ Nov 7 22:40:25 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-07T22:40:25.805ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-07T22:40:25.805ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-07T22:40:25.858ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-07T22:40:25.858ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-07T22:40:25.973ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-07T22:40:25.982ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-07T22:40:25.990ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-07T22:40:26.592ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-07T22:40:26.729ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-07T22:40:26.729ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-07T22:40:26.729ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-07T22:40:26.729ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-07T22:40:26.729ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-07T22:40:26.729ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-07T22:40:26.732ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-07T22:40:26.732ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-07T22:40:26.732ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-07T22:40:26.732ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-07T22:40:26.732ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-07T22:40:26.732ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-07T22:40:26.732ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-11-07T22:40:26.732ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-07T22:40:26.732ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-07T22:40:26.743ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-07T22:40:26.743ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool)
322024-11-07T22:40:26.843ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal }
332024-11-07T22:40:27.321ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-11-07T22:40:27.321ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-07T22:40:27.321ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-07T22:40:27.321ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-07T22:40:27.321ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
382024-11-07T22:40:27.322ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-07T22:40:27.322ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-07T22:40:27.330ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-07T22:40:27.330ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool)
422024-11-07T22:40:27.419ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal }
432024-11-07T22:40:27.892ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-07T22:40:27.892ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-07T22:40:27.892ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
472024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482024-11-07T22:40:27.892ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-07T22:40:27.892ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-07T22:40:27.892ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-11-07T22:40:27.892ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
542024-11-07T22:40:27.892ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-07T22:40:27.892ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-07T22:40:27.892ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-07T22:40:27.892ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
582024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-11-07T22:40:27.892ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
602024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-07T22:40:27.892ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-07T22:40:27.892ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
632024-11-07T22:40:27.892ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-11-07T22:40:27.892ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-07T22:40:27.892ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-07T22:40:27.892ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-07T22:40:27.892ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
702024-11-07T22:40:27.892ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-11-07T22:40:27.892ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-07T22:40:27.892ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-07T22:40:27.892ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-07T22:40:27.893ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
782024-11-07T22:40:27.893ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-07T22:40:27.893ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-07T22:40:27.893ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-07T22:40:27.893ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-07T22:40:27.893ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-11-07T22:40:27.893ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
842024-11-07T22:40:27.893ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-07T22:40:27.893ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-07T22:40:27.893ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
872024-11-07T22:40:27.893ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-07T22:40:27.893ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-07T22:40:27.893ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-11-07T22:40:27.893ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-07T22:40:27.893ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-07T22:40:27.893ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
932024-11-07T22:40:27.893ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-07T22:40:27.893ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-07T22:40:27.893ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-07T22:40:27.893ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-07T22:40:27.893ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-07T22:40:27.893ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-07T22:40:27.893ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-07T22:40:27.893ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-07T22:40:27.893ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-07T22:40:27.893ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1032024-11-07T22:40:27.893ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-07T22:40:27.893ZINFOSledAgent (bootstore): No ledger in /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-11-07T22:40:27.893ZINFOSledAgent (bootstore): No ledger in /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-11-07T22:40:27.893ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-07T22:40:27.893ZINFOSledAgent (bootstore): No ledger in /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-11-07T22:40:27.893ZINFOSledAgent (bootstore): No ledger in /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-11-07T22:40:27.893ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-07T22:40:27.893ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-07T22:40:27.893ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-07T22:40:27.904ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:733
1132024-11-07T22:40:27.904ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1121, tv_nsec: 411987900 } time_to_next_cleanup = 599.999916097s
1142024-11-07T22:40:27.904ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3910
1152024-11-07T22:40:27.904ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1162024-11-07T22:40:27.904ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-07T22:40:27.907ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-07T22:40:27.907ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-07T22:40:27.909ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-07T22:40:27.909ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1083
1212024-11-07T22:40:27.909ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-07T22:40:27.909ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1232024-11-07T22:40:27.909ZINFOSledAgent (RSS): No ledger in /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-07T22:40:27.909ZINFOSledAgent (RSS): No ledger in /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-07T22:40:27.909ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1146
1262024-11-07T22:40:27.909ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1272024-11-07T22:40:27.909ZINFOSledAgent (RSS): No ledger in /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-07T22:40:27.909ZINFOSledAgent (RSS): No ledger in /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-07T22:40:27.909ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1188
1302024-11-07T22:40:27.909ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-07T22:40:27.909ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-07T22:40:27.909ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1332024-11-07T22:40:27.909ZINFOSledAgent (RSS): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-07T22:40:27.910ZINFOSledAgent (RSS): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-07T22:40:27.910ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 (sled), rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-07T22:40:27.910ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1222
1372024-11-07T22:40:27.910ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-11-07T22:40:27.910ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-11-07T22:40:27.910ZINFOSledAgent (bootstore): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-11-07T22:40:27.910ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-11-07T22:40:27.910ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 (sled), rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-11-07T22:40:27.911ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4207
1432024-11-07T22:40:27.911ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4589
1442024-11-07T22:40:27.916ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-07T22:40:27.923ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-07T22:40:27.923ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-07T22:40:27.927ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-07T22:40:27.927ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-07T22:40:27.927ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:33614
1502024-11-07T22:40:27.927ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 (sled), rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-07T22:40:27.927ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-07T22:40:27.927ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-07T22:40:27.927ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-07T22:40:27.927ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1552024-11-07T22:40:27.927ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1562024-11-07T22:40:27.927ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-07T22:40:27.927ZINFOSledAgent (StorageManager): No ledger in /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-07T22:40:27.927ZINFOSledAgent (StorageManager): No ledger in /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-07T22:40:27.927ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1602024-11-07T22:40:27.927ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1612024-11-07T22:40:27.927ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1622024-11-07T22:40:27.927ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-07T22:40:27.927ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1642024-11-07T22:40:27.944ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1652024-11-07T22:40:27.965ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-07T22:40:27.982ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-07T22:40:28.005ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
1682024-11-07T22:40:28.005ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1692024-11-07T22:40:28.005ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
1702024-11-07T22:40:28.005ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-07T22:40:28.008ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 50.833092ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "079c7467-3741-41ae-b307-2f178efc2978", "content-length": "124", "date": "Thu, 07 Nov 2024 22:40:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "079c7467-3741-41ae-b307-2f178efc2978" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-07T22:40:28.018ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_fa6fb39a-dddd-477d-9120-b0fab05e8b5a/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-07T22:40:28.043ZINFOSledAgent: successfully created encrypted zvol: name="oxi_fa6fb39a-dddd-477d-9120-b0fab05e8b5a/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-07T22:40:28.043ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_fa6fb39a-dddd-477d-9120-b0fab05e8b5a/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-07T22:40:28.048ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
1762024-11-07T22:40:28.048ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-07T22:40:28.048ZINFOSledAgent (BackingFs): Ensuring dataset oxi_fa6fb39a-dddd-477d-9120-b0fab05e8b5a/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-07T22:40:28.060ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-07T22:40:28.060ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 106.654503ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "49a7d272-ca74-42a2-8223-f7f3301f1cf7", "content-length": "124", "date": "Thu, 07 Nov 2024 22:40:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "49a7d272-ca74-42a2-8223-f7f3301f1cf7" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-07T22:40:28.127ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-07T22:40:28.169ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-07T22:40:28.169ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 123.244365ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "74676df5-5234-4990-9692-cc2bd931a3a6", "content-length": "124", "date": "Thu, 07 Nov 2024 22:40:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "74676df5-5234-4990-9692-cc2bd931a3a6" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-07T22:40:28.293ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-11-07T22:40:28.294ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 243.59069ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bf617fda-606b-494b-b2f0-6cfd1e5f0a3c", "content-length": "124", "date": "Thu, 07 Nov 2024 22:40:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bf617fda-606b-494b-b2f0-6cfd1e5f0a3c" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-11-07T22:40:28.345ZINFOSledAgent (BackingFs): Mounting oxi_fa6fb39a-dddd-477d-9120-b0fab05e8b5a/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1862024-11-07T22:40:28.357ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1872024-11-07T22:40:28.358ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1882024-11-07T22:40:28.358ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1892024-11-07T22:40:28.358ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1902024-11-07T22:40:28.538ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-07T22:40:28.539ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 274.403ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7656ff44-a75d-4f02-a71a-ecaabd635e28", "content-length": "124", "date": "Thu, 07 Nov 2024 22:40:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7656ff44-a75d-4f02-a71a-ecaabd635e28" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-07T22:40:28.814ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-07T22:40:28.815ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 328.063427ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b033d5a3-715f-4407-bb01-faff98771db8", "content-length": "124", "date": "Thu, 07 Nov 2024 22:40:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b033d5a3-715f-4407-bb01-faff98771db8" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-07T22:40:29.096ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
1952024-11-07T22:40:29.101ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:61538 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
1962024-11-07T22:40:29.101ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
1972024-11-07T22:40:29.101ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:61538 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
1982024-11-07T22:40:29.102ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 193.908725ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
1992024-11-07T22:40:29.104ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2002024-11-07T22:40:29.104ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2012024-11-07T22:40:29.104ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:917 underlay_address = fd00:1122:3344:101::1
2022024-11-07T22:40:29.104ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-11-07T22:40:29.144ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-11-07T22:40:29.298ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 638.591607ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2052024-11-07T22:40:29.938ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 929.42185ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2062024-11-07T22:40:30.869ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.998225495s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2072024-11-07T22:40:31.531ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2664
2082024-11-07T22:40:31.531ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2882
2092024-11-07T22:40:31.531ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2534
2102024-11-07T22:40:31.531ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2581
2112024-11-07T22:40:31.531ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2963
2122024-11-07T22:40:31.531ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3005
2132024-11-07T22:40:31.533ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2807
2142024-11-07T22:40:31.534ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2575
2152024-11-07T22:40:31.534ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='43a27374-6630-4b8d-a3e3-a2857df923bd'/> <propval type="astring" name="rack_id" value='1a2f25b5-769a-4c68-be75-53fcae3bde7f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe15:6866'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='c1e85b8f-73ff-449f-b9a8-ac0480ffdec1'/> <propval type="astring" name="rack_id" value='1a2f25b5-769a-4c68-be75-53fcae3bde7f'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='c1e85b8f-73ff-449f-b9a8-ac0480ffdec1'/> <propval type="astring" name="rack_uuid" value='1a2f25b5-769a-4c68-be75-53fcae3bde7f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='c1e85b8f-73ff-449f-b9a8-ac0480ffdec1'/> <propval type="astring" name="rack_uuid" value='1a2f25b5-769a-4c68-be75-53fcae3bde7f'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-11-07T22:40:31.535ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-11-07T22:40:31.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 67.024491ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-11-07T22:40:32.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 88.068412ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-11-07T22:40:32.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 219.831175ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-07T22:40:32.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 276.292216ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-07T22:40:32.869ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.798786563s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2222024-11-07T22:40:32.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.038593901s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-07T22:40:34.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 853.708393ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-07T22:40:35.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 908.954931ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-07T22:40:35.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 688.314988ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-07T22:40:36.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 895.101041ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-07T22:40:37.670ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.936709274s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2282024-11-07T22:40:38.153ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) file = sled-agent/src/nexus.rs:527 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2292024-11-07T22:40:38.191ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2302024-11-07T22:40:38.191ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2312024-11-07T22:40:38.192ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2322024-11-07T22:40:38.192ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2332024-11-07T22:40:38.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2342024-11-07T22:40:38.192ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-11-07T22:40:38.192ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-07T22:40:38.193ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2372024-11-07T22:40:38.193ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2382024-11-07T22:40:38.193ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3910
2392024-11-07T22:40:38.193ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:33614
2402024-11-07T22:40:38.421ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2412024-11-07T22:40:38.421ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2422024-11-07T22:40:38.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2432024-11-07T22:40:38.421ZINFOSledAgent (RSS): No ledger in /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2442024-11-07T22:40:38.421ZINFOSledAgent (RSS): No ledger in /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-07T22:40:38.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2462024-11-07T22:40:38.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2472024-11-07T22:40:38.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2482024-11-07T22:40:38.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2492024-11-07T22:40:38.427ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4231 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2502024-11-07T22:40:38.427ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4247
2512024-11-07T22:40:38.427ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2522024-11-07T22:40:38.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65023
2532024-11-07T22:40:38.670ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2542024-11-07T22:40:38.670ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2552024-11-07T22:40:38.670ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:188
2562024-11-07T22:40:38.670ZINFOSledAgent (ServiceManager): No ledger in /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-07T22:40:38.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65023 req_id = 2471da13-d10e-4527-8761-e0f69ff33762 response_code = 200 uri = /inventory
2582024-11-07T22:40:38.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44598
2592024-11-07T22:40:38.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44598 req_id = d08cf9e3-97a0-4e6c-8286-e4f92e7b0cb8 response_code = 200 uri = /sled-role
2602024-11-07T22:40:38.702ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2612024-11-07T22:40:38.702ZINFOSledAgent (RSS): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2622024-11-07T22:40:38.702ZINFOSledAgent (RSS): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-07T22:40:38.702ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:886
2642024-11-07T22:40:38.733ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 8ad32978-a41e-4991-9a75-fca3bc0437f5, pool_id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1d70f001-263f-4439-9ac2-18b1cfa044d2, pool_id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 98b8cf95-3afa-4b99-a5cb-1009b15c427a, pool_id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: f3c6b9cc-ba15-4d7e-8243-4995f9a4be0c, pool_id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 0998df93-3e4b-4543-b923-607650fbf01e, pool_id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: be1da2bc-66af-425f-b89b-d2bcea68a325, pool_id: 6a8d312b-1855-4f59-8964-cdc4c8aad9f3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b38de4c3-3782-418a-9b84-2cf036b2330b, pool_id: c38ffc78-518d-45b9-9391-e3e1820de913 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 752889fc-00ab-47bb-aad8-427538c96418, pool_id: aa1b0888-f629-45fb-b793-272240a5e638 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: c5f826fc-855c-4fc2-b0e5-c83583ed45f1, pool_id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool) }] } file = sled-agent/src/rack_setup/service.rs:376 sled_address = [fd00:1122:3344:101::1]:12345
2652024-11-07T22:40:38.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34867
2662024-11-07T22:40:38.734ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:886 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2672024-11-07T22:40:38.734ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 8ad32978-a41e-4991-9a75-fca3bc0437f5, pool_id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 1d70f001-263f-4439-9ac2-18b1cfa044d2, pool_id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 98b8cf95-3afa-4b99-a5cb-1009b15c427a, pool_id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: f3c6b9cc-ba15-4d7e-8243-4995f9a4be0c, pool_id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 0998df93-3e4b-4543-b923-607650fbf01e, pool_id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: be1da2bc-66af-425f-b89b-d2bcea68a325, pool_id: 6a8d312b-1855-4f59-8964-cdc4c8aad9f3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b38de4c3-3782-418a-9b84-2cf036b2330b, pool_id: c38ffc78-518d-45b9-9391-e3e1820de913 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 752889fc-00ab-47bb-aad8-427538c96418, pool_id: aa1b0888-f629-45fb-b793-272240a5e638 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: c5f826fc-855c-4fc2-b0e5-c83583ed45f1, pool_id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2682024-11-07T22:40:38.734ZINFOSledAgent (StorageManager): No ledger in /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2692024-11-07T22:40:38.734ZINFOSledAgent (StorageManager): No ledger in /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-07T22:40:38.734ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2712024-11-07T22:40:38.734ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2722024-11-07T22:40:38.734ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2732024-11-07T22:40:38.734ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2742024-11-07T22:40:38.734ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2752024-11-07T22:40:38.880ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2762024-11-07T22:40:38.881ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool)
2772024-11-07T22:40:39.109ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10265181251219249569 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2782024-11-07T22:40:39.109ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13255135042270668226 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2792024-11-07T22:40:39.342ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2802024-11-07T22:40:39.344ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) file = sled-agent/src/probe_manager.rs:231 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
2812024-11-07T22:40:39.405ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }
2822024-11-07T22:40:39.413ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:225
2832024-11-07T22:40:39.414ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:227
2842024-11-07T22:40:39.414ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:231
2852024-11-07T22:40:39.414ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:233
2862024-11-07T22:40:39.414ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-11-07T22:40:39.414ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-07T22:40:39.414ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
2892024-11-07T22:40:39.450ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2902024-11-07T22:40:39.458ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_896a209a-9e6b-4a3e-85d1-8128327ab969/crypt/zone file = sled-storage/src/dataset.rs:288
2912024-11-07T22:40:39.632ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_896a209a-9e6b-4a3e-85d1-8128327ab969 file = sled-storage/src/dataset.rs:374
2922024-11-07T22:40:39.639ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2932024-11-07T22:40:39.639ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2942024-11-07T22:40:39.640ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2952024-11-07T22:40:39.640ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2962024-11-07T22:40:39.640ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2972024-11-07T22:40:39.649ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2982024-11-07T22:40:39.650ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool)
2992024-11-07T22:40:39.741ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }
3002024-11-07T22:40:39.749ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:225
3012024-11-07T22:40:39.749ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:227
3022024-11-07T22:40:39.749ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:231
3032024-11-07T22:40:39.749ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:233
3042024-11-07T22:40:39.749ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3052024-11-07T22:40:39.749ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-11-07T22:40:39.749ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3072024-11-07T22:40:39.783ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3082024-11-07T22:40:39.791ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_542fb670-2cd7-4cb9-9a65-01ef014dcdb4/crypt/zone file = sled-storage/src/dataset.rs:288
3092024-11-07T22:40:39.962ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_542fb670-2cd7-4cb9-9a65-01ef014dcdb4 file = sled-storage/src/dataset.rs:374
3102024-11-07T22:40:39.970ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3112024-11-07T22:40:39.970ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3122024-11-07T22:40:39.970ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3132024-11-07T22:40:39.970ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3142024-11-07T22:40:39.970ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3152024-11-07T22:40:39.980ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3162024-11-07T22:40:39.980ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool)
3172024-11-07T22:40:40.072ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }
3182024-11-07T22:40:40.080ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:225
3192024-11-07T22:40:40.080ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:227
3202024-11-07T22:40:40.080ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:231
3212024-11-07T22:40:40.080ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:233
3222024-11-07T22:40:40.080ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3232024-11-07T22:40:40.081ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-11-07T22:40:40.081ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3252024-11-07T22:40:40.116ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3262024-11-07T22:40:40.124ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6bcd12fd-a17a-4b71-b93d-84590e442e65/crypt/zone file = sled-storage/src/dataset.rs:288
3272024-11-07T22:40:40.299ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6bcd12fd-a17a-4b71-b93d-84590e442e65 file = sled-storage/src/dataset.rs:374
3282024-11-07T22:40:40.307ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3292024-11-07T22:40:40.307ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3302024-11-07T22:40:40.307ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3312024-11-07T22:40:40.307ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3322024-11-07T22:40:40.307ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3332024-11-07T22:40:40.316ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3342024-11-07T22:40:40.316ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 079e3938-061f-42e6-b89a-4de48c877f70 (zpool)
3352024-11-07T22:40:40.409ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }
3362024-11-07T22:40:40.417ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:225
3372024-11-07T22:40:40.417ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:227
3382024-11-07T22:40:40.417ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:231
3392024-11-07T22:40:40.417ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:233
3402024-11-07T22:40:40.417ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3412024-11-07T22:40:40.417ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3422024-11-07T22:40:40.417ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3432024-11-07T22:40:40.421ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) file = sled-agent/src/probe_manager.rs:231 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3442024-11-07T22:40:40.451ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3452024-11-07T22:40:40.460ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_079e3938-061f-42e6-b89a-4de48c877f70/crypt/zone file = sled-storage/src/dataset.rs:288
3462024-11-07T22:40:40.630ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_079e3938-061f-42e6-b89a-4de48c877f70 file = sled-storage/src/dataset.rs:374
3472024-11-07T22:40:40.638ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3482024-11-07T22:40:40.638ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3492024-11-07T22:40:40.638ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3502024-11-07T22:40:40.638ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3512024-11-07T22:40:40.638ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3522024-11-07T22:40:40.648ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3532024-11-07T22:40:40.648ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool)
3542024-11-07T22:40:40.743ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }
3552024-11-07T22:40:40.751ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:225
3562024-11-07T22:40:40.751ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:227
3572024-11-07T22:40:40.751ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:231
3582024-11-07T22:40:40.751ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:233
3592024-11-07T22:40:40.751ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3602024-11-07T22:40:40.751ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-11-07T22:40:40.751ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3622024-11-07T22:40:40.788ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3632024-11-07T22:40:40.796ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e246880a-4d88-4441-a6d6-a9e42d69d6eb/crypt/zone file = sled-storage/src/dataset.rs:288
3642024-11-07T22:40:40.970ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e246880a-4d88-4441-a6d6-a9e42d69d6eb file = sled-storage/src/dataset.rs:374
3652024-11-07T22:40:40.978ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3662024-11-07T22:40:40.978ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3672024-11-07T22:40:40.978ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3682024-11-07T22:40:40.978ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3692024-11-07T22:40:40.978ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3702024-11-07T22:40:40.988ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3712024-11-07T22:40:40.988ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6a8d312b-1855-4f59-8964-cdc4c8aad9f3 (zpool)
3722024-11-07T22:40:41.084ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 6a8d312b-1855-4f59-8964-cdc4c8aad9f3 (zpool), kind: External }
3732024-11-07T22:40:41.092ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:225
3742024-11-07T22:40:41.092ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:227
3752024-11-07T22:40:41.092ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:231
3762024-11-07T22:40:41.092ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:233
3772024-11-07T22:40:41.092ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3782024-11-07T22:40:41.092ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3792024-11-07T22:40:41.092ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3802024-11-07T22:40:41.129ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3812024-11-07T22:40:41.137ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6a8d312b-1855-4f59-8964-cdc4c8aad9f3/crypt/zone file = sled-storage/src/dataset.rs:288
3822024-11-07T22:40:41.311ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6a8d312b-1855-4f59-8964-cdc4c8aad9f3 file = sled-storage/src/dataset.rs:374
3832024-11-07T22:40:41.319ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3842024-11-07T22:40:41.319ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3852024-11-07T22:40:41.319ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3862024-11-07T22:40:41.319ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3872024-11-07T22:40:41.319ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3882024-11-07T22:40:41.329ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3892024-11-07T22:40:41.329ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c38ffc78-518d-45b9-9391-e3e1820de913 (zpool)
3902024-11-07T22:40:41.430ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: c38ffc78-518d-45b9-9391-e3e1820de913 (zpool), kind: External }
3912024-11-07T22:40:41.438ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:225
3922024-11-07T22:40:41.438ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:227
3932024-11-07T22:40:41.438ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:231
3942024-11-07T22:40:41.438ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:233
3952024-11-07T22:40:41.438ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3962024-11-07T22:40:41.438ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3972024-11-07T22:40:41.438ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3982024-11-07T22:40:41.474ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3992024-11-07T22:40:41.478ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) file = sled-agent/src/probe_manager.rs:231 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4002024-11-07T22:40:41.483ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c38ffc78-518d-45b9-9391-e3e1820de913/crypt/zone file = sled-storage/src/dataset.rs:288
4012024-11-07T22:40:41.658ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c38ffc78-518d-45b9-9391-e3e1820de913 file = sled-storage/src/dataset.rs:374
4022024-11-07T22:40:41.666ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4032024-11-07T22:40:41.666ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4042024-11-07T22:40:41.666ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4052024-11-07T22:40:41.666ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4062024-11-07T22:40:41.666ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4072024-11-07T22:40:41.675ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4082024-11-07T22:40:41.675ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = aa1b0888-f629-45fb-b793-272240a5e638 (zpool)
4092024-11-07T22:40:41.779ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: aa1b0888-f629-45fb-b793-272240a5e638 (zpool), kind: External }
4102024-11-07T22:40:41.788ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:225
4112024-11-07T22:40:41.788ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:227
4122024-11-07T22:40:41.788ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:231
4132024-11-07T22:40:41.788ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:233
4142024-11-07T22:40:41.788ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4152024-11-07T22:40:41.788ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4162024-11-07T22:40:41.788ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4172024-11-07T22:40:41.821ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4182024-11-07T22:40:41.829ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_aa1b0888-f629-45fb-b793-272240a5e638/crypt/zone file = sled-storage/src/dataset.rs:288
4192024-11-07T22:40:42.007ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_aa1b0888-f629-45fb-b793-272240a5e638 file = sled-storage/src/dataset.rs:374
4202024-11-07T22:40:42.015ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4212024-11-07T22:40:42.015ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4222024-11-07T22:40:42.015ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4232024-11-07T22:40:42.015ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4242024-11-07T22:40:42.015ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4252024-11-07T22:40:42.024ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4262024-11-07T22:40:42.024ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool)
4272024-11-07T22:40:42.118ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External }
4282024-11-07T22:40:42.126ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:225
4292024-11-07T22:40:42.126ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:227
4302024-11-07T22:40:42.126ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:231
4312024-11-07T22:40:42.126ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:233
4322024-11-07T22:40:42.126ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4332024-11-07T22:40:42.126ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4342024-11-07T22:40:42.126ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4352024-11-07T22:40:42.162ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4362024-11-07T22:40:42.170ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3f19b51d-8f23-4736-b0f1-315ae26a980a/crypt/zone file = sled-storage/src/dataset.rs:288
4372024-11-07T22:40:42.345ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3f19b51d-8f23-4736-b0f1-315ae26a980a file = sled-storage/src/dataset.rs:374
4382024-11-07T22:40:42.352ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4392024-11-07T22:40:42.352ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4402024-11-07T22:40:42.352ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4412024-11-07T22:40:42.352ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa6fb39a-dddd-477d-9120-b0fab05e8b5a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6a8d312b-1855-4f59-8964-cdc4c8aad9f3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c38ffc78-518d-45b9-9391-e3e1820de913 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: aa1b0888-f629-45fb-b793-272240a5e638 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4422024-11-07T22:40:42.352ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4432024-11-07T22:40:42.352ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4442024-11-07T22:40:42.352ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4452024-11-07T22:40:42.353ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:890 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4462024-11-07T22:40:42.353ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4472024-11-07T22:40:42.353ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:916 generation = Generation(1) sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4482024-11-07T22:40:42.353ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:921 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4492024-11-07T22:40:42.353ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:926 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4502024-11-07T22:40:42.353ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4512024-11-07T22:40:42.353ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:932 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4522024-11-07T22:40:42.353ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4532024-11-07T22:40:42.353ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:937 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4542024-11-07T22:40:42.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3619405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34867 req_id = 947f25f4-1c9f-4889-9ab9-963e7658ba9a response_code = 200 uri = /omicron-physical-disks
4552024-11-07T22:40:42.384ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: de9282a1-0aa7-4ad8-a39a-58f19d05b651 (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: e7c445ee-ab31-4494-81d3-0b2af41ae707 (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a127151b-10b2-4835-91ce-b493ecd30481 (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
4562024-11-07T22:40:42.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51243
4572024-11-07T22:40:42.384ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4582024-11-07T22:40:42.384ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4592024-11-07T22:40:42.436ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4602024-11-07T22:40:42.436ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4612024-11-07T22:40:42.480ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) file = sled-agent/src/probe_manager.rs:231 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4622024-11-07T22:40:42.487ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4632024-11-07T22:40:42.487ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4642024-11-07T22:40:42.538ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4652024-11-07T22:40:42.538ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:188
4662024-11-07T22:40:42.538ZINFOSledAgent (ServiceManager): No ledger in /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:188
4672024-11-07T22:40:42.538ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4682024-11-07T22:40:42.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4692024-11-07T22:40:42.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4702024-11-07T22:40:42.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4712024-11-07T22:40:42.634ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707 file = illumos-utils/src/zone.rs:325
4722024-11-07T22:40:42.637ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481 file = illumos-utils/src/zone.rs:325
4732024-11-07T22:40:42.642ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651 file = illumos-utils/src/zone.rs:325
4742024-11-07T22:40:42.653ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707 file = illumos-utils/src/zone.rs:363
4752024-11-07T22:40:42.658ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481 file = illumos-utils/src/zone.rs:363
4762024-11-07T22:40:42.662ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651 file = illumos-utils/src/zone.rs:363
4772024-11-07T22:40:43.483ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) file = sled-agent/src/probe_manager.rs:231 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4782024-11-07T22:40:44.240ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4792024-11-07T22:40:44.240ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4802024-11-07T22:40:44.240ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
4812024-11-07T22:40:44.724ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4822024-11-07T22:40:45.202ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4832024-11-07T22:40:45.202ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4842024-11-07T22:40:45.202ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4852024-11-07T22:40:45.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707") failed: Property not found. retry in 31.252456ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
4862024-11-07T22:40:45.211ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481
4872024-11-07T22:40:45.215ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651
4882024-11-07T22:40:45.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707") failed: Property not found. retry in 113.26095ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
4892024-11-07T22:40:45.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481") failed: Property not found. retry in 60.299896ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481
4902024-11-07T22:40:45.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651") failed: Property not found. retry in 33.059953ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651
4912024-11-07T22:40:45.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707") failed: Property not found. retry in 109.6334ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
4922024-11-07T22:40:45.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651") failed: Property not found. retry in 77.720903ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651
4932024-11-07T22:40:45.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481") failed: Property not found. retry in 53.273184ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481
4942024-11-07T22:40:45.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651") failed: Property not found. retry in 204.509218ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651
4952024-11-07T22:40:45.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481") failed: Property not found. retry in 199.384258ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481
4962024-11-07T22:40:45.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707") failed: Property not found. retry in 580.921211ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
4972024-11-07T22:40:45.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651") failed: Property not found. retry in 239.339787ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651
4982024-11-07T22:40:45.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481") failed: Property not found. retry in 501.453446ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481
4992024-11-07T22:40:45.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651") failed: Property not found. retry in 1.178161369s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651
5002024-11-07T22:40:46.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707") failed: Property not found. retry in 525.142971ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
5012024-11-07T22:40:46.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481") failed: Property not found. retry in 844.067355ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481
5022024-11-07T22:40:46.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707") failed: Property not found. retry in 1.221449769s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
5032024-11-07T22:40:47.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481") failed: Property not found. retry in 676.958559ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481
5042024-11-07T22:40:47.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651") failed: Property not found. retry in 1.490787146s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651
5052024-11-07T22:40:47.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481") failed: Property not found. retry in 1.1104845s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481
5062024-11-07T22:40:47.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707") failed: Property not found. retry in 513.938231ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
5072024-11-07T22:40:47.888ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4255
5082024-11-07T22:40:47.888ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4265 gateway = fd00:1122:3344:101::1
5092024-11-07T22:40:47.894ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4344
5102024-11-07T22:40:47.998ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4392
5112024-11-07T22:40:47.998ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4419
5122024-11-07T22:40:48.040ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4432
5132024-11-07T22:40:48.040ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4296
5142024-11-07T22:40:48.097ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4338
5152024-11-07T22:40:48.097ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4399 rack_subnet = fd00:1122:3344::
5162024-11-07T22:40:48.123ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4410
5172024-11-07T22:40:48.123ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4452
5182024-11-07T22:40:48.157ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13978309626306992167 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
5192024-11-07T22:40:48.158ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3624901700899748848 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
5202024-11-07T22:40:48.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:36668
5212024-11-07T22:40:48.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:36668 req_id = 8c684f13-dc95-4c4d-8294-ef991a0b129a response_code = 200 uri = /sled-identifiers
5222024-11-07T22:40:48.198ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4484
5232024-11-07T22:40:48.198ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4490
5242024-11-07T22:40:48.287ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4531
5252024-11-07T22:40:48.287ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5262024-11-07T22:40:48.320ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5272024-11-07T22:40:48.352ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5282024-11-07T22:40:48.352ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
5292024-11-07T22:40:48.353ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 0
5302024-11-07T22:40:48.353ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5312024-11-07T22:40:48.389ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
5322024-11-07T22:40:48.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707") failed: Property not found. retry in 1.083442882s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
5332024-11-07T22:40:48.439ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5342024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5352024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5362024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5372024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5382024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5392024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5402024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5412024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5422024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5432024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5442024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5452024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5462024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5472024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5482024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5492024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5502024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5512024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5522024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5532024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5542024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5552024-11-07T22:40:48.439ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5562024-11-07T22:40:48.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651") failed: Property not found. retry in 1.21769371s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651
5572024-11-07T22:40:48.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481") failed: Property not found. retry in 1.239280652s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481
5582024-11-07T22:40:49.112ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10265181251219249569 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
5592024-11-07T22:40:49.112ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13255135042270668226 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
5602024-11-07T22:40:49.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707") failed: Property not found. retry in 1.353192228s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
5612024-11-07T22:40:49.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651") failed: Property not found. retry in 931.235262ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651
5622024-11-07T22:40:50.878ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_e7c445ee-ab31-4494-81d3-0b2af41ae707
5632024-11-07T22:40:50.878ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_a127151b-10b2-4835-91ce-b493ecd30481
5642024-11-07T22:40:50.878ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_de9282a1-0aa7-4ad8-a39a-58f19d05b651
5652024-11-07T22:40:50.878ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5662024-11-07T22:40:50.878ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5672024-11-07T22:40:50.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8494532 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51243 req_id = afb31776-3eff-45c0-bda0-0bb3d3eb7d10 response_code = 204 uri = /omicron-zones
5682024-11-07T22:40:50.881ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5692024-11-07T22:40:50.925ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5702024-11-07T22:40:50.979ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5712024-11-07T22:40:51.024ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:612
5722024-11-07T22:40:51.024ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5732024-11-07T22:40:51.057ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5742024-11-07T22:40:51.058ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5752024-11-07T22:40:51.058ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5762024-11-07T22:40:51.086ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: de9282a1-0aa7-4ad8-a39a-58f19d05b651 (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: e7c445ee-ab31-4494-81d3-0b2af41ae707 (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a127151b-10b2-4835-91ce-b493ecd30481 (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 61c81892-0bdb-4da3-9815-23932409c1a2 (service), filesystem_pool: Some(ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8126a687-8e7a-4aff-9141-5004b074ee89, kind: Service { id: 61c81892-0bdb-4da3-9815-23932409c1a2 }, name: Name("ntp-61c81892-0bdb-4da3-9815-23932409c1a2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 83])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
5772024-11-07T22:40:51.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43715
5782024-11-07T22:40:51.087ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5792024-11-07T22:40:51.087ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5802024-11-07T22:40:51.127ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5812024-11-07T22:40:51.127ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5822024-11-07T22:40:51.159ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5832024-11-07T22:40:51.159ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5842024-11-07T22:40:51.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5852024-11-07T22:40:51.192ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:177
5862024-11-07T22:40:51.192ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:177
5872024-11-07T22:40:51.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5882024-11-07T22:40:51.203ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5892024-11-07T22:40:51.235ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5902024-11-07T22:40:51.236ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5912024-11-07T22:40:51.236ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5922024-11-07T22:40:51.265ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 173, 83]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5932024-11-07T22:40:51.265ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = boundary_ntp
5942024-11-07T22:40:51.266ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
5952024-11-07T22:40:51.266ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
5962024-11-07T22:40:51.266ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
5972024-11-07T22:40:51.267ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5982024-11-07T22:40:51.289ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2 file = illumos-utils/src/zone.rs:325
5992024-11-07T22:40:51.308ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2 file = illumos-utils/src/zone.rs:363
6002024-11-07T22:40:51.923ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6012024-11-07T22:40:51.923ZINFOSledAgent (ServiceManager): Booting oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6022024-11-07T22:40:52.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2") failed: Property not found. retry in 63.245426ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6032024-11-07T22:40:52.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2") failed: Property not found. retry in 78.758829ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6042024-11-07T22:40:52.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2") failed: Property not found. retry in 210.685058ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6052024-11-07T22:40:52.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2") failed: Property not found. retry in 502.425105ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6062024-11-07T22:40:52.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2") failed: Property not found. retry in 1.127974325s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6072024-11-07T22:40:54.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2") failed: Property not found. retry in 844.886626ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6082024-11-07T22:40:54.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2") failed: Property not found. retry in 1.107656457s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6092024-11-07T22:40:56.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2") failed: Property not found. retry in 637.083762ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6102024-11-07T22:40:56.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2") failed: Property not found. retry in 764.563235ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6112024-11-07T22:40:57.511ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2
6122024-11-07T22:40:57.511ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6132024-11-07T22:40:57.511ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6142024-11-07T22:40:57.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6425241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43715 req_id = 4ee659a6-32cf-4646-8e2e-eb8beee94ca8 response_code = 204 uri = /omicron-zones
6152024-11-07T22:40:57.514ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:653
6162024-11-07T22:40:57.544ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6172024-11-07T22:40:57.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51656
6182024-11-07T22:40:57.553ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6192024-11-07T22:40:57.553ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8508 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51656 req_id = e3dd6f8b-b45d-4c78-a119-6303407c9e4a response_code = 500 uri = /timesync
6202024-11-07T22:40:57.555ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6212024-11-07T22:40:57.652ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6222024-11-07T22:40:57.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60943
6232024-11-07T22:40:58.160ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13978309626306992167 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
6242024-11-07T22:40:58.160ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3624901700899748848 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
6252024-11-07T22:40:59.114ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10265181251219249569 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
6262024-11-07T22:40:59.114ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13255135042270668226 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
6272024-11-07T22:41:00.176ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16170740942567250893 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
6282024-11-07T22:41:00.820ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5818469417015402350 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
6292024-11-07T22:41:00.880ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17045180034600166943 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
6302024-11-07T22:41:01.660ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_61c81892-0bdb-4da3-9815-23932409c1a2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3863
6312024-11-07T22:41:01.660ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60943 req_id = 1108ef5e-a3e5-4506-a6b1-4f418e20186c response_code = 500 uri = /timesync
6322024-11-07T22:41:01.663ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6332024-11-07T22:41:01.836ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6342024-11-07T22:41:01.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54814
6352024-11-07T22:41:01.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54814 req_id = a7e2059c-0a40-4877-8113-fc67d889dcbc response_code = 200 uri = /timesync
6362024-11-07T22:41:01.847ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6372024-11-07T22:41:01.847ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6382024-11-07T22:41:02.003ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6392024-11-07T22:41:02.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55463
6402024-11-07T22:41:02.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9425 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55463 req_id = ccb46b37-dc3a-4fce-b40c-3cd8ade501d0 response_code = 200 uri = /timesync
6412024-11-07T22:41:02.015ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6422024-11-07T22:41:02.015ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6432024-11-07T22:41:02.266ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6442024-11-07T22:41:02.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42673
6452024-11-07T22:41:02.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42673 req_id = 009880d1-11cf-4993-a7ca-972b0d0aab2b response_code = 200 uri = /timesync
6462024-11-07T22:41:02.276ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6472024-11-07T22:41:02.277ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6482024-11-07T22:41:02.418ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6492024-11-07T22:41:02.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52354
6502024-11-07T22:41:02.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52354 req_id = cd1fd410-f4b2-45ab-a1fb-6ea157eb2fc1 response_code = 200 uri = /timesync
6512024-11-07T22:41:02.427ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6522024-11-07T22:41:02.427ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6532024-11-07T22:41:02.650ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6542024-11-07T22:41:02.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40870
6552024-11-07T22:41:02.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40870 req_id = 87fad09c-e567-4d69-b3e8-c25898046209 response_code = 200 uri = /timesync
6562024-11-07T22:41:02.661ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6572024-11-07T22:41:02.661ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6582024-11-07T22:41:03.030ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6592024-11-07T22:41:03.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37416
6602024-11-07T22:41:03.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7625 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37416 req_id = 675db780-b557-4e2c-ac49-a04e951d5675 response_code = 200 uri = /timesync
6612024-11-07T22:41:03.041ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6622024-11-07T22:41:03.041ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6632024-11-07T22:41:03.002ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6642024-11-07T22:41:03.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52619
6652024-11-07T22:41:03.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8575 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52619 req_id = b8a5849a-3dfa-432a-8f16-cac238860cc2 response_code = 200 uri = /timesync
6662024-11-07T22:41:03.013ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6672024-11-07T22:41:03.013ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6682024-11-07T22:41:03.150ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6692024-11-07T22:41:03.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57689
6702024-11-07T22:41:03.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 19692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57689 req_id = 1ff2dd51-3f0c-40d3-aa65-0b45bcf430dd response_code = 200 uri = /timesync
6712024-11-07T22:41:03.175ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2491905848, ip_addr: 148.135.119.56, stratum: 3, ref_time: 1731019263.0125732, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6722024-11-07T22:41:03.175ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1308
6732024-11-07T22:41:03.205ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: de9282a1-0aa7-4ad8-a39a-58f19d05b651 (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: e7c445ee-ab31-4494-81d3-0b2af41ae707 (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a127151b-10b2-4835-91ce-b493ecd30481 (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 61c81892-0bdb-4da3-9815-23932409c1a2 (service), filesystem_pool: Some(ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8126a687-8e7a-4aff-9141-5004b074ee89, kind: Service { id: 61c81892-0bdb-4da3-9815-23932409c1a2 }, name: Name("ntp-61c81892-0bdb-4da3-9815-23932409c1a2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 83])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 1db428b1-fc12-4225-b98f-12f52868915b (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } } } }, OmicronZoneConfig { id: f514120e-ab80-43ed-aeca-fe9efa216aea (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d (service), filesystem_pool: Some(ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7127177f-253b-40a2-8bb7-fb243f954d18 (service), filesystem_pool: Some(ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
6742024-11-07T22:41:03.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47832
6752024-11-07T22:41:03.206ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6762024-11-07T22:41:03.206ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6772024-11-07T22:41:03.240ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6782024-11-07T22:41:03.240ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6792024-11-07T22:41:03.273ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6802024-11-07T22:41:03.273ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6812024-11-07T22:41:03.303ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1db428b1-fc12-4225-b98f-12f52868915b, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6822024-11-07T22:41:03.303ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1db428b1-fc12-4225-b98f-12f52868915b, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Cockroach }, responder: ... }
6832024-11-07T22:41:03.357ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f514120e-ab80-43ed-aeca-fe9efa216aea, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6842024-11-07T22:41:03.357ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f514120e-ab80-43ed-aeca-fe9efa216aea, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
6852024-11-07T22:41:03.408ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6862024-11-07T22:41:03.408ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: Cockroach }, responder: ... }
6872024-11-07T22:41:03.458ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6882024-11-07T22:41:03.458ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }, kind: Cockroach }, responder: ... }
6892024-11-07T22:41:03.511ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7127177f-253b-40a2-8bb7-fb243f954d18, dataset_name: DatasetName { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6902024-11-07T22:41:03.511ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 7127177f-253b-40a2-8bb7-fb243f954d18, dataset_name: DatasetName { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }, kind: Cockroach }, responder: ... }
6912024-11-07T22:41:03.563ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6922024-11-07T22:41:03.563ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:177
6932024-11-07T22:41:03.563ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:177
6942024-11-07T22:41:03.563ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6952024-11-07T22:41:03.595ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
6962024-11-07T22:41:03.595ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
6972024-11-07T22:41:03.595ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
6982024-11-07T22:41:03.595ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
6992024-11-07T22:41:03.595ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
7002024-11-07T22:41:03.595ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b", TimeNotSynchronized), ("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d", TimeNotSynchronized), ("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18", TimeNotSynchronized), ("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d", TimeNotSynchronized), ("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 389211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47832 req_id = 170929f6-f3a0-4397-8257-d8cef68a7768 response_code = 500 uri = /omicron-zones
7012024-11-07T22:41:03.595ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "170929f6-f3a0-4397-8257-d8cef68a7768", "content-length": "124", "date": "Thu, 07 Nov 2024 22:41:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "170929f6-f3a0-4397-8257-d8cef68a7768" } file = sled-agent/src/rack_setup/service.rs:496 retry_after = 61.690028ms sled_address = [fd00:1122:3344:101::1]:12345
7022024-11-07T22:41:03.658ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: de9282a1-0aa7-4ad8-a39a-58f19d05b651 (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: e7c445ee-ab31-4494-81d3-0b2af41ae707 (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a127151b-10b2-4835-91ce-b493ecd30481 (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 61c81892-0bdb-4da3-9815-23932409c1a2 (service), filesystem_pool: Some(ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8126a687-8e7a-4aff-9141-5004b074ee89, kind: Service { id: 61c81892-0bdb-4da3-9815-23932409c1a2 }, name: Name("ntp-61c81892-0bdb-4da3-9815-23932409c1a2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 83])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 1db428b1-fc12-4225-b98f-12f52868915b (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } } } }, OmicronZoneConfig { id: f514120e-ab80-43ed-aeca-fe9efa216aea (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d (service), filesystem_pool: Some(ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7127177f-253b-40a2-8bb7-fb243f954d18 (service), filesystem_pool: Some(ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
7032024-11-07T22:41:03.658ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7042024-11-07T22:41:03.658ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7052024-11-07T22:41:03.690ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7062024-11-07T22:41:03.690ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7072024-11-07T22:41:03.721ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7082024-11-07T22:41:03.721ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7092024-11-07T22:41:03.752ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1db428b1-fc12-4225-b98f-12f52868915b, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7102024-11-07T22:41:03.752ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1db428b1-fc12-4225-b98f-12f52868915b, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7112024-11-07T22:41:03.784ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f514120e-ab80-43ed-aeca-fe9efa216aea, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7122024-11-07T22:41:03.784ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f514120e-ab80-43ed-aeca-fe9efa216aea, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7132024-11-07T22:41:03.817ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7142024-11-07T22:41:03.817ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7152024-11-07T22:41:03.849ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7162024-11-07T22:41:03.849ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7172024-11-07T22:41:03.882ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7127177f-253b-40a2-8bb7-fb243f954d18, dataset_name: DatasetName { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7182024-11-07T22:41:03.882ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 7127177f-253b-40a2-8bb7-fb243f954d18, dataset_name: DatasetName { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }, kind: Cockroach }, responder: ... }
7192024-11-07T22:41:03.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7202024-11-07T22:41:03.914ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:177
7212024-11-07T22:41:03.914ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:177
7222024-11-07T22:41:03.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7232024-11-07T22:41:03.947ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
7242024-11-07T22:41:03.947ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
7252024-11-07T22:41:03.947ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
7262024-11-07T22:41:03.947ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
7272024-11-07T22:41:03.947ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
7282024-11-07T22:41:03.947ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b", TimeNotSynchronized), ("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18", TimeNotSynchronized), ("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d", TimeNotSynchronized), ("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d", TimeNotSynchronized), ("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 288633 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47832 req_id = 2f004522-6d22-4d48-9e86-17fb273bdb46 response_code = 500 uri = /omicron-zones
7292024-11-07T22:41:03.947ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2f004522-6d22-4d48-9e86-17fb273bdb46", "content-length": "124", "date": "Thu, 07 Nov 2024 22:41:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2f004522-6d22-4d48-9e86-17fb273bdb46" } file = sled-agent/src/rack_setup/service.rs:496 retry_after = 138.92863ms sled_address = [fd00:1122:3344:101::1]:12345
7302024-11-07T22:41:04.087ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: de9282a1-0aa7-4ad8-a39a-58f19d05b651 (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: e7c445ee-ab31-4494-81d3-0b2af41ae707 (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a127151b-10b2-4835-91ce-b493ecd30481 (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 61c81892-0bdb-4da3-9815-23932409c1a2 (service), filesystem_pool: Some(ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8126a687-8e7a-4aff-9141-5004b074ee89, kind: Service { id: 61c81892-0bdb-4da3-9815-23932409c1a2 }, name: Name("ntp-61c81892-0bdb-4da3-9815-23932409c1a2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 83])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 1db428b1-fc12-4225-b98f-12f52868915b (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } } } }, OmicronZoneConfig { id: f514120e-ab80-43ed-aeca-fe9efa216aea (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d (service), filesystem_pool: Some(ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7127177f-253b-40a2-8bb7-fb243f954d18 (service), filesystem_pool: Some(ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
7312024-11-07T22:41:04.088ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7322024-11-07T22:41:04.088ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7332024-11-07T22:41:04.119ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7342024-11-07T22:41:04.119ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7352024-11-07T22:41:04.150ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7362024-11-07T22:41:04.150ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7372024-11-07T22:41:04.180ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1db428b1-fc12-4225-b98f-12f52868915b, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7382024-11-07T22:41:04.180ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1db428b1-fc12-4225-b98f-12f52868915b, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7392024-11-07T22:41:04.210ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f514120e-ab80-43ed-aeca-fe9efa216aea, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7402024-11-07T22:41:04.210ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f514120e-ab80-43ed-aeca-fe9efa216aea, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7412024-11-07T22:41:04.242ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7422024-11-07T22:41:04.242ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7432024-11-07T22:41:04.270ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7442024-11-07T22:41:04.270ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7452024-11-07T22:41:04.299ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7127177f-253b-40a2-8bb7-fb243f954d18, dataset_name: DatasetName { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7462024-11-07T22:41:04.299ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 7127177f-253b-40a2-8bb7-fb243f954d18, dataset_name: DatasetName { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }, kind: Cockroach }, responder: ... }
7472024-11-07T22:41:04.329ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7482024-11-07T22:41:04.329ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:177
7492024-11-07T22:41:04.329ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:177
7502024-11-07T22:41:04.329ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7512024-11-07T22:41:04.407ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7522024-11-07T22:41:04.407ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7532024-11-07T22:41:04.407ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7542024-11-07T22:41:04.407ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7552024-11-07T22:41:04.407ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7562024-11-07T22:41:04.499ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d file = illumos-utils/src/zone.rs:325
7572024-11-07T22:41:04.503ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18 file = illumos-utils/src/zone.rs:325
7582024-11-07T22:41:04.508ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea file = illumos-utils/src/zone.rs:325
7592024-11-07T22:41:04.512ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d file = illumos-utils/src/zone.rs:325
7602024-11-07T22:41:04.516ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b file = illumos-utils/src/zone.rs:325
7612024-11-07T22:41:04.521ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d file = illumos-utils/src/zone.rs:363
7622024-11-07T22:41:04.525ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18 file = illumos-utils/src/zone.rs:363
7632024-11-07T22:41:04.530ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea file = illumos-utils/src/zone.rs:363
7642024-11-07T22:41:04.534ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d file = illumos-utils/src/zone.rs:363
7652024-11-07T22:41:04.538ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b file = illumos-utils/src/zone.rs:363
7662024-11-07T22:41:07.045ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 255.562095ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
7672024-11-07T22:41:07.464ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f514120e-ab80-43ed-aeca-fe9efa216aea'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7682024-11-07T22:41:07.464ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7127177f-253b-40a2-8bb7-fb243f954d18'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7692024-11-07T22:41:07.464ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
7702024-11-07T22:41:07.470ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
7712024-11-07T22:41:07.475ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='930e82f8-1d16-4133-99b6-4cb7a91c0a5d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7722024-11-07T22:41:07.475ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
7732024-11-07T22:41:07.485ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='40a3a03b-5dfb-4ea7-8339-2a617a71ab1d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7742024-11-07T22:41:07.485ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1db428b1-fc12-4225-b98f-12f52868915b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7752024-11-07T22:41:07.485ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
7762024-11-07T22:41:07.489ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
7772024-11-07T22:41:07.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 52.77538ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
7782024-11-07T22:41:07.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 58.094802ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
7792024-11-07T22:41:07.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 46.012719ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
7802024-11-07T22:41:07.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 60.46813ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
7812024-11-07T22:41:07.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 53.194306ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
7822024-11-07T22:41:07.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 59.272819ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
7832024-11-07T22:41:07.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 130.015974ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
7842024-11-07T22:41:08.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 67.841454ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
7852024-11-07T22:41:08.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 106.868625ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
7862024-11-07T22:41:08.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 87.083131ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
7872024-11-07T22:41:08.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 100.347558ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
7882024-11-07T22:41:08.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 289.445985ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
7892024-11-07T22:41:08.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 121.571864ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
7902024-11-07T22:41:09.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 172.929621ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
7912024-11-07T22:41:10.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 100.281067ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
7922024-11-07T22:41:10.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 385.644724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
7932024-11-07T22:41:10.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 321.775782ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
7942024-11-07T22:41:10.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 531.093664ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
7952024-11-07T22:41:10.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 365.713702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
7962024-11-07T22:41:10.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 275.212945ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
7972024-11-07T22:41:10.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 857.649174ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
7982024-11-07T22:41:10.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 1.047668493s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
7992024-11-07T22:41:10.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 814.141024ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8002024-11-07T22:41:10.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 1.155904244s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8012024-11-07T22:41:10.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 1.127625021s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8022024-11-07T22:41:11.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 966.281609ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8032024-11-07T22:41:11.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.363734247s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8042024-11-07T22:41:11.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 1.489267997s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8052024-11-07T22:41:11.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 1.02361871s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8062024-11-07T22:41:11.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 810.445513ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8072024-11-07T22:41:12.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 1.348084625s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8082024-11-07T22:41:12.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 676.301599ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8092024-11-07T22:41:12.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.28532136s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8102024-11-07T22:41:12.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 1.431394321s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8112024-11-07T22:41:13.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 1.400544638s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8122024-11-07T22:41:13.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 1.065740449s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8132024-11-07T22:41:13.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 966.014339ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8142024-11-07T22:41:14.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.466396481s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8152024-11-07T22:41:14.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 1.37841647s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8162024-11-07T22:41:14.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 1.433645893s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8172024-11-07T22:41:14.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 1.007965444s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8182024-11-07T22:41:14.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 620.911871ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8192024-11-07T22:41:15.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 716.604428ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8202024-11-07T22:41:15.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 1.389811198s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8212024-11-07T22:41:15.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.308325555s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8222024-11-07T22:41:15.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 559.257152ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8232024-11-07T22:41:15.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 1.073514953s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8242024-11-07T22:41:16.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 1.424045677s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8252024-11-07T22:41:16.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 590.425952ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8262024-11-07T22:41:16.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 554.438622ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8272024-11-07T22:41:16.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 646.261737ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8282024-11-07T22:41:16.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 1.277184371s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8292024-11-07T22:41:17.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 1.008613026s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8302024-11-07T22:41:17.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 1.394671785s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8312024-11-07T22:41:17.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 1.097273224s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8322024-11-07T22:41:17.521ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60257
8332024-11-07T22:41:17.521ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60257 req_id = 9115ad0e-e297-440e-ab85-b3db20426c8a response_code = 200 uri = /baseboard
8342024-11-07T22:41:17.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.130692978s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8352024-11-07T22:41:18.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 518.409077ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8362024-11-07T22:41:18.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 1.247214467s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8372024-11-07T22:41:18.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 1.260661515s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8382024-11-07T22:41:18.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 681.49275ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8392024-11-07T22:41:18.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.127851289s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8402024-11-07T22:41:18.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 774.824637ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8412024-11-07T22:41:19.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 571.508358ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8422024-11-07T22:41:19.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 861.610058ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8432024-11-07T22:41:19.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 1.413588542s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8442024-11-07T22:41:19.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 840.988063ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8452024-11-07T22:41:19.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 1.397064017s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8462024-11-07T22:41:19.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 1.17883896s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8472024-11-07T22:41:20.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 1.411371533s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8482024-11-07T22:41:20.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.030579173s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8492024-11-07T22:41:21.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 1.464281414s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8502024-11-07T22:41:21.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 1.356797055s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8512024-11-07T22:41:21.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 1.082961404s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8522024-11-07T22:41:21.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.479436652s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8532024-11-07T22:41:21.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 1.309601964s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8542024-11-07T22:41:22.355ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 577.478228ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
8552024-11-07T22:41:22.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea") failed: Property not found. retry in 966.017856ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8562024-11-07T22:41:22.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d") failed: Property not found. retry in 1.141621619s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8572024-11-07T22:41:22.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 519.512466ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8582024-11-07T22:41:23.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d") failed: Property not found. retry in 722.445331ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8592024-11-07T22:41:23.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18") failed: Property not found. retry in 928.562794ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8602024-11-07T22:41:23.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.089385526s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8612024-11-07T22:41:24.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 870.931565ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8622024-11-07T22:41:25.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.265650022s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8632024-11-07T22:41:26.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.242722912s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8642024-11-07T22:41:27.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.200033617s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8652024-11-07T22:41:28.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 603.807279ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8662024-11-07T22:41:29.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 585.264141ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8672024-11-07T22:41:30.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.314400023s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8682024-11-07T22:41:31.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 702.511803ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8692024-11-07T22:41:32.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.365089335s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8702024-11-07T22:41:33.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.170465683s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8712024-11-07T22:41:34.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 567.914225ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8722024-11-07T22:41:35.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b") failed: Property not found. retry in 1.426855137s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8732024-11-07T22:41:36.779ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_930e82f8-1d16-4133-99b6-4cb7a91c0a5d
8742024-11-07T22:41:36.779ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_7127177f-253b-40a2-8bb7-fb243f954d18
8752024-11-07T22:41:36.779ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_f514120e-ab80-43ed-aeca-fe9efa216aea
8762024-11-07T22:41:36.779ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_40a3a03b-5dfb-4ea7-8339-2a617a71ab1d
8772024-11-07T22:41:36.779ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_1db428b1-fc12-4225-b98f-12f52868915b
8782024-11-07T22:41:36.779ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8792024-11-07T22:41:36.783ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8802024-11-07T22:41:36.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32668282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47832 req_id = 767710b2-ca08-4025-851b-395b5df0f1bd response_code = 204 uri = /omicron-zones
8812024-11-07T22:41:36.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52883
8822024-11-07T22:41:36.845ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3706
8832024-11-07T22:41:44.051ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3724
8842024-11-07T22:41:55.912ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3747
8852024-11-07T22:41:55.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 19095604 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52883 req_id = ddd63a6c-81e0-4d9a-9a21-a4afaeccd4e3 response_code = 204 uri = /cockroachdb
8862024-11-07T22:41:55.912ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43529
8872024-11-07T22:41:55.913ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43529 req_id = b6e5bf02-1f32-47b2-b42d-0ee926de1390 response_code = 200 uri = /baseboard
8882024-11-07T22:41:55.916ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 511.245019ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
8892024-11-07T22:41:55.948ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: de9282a1-0aa7-4ad8-a39a-58f19d05b651 (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: e7c445ee-ab31-4494-81d3-0b2af41ae707 (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a127151b-10b2-4835-91ce-b493ecd30481 (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 61c81892-0bdb-4da3-9815-23932409c1a2 (service), filesystem_pool: Some(ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8126a687-8e7a-4aff-9141-5004b074ee89, kind: Service { id: 61c81892-0bdb-4da3-9815-23932409c1a2 }, name: Name("ntp-61c81892-0bdb-4da3-9815-23932409c1a2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 83])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 1db428b1-fc12-4225-b98f-12f52868915b (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } } } }, OmicronZoneConfig { id: f514120e-ab80-43ed-aeca-fe9efa216aea (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d (service), filesystem_pool: Some(ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7127177f-253b-40a2-8bb7-fb243f954d18 (service), filesystem_pool: Some(ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External } } } }, OmicronZoneConfig { id: 939b4884-df0a-49e9-b0e5-27de78137ddd (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 377e4941-a34d-4c51-b725-3cc833f8df14 (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 42e8095c-4973-40db-9d13-0be7e130d89d (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1d0ef856-8367-48e8-a7e7-21f345224101 (service), filesystem_pool: Some(ZpoolName { id: 6a8d312b-1855-4f59-8964-cdc4c8aad9f3 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 41cb459b-a9cd-46b7-b575-71baf0b03aa3 (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } } } }, OmicronZoneConfig { id: dd6358e0-aa95-4e4d-bb91-75a192337727 (service), filesystem_pool: Some(ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 949ce051-2791-4bab-87b3-d767f6321325 (service), filesystem_pool: Some(ZpoolName { id: aa1b0888-f629-45fb-b793-272240a5e638 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: a32e0ae0-9c04-41c3-8849-40577b780ef0 (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 35f47ca0-16aa-4648-a4bb-ea527c45c8c5 (service), filesystem_pool: Some(ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External } } } }, OmicronZoneConfig { id: c5b9804e-6cba-4dfb-814d-ae73483c83a8 (service), filesystem_pool: Some(ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 635ebbc4-7443-4d5b-ada0-64b941ea5702 (service), filesystem_pool: Some(ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External } } } }, OmicronZoneConfig { id: 722550d9-f709-4f5d-89c9-b29858498f2c (service), filesystem_pool: Some(ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External } } } }, OmicronZoneConfig { id: df7d394a-6ba7-4b06-bcc0-8b33528280f0 (service), filesystem_pool: Some(ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External } } } }, OmicronZoneConfig { id: ca4144bb-dfba-4597-8389-b37525e85c55 (service), filesystem_pool: Some(ZpoolName { id: 6a8d312b-1855-4f59-8964-cdc4c8aad9f3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6a8d312b-1855-4f59-8964-cdc4c8aad9f3 (zpool), kind: External } } } }, OmicronZoneConfig { id: c94d72cb-45d2-40e1-8cf8-5c11e94896fd (service), filesystem_pool: Some(ZpoolName { id: c38ffc78-518d-45b9-9391-e3e1820de913 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c38ffc78-518d-45b9-9391-e3e1820de913 (zpool), kind: External } } } }, OmicronZoneConfig { id: 964ffa14-9b6a-4b9f-bf79-95eddda7df66 (service), filesystem_pool: Some(ZpoolName { id: aa1b0888-f629-45fb-b793-272240a5e638 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aa1b0888-f629-45fb-b793-272240a5e638 (zpool), kind: External } } } }, OmicronZoneConfig { id: d50d879b-6c47-4b42-82ba-218fec18cbc7 (service), filesystem_pool: Some(ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
8902024-11-07T22:41:55.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35908
8912024-11-07T22:41:55.948ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8922024-11-07T22:41:55.948ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: de9282a1-0aa7-4ad8-a39a-58f19d05b651, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8932024-11-07T22:41:56.027ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8942024-11-07T22:41:56.027ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e7c445ee-ab31-4494-81d3-0b2af41ae707, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8952024-11-07T22:41:56.103ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8962024-11-07T22:41:56.103ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a127151b-10b2-4835-91ce-b493ecd30481, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8972024-11-07T22:41:56.175ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1db428b1-fc12-4225-b98f-12f52868915b, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8982024-11-07T22:41:56.175ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1db428b1-fc12-4225-b98f-12f52868915b, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8992024-11-07T22:41:56.223ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f514120e-ab80-43ed-aeca-fe9efa216aea, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9002024-11-07T22:41:56.223ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f514120e-ab80-43ed-aeca-fe9efa216aea, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9012024-11-07T22:41:56.288ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9022024-11-07T22:41:56.288ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 930e82f8-1d16-4133-99b6-4cb7a91c0a5d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9032024-11-07T22:41:56.369ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9042024-11-07T22:41:56.369ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 40a3a03b-5dfb-4ea7-8339-2a617a71ab1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9052024-11-07T22:41:56.426ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7127177f-253b-40a2-8bb7-fb243f954d18, dataset_name: DatasetName { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9062024-11-07T22:41:56.426ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 7127177f-253b-40a2-8bb7-fb243f954d18, dataset_name: DatasetName { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }, kind: Cockroach }, responder: ... }
9072024-11-07T22:41:56.485ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 939b4884-df0a-49e9-b0e5-27de78137ddd, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9082024-11-07T22:41:56.485ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 939b4884-df0a-49e9-b0e5-27de78137ddd, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9092024-11-07T22:41:56.641ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19da6a5b-073a-4e12-8775-91fc61c1e962, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9102024-11-07T22:41:56.641ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 19da6a5b-073a-4e12-8775-91fc61c1e962, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9112024-11-07T22:41:56.782ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41cb459b-a9cd-46b7-b575-71baf0b03aa3, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
9122024-11-07T22:41:56.782ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 41cb459b-a9cd-46b7-b575-71baf0b03aa3, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9132024-11-07T22:41:56.951ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 35f47ca0-16aa-4648-a4bb-ea527c45c8c5, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9142024-11-07T22:41:56.951ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 35f47ca0-16aa-4648-a4bb-ea527c45c8c5, dataset_name: DatasetName { pool_name: ZpoolName { id: 896a209a-9e6b-4a3e-85d1-8128327ab969 (zpool), kind: External }, kind: Crucible }, responder: ... }
9152024-11-07T22:41:57.064ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c5b9804e-6cba-4dfb-814d-ae73483c83a8, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9162024-11-07T22:41:57.064ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: c5b9804e-6cba-4dfb-814d-ae73483c83a8, dataset_name: DatasetName { pool_name: ZpoolName { id: 542fb670-2cd7-4cb9-9a65-01ef014dcdb4 (zpool), kind: External }, kind: Crucible }, responder: ... }
9172024-11-07T22:41:57.186ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 635ebbc4-7443-4d5b-ada0-64b941ea5702, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9182024-11-07T22:41:57.186ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 635ebbc4-7443-4d5b-ada0-64b941ea5702, dataset_name: DatasetName { pool_name: ZpoolName { id: 6bcd12fd-a17a-4b71-b93d-84590e442e65 (zpool), kind: External }, kind: Crucible }, responder: ... }
9192024-11-07T22:41:57.312ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 722550d9-f709-4f5d-89c9-b29858498f2c, dataset_name: DatasetName { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9202024-11-07T22:41:57.312ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 722550d9-f709-4f5d-89c9-b29858498f2c, dataset_name: DatasetName { pool_name: ZpoolName { id: 079e3938-061f-42e6-b89a-4de48c877f70 (zpool), kind: External }, kind: Crucible }, responder: ... }
9212024-11-07T22:41:57.417ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: df7d394a-6ba7-4b06-bcc0-8b33528280f0, dataset_name: DatasetName { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9222024-11-07T22:41:57.417ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: df7d394a-6ba7-4b06-bcc0-8b33528280f0, dataset_name: DatasetName { pool_name: ZpoolName { id: e246880a-4d88-4441-a6d6-a9e42d69d6eb (zpool), kind: External }, kind: Crucible }, responder: ... }
9232024-11-07T22:41:57.554ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ca4144bb-dfba-4597-8389-b37525e85c55, dataset_name: DatasetName { pool_name: ZpoolName { id: 6a8d312b-1855-4f59-8964-cdc4c8aad9f3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9242024-11-07T22:41:57.554ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: ca4144bb-dfba-4597-8389-b37525e85c55, dataset_name: DatasetName { pool_name: ZpoolName { id: 6a8d312b-1855-4f59-8964-cdc4c8aad9f3 (zpool), kind: External }, kind: Crucible }, responder: ... }
9252024-11-07T22:41:57.680ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c94d72cb-45d2-40e1-8cf8-5c11e94896fd, dataset_name: DatasetName { pool_name: ZpoolName { id: c38ffc78-518d-45b9-9391-e3e1820de913 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9262024-11-07T22:41:57.680ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: c94d72cb-45d2-40e1-8cf8-5c11e94896fd, dataset_name: DatasetName { pool_name: ZpoolName { id: c38ffc78-518d-45b9-9391-e3e1820de913 (zpool), kind: External }, kind: Crucible }, responder: ... }
9272024-11-07T22:41:57.804ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 964ffa14-9b6a-4b9f-bf79-95eddda7df66, dataset_name: DatasetName { pool_name: ZpoolName { id: aa1b0888-f629-45fb-b793-272240a5e638 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9282024-11-07T22:41:57.804ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 964ffa14-9b6a-4b9f-bf79-95eddda7df66, dataset_name: DatasetName { pool_name: ZpoolName { id: aa1b0888-f629-45fb-b793-272240a5e638 (zpool), kind: External }, kind: Crucible }, responder: ... }
9292024-11-07T22:41:57.917ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d50d879b-6c47-4b42-82ba-218fec18cbc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9302024-11-07T22:41:57.917ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d50d879b-6c47-4b42-82ba-218fec18cbc7, dataset_name: DatasetName { pool_name: ZpoolName { id: 3f19b51d-8f23-4736-b0f1-315ae26a980a (zpool), kind: External }, kind: Crucible }, responder: ... }
9312024-11-07T22:41:58.009ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9322024-11-07T22:41:58.009ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:177
9332024-11-07T22:41:58.009ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:177
9342024-11-07T22:41:58.009ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9352024-11-07T22:41:58.140ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9362024-11-07T22:41:58.140ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9372024-11-07T22:41:58.140ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9382024-11-07T22:41:58.180ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9392024-11-07T22:41:58.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9402024-11-07T22:41:58.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9412024-11-07T22:41:58.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9422024-11-07T22:41:58.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9432024-11-07T22:41:58.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9442024-11-07T22:41:58.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9452024-11-07T22:41:58.372ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9462024-11-07T22:41:58.372ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9472024-11-07T22:41:58.373ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9482024-11-07T22:41:58.385ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9492024-11-07T22:41:58.421ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9502024-11-07T22:41:58.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9512024-11-07T22:41:58.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9522024-11-07T22:41:58.421ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8 file = illumos-utils/src/zone.rs:325
9532024-11-07T22:41:58.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9542024-11-07T22:41:58.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9552024-11-07T22:41:58.425ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101 file = illumos-utils/src/zone.rs:325
9562024-11-07T22:41:58.430ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325 file = illumos-utils/src/zone.rs:325
9572024-11-07T22:41:58.434ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0 file = illumos-utils/src/zone.rs:325
9582024-11-07T22:41:58.439ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66 file = illumos-utils/src/zone.rs:325
9592024-11-07T22:41:58.444ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0 file = illumos-utils/src/zone.rs:325
9602024-11-07T22:41:58.449ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702 file = illumos-utils/src/zone.rs:325
9612024-11-07T22:41:58.453ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5 file = illumos-utils/src/zone.rs:325
9622024-11-07T22:41:58.569ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8 file = illumos-utils/src/zone.rs:363
9632024-11-07T22:41:58.573ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101 file = illumos-utils/src/zone.rs:363
9642024-11-07T22:41:58.577ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325 file = illumos-utils/src/zone.rs:363
9652024-11-07T22:41:58.581ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0 file = illumos-utils/src/zone.rs:363
9662024-11-07T22:41:58.586ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66 file = illumos-utils/src/zone.rs:363
9672024-11-07T22:41:58.590ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0 file = illumos-utils/src/zone.rs:363
9682024-11-07T22:41:58.595ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702 file = illumos-utils/src/zone.rs:363
9692024-11-07T22:41:58.599ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5 file = illumos-utils/src/zone.rs:363
9702024-11-07T22:41:58.604ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55 file = illumos-utils/src/zone.rs:325
9712024-11-07T22:41:58.608ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7 file = illumos-utils/src/zone.rs:325
9722024-11-07T22:41:58.614ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3 file = illumos-utils/src/zone.rs:325
9732024-11-07T22:41:58.618ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727 file = illumos-utils/src/zone.rs:325
9742024-11-07T22:41:58.624ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c file = illumos-utils/src/zone.rs:325
9752024-11-07T22:41:58.630ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd file = illumos-utils/src/zone.rs:325
9762024-11-07T22:41:58.636ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55 file = illumos-utils/src/zone.rs:363
9772024-11-07T22:41:58.641ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7 file = illumos-utils/src/zone.rs:363
9782024-11-07T22:41:58.646ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3 file = illumos-utils/src/zone.rs:363
9792024-11-07T22:41:58.651ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727 file = illumos-utils/src/zone.rs:363
9802024-11-07T22:41:58.657ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c file = illumos-utils/src/zone.rs:363
9812024-11-07T22:41:58.663ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd file = illumos-utils/src/zone.rs:363
9822024-11-07T22:41:58.705ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9832024-11-07T22:41:58.747ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9842024-11-07T22:41:58.785ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9852024-11-07T22:41:58.842ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9862024-11-07T22:41:58.911ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9872024-11-07T22:41:58.913ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9882024-11-07T22:41:58.913ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9892024-11-07T22:41:58.971ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 159, 89]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9902024-11-07T22:41:58.971ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9912024-11-07T22:41:58.972ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9922024-11-07T22:41:58.972ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9932024-11-07T22:41:59.025ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 173, 111]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9942024-11-07T22:41:59.025ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9952024-11-07T22:41:59.026ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
9962024-11-07T22:41:59.026ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
9972024-11-07T22:41:59.077ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 167, 222]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9982024-11-07T22:41:59.077ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
9992024-11-07T22:41:59.078ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
10002024-11-07T22:41:59.078ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
10012024-11-07T22:41:59.078ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
10022024-11-07T22:41:59.078ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
10032024-11-07T22:41:59.078ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
10042024-11-07T22:41:59.078ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
10052024-11-07T22:41:59.080ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10062024-11-07T22:41:59.080ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10072024-11-07T22:41:59.131ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 152, 151]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10082024-11-07T22:41:59.131ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
10092024-11-07T22:41:59.133ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10102024-11-07T22:41:59.133ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10112024-11-07T22:41:59.189ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 195, 180]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10122024-11-07T22:41:59.189ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
10132024-11-07T22:41:59.189ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
10142024-11-07T22:41:59.191ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10152024-11-07T22:41:59.191ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
10162024-11-07T22:41:59.193ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
10172024-11-07T22:41:59.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10182024-11-07T22:41:59.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10192024-11-07T22:41:59.407ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978 file = illumos-utils/src/zone.rs:325
10202024-11-07T22:41:59.428ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14 file = illumos-utils/src/zone.rs:325
10212024-11-07T22:41:59.438ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d file = illumos-utils/src/zone.rs:325
10222024-11-07T22:41:59.453ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
10232024-11-07T22:41:59.453ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
10242024-11-07T22:41:59.453ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
10252024-11-07T22:41:59.453ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
10262024-11-07T22:41:59.454ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
10272024-11-07T22:41:59.457ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10282024-11-07T22:41:59.506ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978 file = illumos-utils/src/zone.rs:363
10292024-11-07T22:41:59.517ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14 file = illumos-utils/src/zone.rs:363
10302024-11-07T22:41:59.527ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d file = illumos-utils/src/zone.rs:363
10312024-11-07T22:41:59.538ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
10322024-11-07T22:41:59.542ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962 file = illumos-utils/src/zone.rs:325
10332024-11-07T22:41:59.555ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10342024-11-07T22:41:59.677ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962 file = illumos-utils/src/zone.rs:363
10352024-11-07T22:41:59.701ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd file = illumos-utils/src/zone.rs:325
10362024-11-07T22:41:59.982ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd file = illumos-utils/src/zone.rs:363
10372024-11-07T22:42:00.965ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_896a209a-9e6b-4a3e-85d1-8128327ab969/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='070100e5-cf96-46fd-aef1-1102ffd4c42d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10382024-11-07T22:42:00.965ZINFOSledAgent (ServiceManager): Booting oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
10392024-11-07T22:42:00.992ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10402024-11-07T22:42:00.992ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
10412024-11-07T22:42:01.074ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_aa1b0888-f629-45fb-b793-272240a5e638/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4f5cce3d-6d4d-4075-b6e6-7554ac8a90b9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10422024-11-07T22:42:01.074ZINFOSledAgent (ServiceManager): Booting oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
10432024-11-07T22:42:01.087ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10442024-11-07T22:42:01.088ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
10452024-11-07T22:42:01.096ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_542fb670-2cd7-4cb9-9a65-01ef014dcdb4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ae1f656c-5f21-4deb-91bd-6571272d90aa'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10462024-11-07T22:42:01.096ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
10472024-11-07T22:42:01.104ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10482024-11-07T22:42:01.105ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
10492024-11-07T22:42:01.179ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e246880a-4d88-4441-a6d6-a9e42d69d6eb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8b34137b-f810-4353-87a1-a170764cd214'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10502024-11-07T22:42:01.179ZINFOSledAgent (ServiceManager): Booting oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
10512024-11-07T22:42:01.203ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='1d0ef856-8367-48e8-a7e7-21f345224101'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10522024-11-07T22:42:01.203ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
10532024-11-07T22:42:01.222ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3f19b51d-8f23-4736-b0f1-315ae26a980a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e12c4689-3538-4da7-aba2-ecf56de3f46a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10542024-11-07T22:42:01.222ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
10552024-11-07T22:42:01.229ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6bcd12fd-a17a-4b71-b93d-84590e442e65/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a24331a2-8604-47c1-aa9c-acb6cc3ebd43'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10562024-11-07T22:42:01.229ZINFOSledAgent (ServiceManager): Booting oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
10572024-11-07T22:42:01.263ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6a8d312b-1855-4f59-8964-cdc4c8aad9f3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b35492e1-8cea-4b99-b370-1d57d18e9c83'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10582024-11-07T22:42:01.264ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
10592024-11-07T22:42:01.293ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c38ffc78-518d-45b9-9391-e3e1820de913/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cddd34a3-7fd3-4e06-9455-c733b45d24ae'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10602024-11-07T22:42:01.294ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
10612024-11-07T22:42:01.318ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_079e3938-061f-42e6-b89a-4de48c877f70/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a8149aa3-a4ec-4ef5-9b1b-39f0c0ddfc4d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10622024-11-07T22:42:01.318ZINFOSledAgent (ServiceManager): Booting oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
10632024-11-07T22:42:01.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 42.802112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
10642024-11-07T22:42:01.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 72.399537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
10652024-11-07T22:42:01.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 69.306683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
10662024-11-07T22:42:01.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 46.109567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
10672024-11-07T22:42:01.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 59.565939ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
10682024-11-07T22:42:01.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 30.60391ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
10692024-11-07T22:42:01.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 48.094529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
10702024-11-07T22:42:01.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 37.243708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
10712024-11-07T22:42:01.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 55.682757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
10722024-11-07T22:42:01.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 34.012088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
10732024-11-07T22:42:11.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 72.1749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
10742024-11-07T22:42:11.855ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.062111162s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10752024-11-07T22:42:11.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 90.890596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
10762024-11-07T22:42:11.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 83.180544ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
10772024-11-07T22:42:12.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 124.755117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
10782024-11-07T22:42:12.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 64.369674ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
10792024-11-07T22:42:12.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 131.359365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
10802024-11-07T22:42:12.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 129.670304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
10812024-11-07T22:42:12.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 131.496881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
10822024-11-07T22:42:12.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 132.428625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
10832024-11-07T22:42:12.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 61.544255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
10842024-11-07T22:42:12.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 68.923453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
10852024-11-07T22:42:12.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 98.703354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
10862024-11-07T22:42:12.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 38.042347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
10872024-11-07T22:42:12.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 33.605569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
10882024-11-07T22:42:12.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 199.252928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
10892024-11-07T22:42:12.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 223.238348ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
10902024-11-07T22:42:12.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 106.34003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
10912024-11-07T22:42:12.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 110.530216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
10922024-11-07T22:42:12.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 203.32291ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
10932024-11-07T22:42:12.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 155.688944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
10942024-11-07T22:42:12.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 259.677893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
10952024-11-07T22:42:12.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 252.271168ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
10962024-11-07T22:42:12.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 266.603169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
10972024-11-07T22:42:12.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 145.492999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
10982024-11-07T22:42:12.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 126.325868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
10992024-11-07T22:42:12.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 60.702529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
11002024-11-07T22:42:12.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 55.266464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
11012024-11-07T22:42:12.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 306.886469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
11022024-11-07T22:42:12.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 234.767411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
11032024-11-07T22:42:12.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 154.883303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
11042024-11-07T22:42:12.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 565.834848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
11052024-11-07T22:42:12.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 258.591466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
11062024-11-07T22:42:12.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 453.903569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
11072024-11-07T22:42:12.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 408.592288ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
11082024-11-07T22:42:12.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 204.125974ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
11092024-11-07T22:42:12.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 326.664871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
11102024-11-07T22:42:12.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 405.012031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
11112024-11-07T22:42:12.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 258.619581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
11122024-11-07T22:42:12.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 411.263253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
11132024-11-07T22:42:12.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 469.020049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
11142024-11-07T22:42:12.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 377.22274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
11152024-11-07T22:42:12.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 920.75497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
11162024-11-07T22:42:12.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 1.003145386s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
11172024-11-07T22:42:12.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 621.742103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
11182024-11-07T22:42:12.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 519.651342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
11192024-11-07T22:42:12.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 1.123766274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
11202024-11-07T22:42:12.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 502.024831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
11212024-11-07T22:42:12.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.128352685s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
11222024-11-07T22:42:13.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 679.46401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
11232024-11-07T22:42:13.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 656.154693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
11242024-11-07T22:42:13.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 699.861646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
11252024-11-07T22:42:13.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 813.639598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
11262024-11-07T22:42:13.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 996.66455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
11272024-11-07T22:42:13.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 819.197073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
11282024-11-07T22:42:13.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 1.039938897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
11292024-11-07T22:42:13.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 514.694995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
11302024-11-07T22:42:13.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 962.900247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
11312024-11-07T22:42:13.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 936.156875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
11322024-11-07T22:42:13.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 1.145283307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
11332024-11-07T22:42:13.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 1.369390027s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
11342024-11-07T22:42:13.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 1.32948948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
11352024-11-07T22:42:13.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 928.990771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
11362024-11-07T22:42:13.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 1.317824283s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
11372024-11-07T22:42:13.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 695.118253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
11382024-11-07T22:42:14.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.253429074s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
11392024-11-07T22:42:14.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 806.339443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
11402024-11-07T22:42:14.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 556.728295ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
11412024-11-07T22:42:14.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 1.305242841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
11422024-11-07T22:42:14.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 826.858595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
11432024-11-07T22:42:14.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 875.535038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
11442024-11-07T22:42:14.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 891.336351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
11452024-11-07T22:42:14.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 1.375128591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
11462024-11-07T22:42:14.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.283868088s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
11472024-11-07T22:42:14.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 1.233495175s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
11482024-11-07T22:42:14.820ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11492024-11-07T22:42:14.820ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
11502024-11-07T22:42:14.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 634.432479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
11512024-11-07T22:42:14.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 860.902421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
11522024-11-07T22:42:15.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 1.419169981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
11532024-11-07T22:42:15.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 57.347974ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
11542024-11-07T22:42:15.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 641.733508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
11552024-11-07T22:42:15.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 70.795022ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
11562024-11-07T22:42:15.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 628.354331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
11572024-11-07T22:42:15.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 711.041758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
11582024-11-07T22:42:15.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 248.459127ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
11592024-11-07T22:42:15.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.44985584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
11602024-11-07T22:42:15.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 1.069934289s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
11612024-11-07T22:42:15.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 598.402009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
11622024-11-07T22:42:15.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 992.310235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
11632024-11-07T22:42:15.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 558.454517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
11642024-11-07T22:42:15.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 539.158092ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
11652024-11-07T22:42:15.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 793.649632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
11662024-11-07T22:42:15.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 920.165154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
11672024-11-07T22:42:15.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 747.949871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
11682024-11-07T22:42:15.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 937.742189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
11692024-11-07T22:42:15.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 878.153165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
11702024-11-07T22:42:16.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.1005862s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
11712024-11-07T22:42:16.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 1.004693424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
11722024-11-07T22:42:16.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 517.949573ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
11732024-11-07T22:42:16.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 577.032188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
11742024-11-07T22:42:16.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 682.099089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
11752024-11-07T22:42:16.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 1.115852142s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
11762024-11-07T22:42:16.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 584.65761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
11772024-11-07T22:42:16.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 1.193461829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
11782024-11-07T22:42:16.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 1.155475711s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
11792024-11-07T22:42:16.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 1.30825515s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
11802024-11-07T22:42:16.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 1.119227051s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
11812024-11-07T22:42:16.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 556.410146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
11822024-11-07T22:42:16.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 902.673685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
11832024-11-07T22:42:16.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.259586169s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
11842024-11-07T22:42:16.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 756.126586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
11852024-11-07T22:42:16.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 1.073391832s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
11862024-11-07T22:42:16.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 600.748649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
11872024-11-07T22:42:17.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 725.097547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
11882024-11-07T22:42:17.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 1.08292905s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
11892024-11-07T22:42:17.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.224064777s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
11902024-11-07T22:42:17.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 1.475823293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
11912024-11-07T22:42:17.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 1.373883331s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
11922024-11-07T22:42:17.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 756.115198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
11932024-11-07T22:42:17.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 841.543595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
11942024-11-07T22:42:17.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 1.287873596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
11952024-11-07T22:42:17.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 1.306169684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
11962024-11-07T22:42:17.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 575.685496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
11972024-11-07T22:42:17.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 621.672715ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
11982024-11-07T22:42:17.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 970.099129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
11992024-11-07T22:42:17.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 921.547687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
12002024-11-07T22:42:17.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 930.338046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
12012024-11-07T22:42:18.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.03053684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
12022024-11-07T22:42:18.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 1.135439507s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
12032024-11-07T22:42:18.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 888.987571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
12042024-11-07T22:42:18.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 1.377373016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
12052024-11-07T22:42:18.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.273478716s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
12062024-11-07T22:42:18.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 1.341334932s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
12072024-11-07T22:42:18.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 602.018912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
12082024-11-07T22:42:18.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 931.613217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
12092024-11-07T22:42:18.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 1.116597357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
12102024-11-07T22:42:18.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 1.248468246s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
12112024-11-07T22:42:18.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 1.428425073s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
12122024-11-07T22:42:18.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 872.043436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
12132024-11-07T22:42:18.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 983.07611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
12142024-11-07T22:42:19.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 901.343839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
12152024-11-07T22:42:19.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 1.409789542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
12162024-11-07T22:42:19.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.351537714s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
12172024-11-07T22:42:19.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 1.088425895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
12182024-11-07T22:42:19.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 628.010659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
12192024-11-07T22:42:19.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.163837622s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
12202024-11-07T22:42:19.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 1.188893546s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
12212024-11-07T22:42:19.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 1.445225026s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
12222024-11-07T22:42:19.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 1.367324131s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
12232024-11-07T22:42:19.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 1.178023599s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
12242024-11-07T22:42:19.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 955.628021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
12252024-11-07T22:42:19.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 732.013954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
12262024-11-07T22:42:19.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 555.316476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
12272024-11-07T22:42:20.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 716.380484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
12282024-11-07T22:42:20.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 1.49042372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
12292024-11-07T22:42:20.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 721.502512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
12302024-11-07T22:42:20.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 865.591691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
12312024-11-07T22:42:20.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.197152857s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
12322024-11-07T22:42:20.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 1.478360962s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
12332024-11-07T22:42:20.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 878.236999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
12342024-11-07T22:42:20.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 618.551429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
12352024-11-07T22:42:20.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 1.054245274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
12362024-11-07T22:42:20.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.493405716s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
12372024-11-07T22:42:20.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 1.410296085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
12382024-11-07T22:42:20.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 1.462237995s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
12392024-11-07T22:42:21.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 563.066026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
12402024-11-07T22:42:21.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 1.294567736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
12412024-11-07T22:42:21.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 1.480739801s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
12422024-11-07T22:42:21.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 1.258605363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
12432024-11-07T22:42:21.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 1.068640806s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
12442024-11-07T22:42:21.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 925.641219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
12452024-11-07T22:42:21.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 1.065019765s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
12462024-11-07T22:42:21.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 559.462633ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
12472024-11-07T22:42:21.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.152998687s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
12482024-11-07T22:42:21.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 1.275606201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
12492024-11-07T22:42:21.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 932.941816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
12502024-11-07T22:42:21.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 811.866818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
12512024-11-07T22:42:22.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 1.413664676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
12522024-11-07T22:42:22.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 781.789794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
12532024-11-07T22:42:22.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 960.965154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
12542024-11-07T22:42:22.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 1.08446644s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
12552024-11-07T22:42:22.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.184397945s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
12562024-11-07T22:42:22.370ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12572024-11-07T22:42:22.370ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12582024-11-07T22:42:22.370ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
12592024-11-07T22:42:22.380ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
12602024-11-07T22:42:22.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 633.784282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
12612024-11-07T22:42:22.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 962.232778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
12622024-11-07T22:42:22.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 845.296213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
12632024-11-07T22:42:22.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 842.866352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
12642024-11-07T22:42:22.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 1.355896257s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
12652024-11-07T22:42:22.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 34.827227ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
12662024-11-07T22:42:22.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 1.35208981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
12672024-11-07T22:42:22.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 1.064341837s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
12682024-11-07T22:42:22.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 107.338406ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
12692024-11-07T22:42:22.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.111849617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
12702024-11-07T22:42:22.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 182.75703ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
12712024-11-07T22:42:23.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 1.244218564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
12722024-11-07T22:42:23.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 1.054834376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
12732024-11-07T22:42:23.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 1.085919101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
12742024-11-07T22:42:23.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 579.706041ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
12752024-11-07T22:42:23.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 717.611222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
12762024-11-07T22:42:23.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 823.570065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
12772024-11-07T22:42:23.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 647.550347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
12782024-11-07T22:42:23.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 946.240907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
12792024-11-07T22:42:23.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 891.301588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
12802024-11-07T22:42:23.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 774.342592ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
12812024-11-07T22:42:23.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 676.533254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
12822024-11-07T22:42:23.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 955.912327ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
12832024-11-07T22:42:23.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 883.270926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
12842024-11-07T22:42:23.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.110804541s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
12852024-11-07T22:42:24.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 1.44349293s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
12862024-11-07T22:42:24.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 1.170569566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
12872024-11-07T22:42:24.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 832.114404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
12882024-11-07T22:42:24.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 1.02413221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
12892024-11-07T22:42:24.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 1.275379376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
12902024-11-07T22:42:24.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 1.432595418s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
12912024-11-07T22:42:24.162ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12922024-11-07T22:42:24.162ZINFOSledAgent (ServiceManager): Booting oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
12932024-11-07T22:42:24.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 1.268849972s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
12942024-11-07T22:42:24.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 1.445963781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
12952024-11-07T22:42:24.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 1.250511666s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
12962024-11-07T22:42:24.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 1.398549888s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
12972024-11-07T22:42:24.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 30.065738ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
12982024-11-07T22:42:24.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.080784107s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
12992024-11-07T22:42:24.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 901.54198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
13002024-11-07T22:42:24.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 73.766282ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
13012024-11-07T22:42:24.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 178.961207ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
13022024-11-07T22:42:24.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 224.684382ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
13032024-11-07T22:42:24.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 743.334055ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
13042024-11-07T22:42:24.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 1.400249143s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
13052024-11-07T22:42:24.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 1.442558085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
13062024-11-07T22:42:24.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 685.75236ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
13072024-11-07T22:42:25.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.180889236s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
13082024-11-07T22:42:25.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 718.120421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
13092024-11-07T22:42:25.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 1.272866703s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
13102024-11-07T22:42:25.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 66.140603ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
13112024-11-07T22:42:25.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 1.464778324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
13122024-11-07T22:42:25.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 64.540686ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
13132024-11-07T22:42:25.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 1.102901792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
13142024-11-07T22:42:25.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 147.855602ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
13152024-11-07T22:42:25.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 513.8107ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
13162024-11-07T22:42:25.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 964.072444ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
13172024-11-07T22:42:25.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 769.403938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
13182024-11-07T22:42:25.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 736.685853ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
13192024-11-07T22:42:25.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 1.327477237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
13202024-11-07T22:42:25.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 886.123121ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
13212024-11-07T22:42:25.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 350.152165ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
13222024-11-07T22:42:25.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 778.12901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
13232024-11-07T22:42:25.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 1.155843768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
13242024-11-07T22:42:25.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 614.366021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
13252024-11-07T22:42:25.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 615.349588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
13262024-11-07T22:42:25.948ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13272024-11-07T22:42:25.948ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
13282024-11-07T22:42:26.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 881.155458ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
13292024-11-07T22:42:26.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 875.006704ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
13302024-11-07T22:42:26.021ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56034
13312024-11-07T22:42:26.022ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 569 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56034 req_id = 940f84f6-d61c-484c-aca5-40619d767136 response_code = 200 uri = /baseboard
13322024-11-07T22:42:26.080ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13332024-11-07T22:42:26.080ZINFOSledAgent (ServiceManager): Booting oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
13342024-11-07T22:42:26.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 951.67269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
13352024-11-07T22:42:26.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 36.866156ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
13362024-11-07T22:42:26.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 97.230977ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
13372024-11-07T22:42:26.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 624.532043ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
13382024-11-07T22:42:26.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 1.150599492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
13392024-11-07T22:42:26.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 532.236509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
13402024-11-07T22:42:26.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 1.233002154s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
13412024-11-07T22:42:26.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 37.894636ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
13422024-11-07T22:42:26.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 785.582271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
13432024-11-07T22:42:26.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 233.921154ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
13442024-11-07T22:42:26.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 816.129118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
13452024-11-07T22:42:26.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 122.929084ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
13462024-11-07T22:42:26.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 1.316813854s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
13472024-11-07T22:42:26.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 890.617354ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
13482024-11-07T22:42:26.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 1.065050163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
13492024-11-07T22:42:26.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 1.437880558s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
13502024-11-07T22:42:26.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 1.312316057s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
13512024-11-07T22:42:26.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 106.683565ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
13522024-11-07T22:42:26.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 420.185679ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
13532024-11-07T22:42:26.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 388.830338ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
13542024-11-07T22:42:26.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 1.091830399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
13552024-11-07T22:42:26.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 620.272265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
13562024-11-07T22:42:26.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.452527577s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
13572024-11-07T22:42:26.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 611.214619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
13582024-11-07T22:42:26.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 1.143206774s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
13592024-11-07T22:42:26.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 627.292315ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
13602024-11-07T22:42:26.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 1.393635498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
13612024-11-07T22:42:27.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 919.211592ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
13622024-11-07T22:42:27.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 670.770575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
13632024-11-07T22:42:27.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 561.636191ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
13642024-11-07T22:42:27.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 1.060002956s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
13652024-11-07T22:42:27.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 1.311118499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
13662024-11-07T22:42:27.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 1.258196506s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
13672024-11-07T22:42:27.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 1.423723162s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
13682024-11-07T22:42:27.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.468206876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
13692024-11-07T22:42:27.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 872.61649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
13702024-11-07T22:42:27.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 764.80884ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
13712024-11-07T22:42:27.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 1.170764094s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
13722024-11-07T22:42:27.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 961.926516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
13732024-11-07T22:42:27.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 591.514411ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
13742024-11-07T22:42:27.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 688.981982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
13752024-11-07T22:42:27.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 943.660304ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
13762024-11-07T22:42:27.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 992.863408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
13772024-11-07T22:42:27.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 1.422863784s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
13782024-11-07T22:42:27.982ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.20705013s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13792024-11-07T22:42:28.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 1.133071367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
13802024-11-07T22:42:28.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 601.43591ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
13812024-11-07T22:42:28.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 662.678952ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
13822024-11-07T22:42:28.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 710.08855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
13832024-11-07T22:42:28.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 1.121581962s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
13842024-11-07T22:42:28.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 1.307205812s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
13852024-11-07T22:42:28.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 650.64272ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
13862024-11-07T22:42:28.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 615.43441ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
13872024-11-07T22:42:28.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 622.312351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
13882024-11-07T22:42:28.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 1.218050595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
13892024-11-07T22:42:28.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 751.776508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
13902024-11-07T22:42:28.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 1.127766021s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
13912024-11-07T22:42:28.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 561.976581ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
13922024-11-07T22:42:28.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 1.18898433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
13932024-11-07T22:42:28.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 1.205980167s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
13942024-11-07T22:42:28.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 1.17261249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
13952024-11-07T22:42:28.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 630.009697ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
13962024-11-07T22:42:28.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 893.103958ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
13972024-11-07T22:42:28.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 528.762672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
13982024-11-07T22:42:29.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 1.195091269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
13992024-11-07T22:42:29.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.478999904s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
14002024-11-07T22:42:29.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 521.368193ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
14012024-11-07T22:42:29.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 545.09442ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
14022024-11-07T22:42:29.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 1.060103514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
14032024-11-07T22:42:29.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 852.861516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
14042024-11-07T22:42:29.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 1.023690125s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
14052024-11-07T22:42:29.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 866.848166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
14062024-11-07T22:42:29.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 1.274657831s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
14072024-11-07T22:42:29.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 1.261718477s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
14082024-11-07T22:42:29.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 1.080365946s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
14092024-11-07T22:42:29.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 1.21148798s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
14102024-11-07T22:42:29.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 863.999222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
14112024-11-07T22:42:29.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101") failed: Property not found. retry in 1.470319465s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
14122024-11-07T22:42:29.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 1.299484313s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
14132024-11-07T22:42:29.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0") failed: Property not found. retry in 1.014727789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
14142024-11-07T22:42:29.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 721.953428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
14152024-11-07T22:42:29.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 1.268042943s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
14162024-11-07T22:42:29.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7") failed: Property not found. retry in 1.470862276s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
14172024-11-07T22:42:29.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 1.164873167s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
14182024-11-07T22:42:30.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 1.113432114s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
14192024-11-07T22:42:30.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66") failed: Property not found. retry in 1.429046799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
14202024-11-07T22:42:30.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 899.129525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
14212024-11-07T22:42:30.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 556.18984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
14222024-11-07T22:42:30.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727") failed: Property not found. retry in 1.199320497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
14232024-11-07T22:42:30.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 754.003211ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
14242024-11-07T22:42:30.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 518.478255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
14252024-11-07T22:42:30.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c") failed: Property not found. retry in 1.071134397s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
14262024-11-07T22:42:30.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 645.657636ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
14272024-11-07T22:42:30.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 772.709047ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
14282024-11-07T22:42:30.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702") failed: Property not found. retry in 1.244022479s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
14292024-11-07T22:42:30.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 1.220456833s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
14302024-11-07T22:42:30.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55") failed: Property not found. retry in 919.029213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
14312024-11-07T22:42:30.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd") failed: Property not found. retry in 1.100508408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
14322024-11-07T22:42:30.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0") failed: Property not found. retry in 1.33435288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
14332024-11-07T22:42:31.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 1.237037107s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
14342024-11-07T22:42:31.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 1.210460008s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
14352024-11-07T22:42:31.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325") failed: Property not found. retry in 917.427996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
14362024-11-07T22:42:31.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 875.936573ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
14372024-11-07T22:42:31.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 686.204269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
14382024-11-07T22:42:31.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 511.20732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
14392024-11-07T22:42:31.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 911.607514ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
14402024-11-07T22:42:31.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 1.383747136s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
14412024-11-07T22:42:31.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5") failed: Property not found. retry in 1.076567188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
14422024-11-07T22:42:31.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8") failed: Property not found. retry in 1.298880569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
14432024-11-07T22:42:31.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 1.018436037s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
14442024-11-07T22:42:31.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 820.595839ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
14452024-11-07T22:42:32.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 1.414500402s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
14462024-11-07T22:42:32.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 568.881052ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
14472024-11-07T22:42:32.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 746.574673ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
14482024-11-07T22:42:32.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3") failed: Property not found. retry in 1.031729264s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
14492024-11-07T22:42:32.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 1.304845063s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
14502024-11-07T22:42:32.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 1.283139303s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
14512024-11-07T22:42:32.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 1.16392542s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
14522024-11-07T22:42:33.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 1.49936461s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
14532024-11-07T22:42:33.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 1.087187315s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
14542024-11-07T22:42:34.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14") failed: Property not found. retry in 925.130346ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
14552024-11-07T22:42:34.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 1.021291415s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
14562024-11-07T22:42:34.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 1.233962198s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
14572024-11-07T22:42:34.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 1.464519097s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
14582024-11-07T22:42:34.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 1.488546584s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
14592024-11-07T22:42:35.008ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.996061662s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14602024-11-07T22:42:35.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 982.426765ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
14612024-11-07T22:42:35.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 725.253602ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
14622024-11-07T22:42:36.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 530.458122ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
14632024-11-07T22:42:36.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 1.315115213s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
14642024-11-07T22:42:36.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 1.296427397s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
14652024-11-07T22:42:36.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 1.190540549s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
14662024-11-07T22:42:36.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 619.709331ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
14672024-11-07T22:42:37.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978") failed: Property not found. retry in 1.345636344s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
14682024-11-07T22:42:37.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd") failed: Property not found. retry in 1.0900256s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
14692024-11-07T22:42:37.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962") failed: Property not found. retry in 799.587392ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
14702024-11-07T22:42:37.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d") failed: Property not found. retry in 1.138656431s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
14712024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_c5b9804e-6cba-4dfb-814d-ae73483c83a8
14722024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_oximeter_1d0ef856-8367-48e8-a7e7-21f345224101
14732024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_377e4941-a34d-4c51-b725-3cc833f8df14
14742024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_949ce051-2791-4bab-87b3-d767f6321325
14752024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_a32e0ae0-9c04-41c3-8849-40577b780ef0
14762024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_964ffa14-9b6a-4b9f-bf79-95eddda7df66
14772024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_df7d394a-6ba7-4b06-bcc0-8b33528280f0
14782024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_635ebbc4-7443-4d5b-ada0-64b941ea5702
14792024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_42e8095c-4973-40db-9d13-0be7e130d89d
14802024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_35f47ca0-16aa-4648-a4bb-ea527c45c8c5
14812024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_ca4144bb-dfba-4597-8389-b37525e85c55
14822024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_d50d879b-6c47-4b42-82ba-218fec18cbc7
14832024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_939b4884-df0a-49e9-b0e5-27de78137ddd
14842024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_19da6a5b-073a-4e12-8775-91fc61c1e962
14852024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_clickhouse_41cb459b-a9cd-46b7-b575-71baf0b03aa3
14862024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_dd6358e0-aa95-4e4d-bb91-75a192337727
14872024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_722550d9-f709-4f5d-89c9-b29858498f2c
14882024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_c94d72cb-45d2-40e1-8cf8-5c11e94896fd
14892024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_a5da1467-f0f3-4c0d-ad94-ed83c65ca978
14902024-11-07T22:42:38.851ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14912024-11-07T22:42:38.855ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14922024-11-07T22:42:38.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42912678 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35908 req_id = dca2c10b-f4ae-43d9-8194-31e659722002 response_code = 204 uri = /omicron-zones
14932024-11-07T22:42:38.878ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1331
14942024-11-07T22:42:38.878ZINFOSledAgent (RSS): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14952024-11-07T22:42:38.879ZINFOSledAgent (RSS): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14962024-11-07T22:42:38.883ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:708
14972024-11-07T22:42:38.884ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:720
14982024-11-07T22:42:38.927ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:896
14992024-11-07T22:42:38.930ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15002024-11-07T22:42:39.070ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15012024-11-07T22:42:39.183ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15022024-11-07T22:42:39.299ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15032024-11-07T22:42:39.481ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15042024-11-07T22:42:39.737ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15052024-11-07T22:42:39.878ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15062024-11-07T22:42:40.037ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 12.929829531s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
15072024-11-07T22:42:40.130ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15082024-11-07T22:42:40.634ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15092024-11-07T22:42:41.070ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15102024-11-07T22:42:41.808ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15112024-11-07T22:42:42.626ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15122024-11-07T22:42:43.110ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15132024-11-07T22:42:43.909ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15142024-11-07T22:42:45.139ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15152024-11-07T22:42:46.904ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/1a2f25b5-769a-4c68-be75-53fcae3bde7f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
15162024-11-07T22:42:49.689ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a03c33f4-8437-45db-bb57-f8c35442d7b1", "content-length": "173", "date": "Thu, 07 Nov 2024 22:42:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"1a2f25b5-769a-4c68-be75-53fcae3bde7f\"", request_id: "a03c33f4-8437-45db-bb57-f8c35442d7b1" } file = sled-agent/src/rack_setup/service.rs:958
15172024-11-07T22:42:53.000ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8213ab13-9389-4afa-b648-7cd82f02c9b7", "content-length": "173", "date": "Thu, 07 Nov 2024 22:42:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c1e85b8f-73ff-449f-b9a8-ac0480ffdec1\"", request_id: "8213ab13-9389-4afa-b648-7cd82f02c9b7" } file = sled-agent/src/rack_setup/service.rs:958
15182024-11-07T22:42:54.637ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "da1ffcdb-ae07-4662-baee-78a696b87176", "content-length": "173", "date": "Thu, 07 Nov 2024 22:42:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c1e85b8f-73ff-449f-b9a8-ac0480ffdec1\"", request_id: "da1ffcdb-ae07-4662-baee-78a696b87176" } file = sled-agent/src/rack_setup/service.rs:958
15192024-11-07T22:42:56.059ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36165
15202024-11-07T22:42:56.059ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36165 req_id = c75cbd90-186f-49a4-a6d4-9c3f1c385ce4 response_code = 200 uri = /baseboard
15212024-11-07T22:42:56.345ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "db92457d-af28-4196-99ed-d0c8bae42812", "content-length": "173", "date": "Thu, 07 Nov 2024 22:42:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c1e85b8f-73ff-449f-b9a8-ac0480ffdec1\"", request_id: "db92457d-af28-4196-99ed-d0c8bae42812" } file = sled-agent/src/rack_setup/service.rs:958
15222024-11-07T22:42:59.275ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1a74493f-f785-4a60-a731-3541408da6ae", "content-length": "173", "date": "Thu, 07 Nov 2024 22:42:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c1e85b8f-73ff-449f-b9a8-ac0480ffdec1\"", request_id: "1a74493f-f785-4a60-a731-3541408da6ae" } file = sled-agent/src/rack_setup/service.rs:958
15232024-11-07T22:43:04.759ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d23c1720-9361-4c0a-bf6c-ce9d3c6e574a", "content-length": "173", "date": "Thu, 07 Nov 2024 22:43:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c1e85b8f-73ff-449f-b9a8-ac0480ffdec1\"", request_id: "d23c1720-9361-4c0a-bf6c-ce9d3c6e574a" } file = sled-agent/src/rack_setup/service.rs:958
15242024-11-07T22:43:06.775ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:61538 remote_addr = [fd00:1122:3344:101::d]:51000 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
15252024-11-07T22:43:06.798ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 22136 local_addr = [fd00:1122:3344:101::1]:61538 method = GET remote_addr = [fd00:1122:3344:101::d]:51000 req_id = df30758e-945a-4743-8819-f643a704d0c1 response_code = 200 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 uri = /c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
15262024-11-07T22:43:07.933ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
15272024-11-07T22:43:08.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45403
15282024-11-07T22:43:08.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15292024-11-07T22:43:08.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15302024-11-07T22:43:08.022ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:177
15312024-11-07T22:43:08.024ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:177
15322024-11-07T22:43:08.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 190584 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45403 req_id = 14883506-a032-4ffc-b64a-52c97888b755 response_code = 200 uri = /inventory
15332024-11-07T22:43:11.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43052
15342024-11-07T22:43:11.879ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15352024-11-07T22:43:11.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15362024-11-07T22:43:11.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15372024-11-07T22:43:11.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15382024-11-07T22:43:11.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15392024-11-07T22:43:11.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
15402024-11-07T22:43:11.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15412024-11-07T22:43:11.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43052 req_id = 264f56c4-cb4d-4dde-9d8d-708296b5daea response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15422024-11-07T22:43:11.880ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:968
15432024-11-07T22:43:12.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47737
15442024-11-07T22:43:12.114ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15452024-11-07T22:43:12.114ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15462024-11-07T22:43:12.114ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:177
15472024-11-07T22:43:12.114ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:177
15482024-11-07T22:43:12.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47737 req_id = 8aadd11a-66f5-4181-b380-0ff381465b40 response_code = 200 uri = /inventory
15492024-11-07T22:43:12.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43701
15502024-11-07T22:43:12.519ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15512024-11-07T22:43:12.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15522024-11-07T22:43:12.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15532024-11-07T22:43:12.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15542024-11-07T22:43:12.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15552024-11-07T22:43:12.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
15562024-11-07T22:43:12.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15572024-11-07T22:43:12.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43701 req_id = 9e4b5216-a67e-47ef-81fe-e3b24e4e3f04 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15582024-11-07T22:43:13.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35606
15592024-11-07T22:43:13.025ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15602024-11-07T22:43:13.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15612024-11-07T22:43:13.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15622024-11-07T22:43:13.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15632024-11-07T22:43:13.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15642024-11-07T22:43:13.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
15652024-11-07T22:43:13.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15662024-11-07T22:43:13.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35606 req_id = 68e5180a-b0b7-4e88-a201-eaea4b67f8d6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15672024-11-07T22:43:13.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39341
15682024-11-07T22:43:13.108ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15692024-11-07T22:43:13.108ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15702024-11-07T22:43:13.108ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15712024-11-07T22:43:13.108ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15722024-11-07T22:43:13.108ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15732024-11-07T22:43:13.108ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
15742024-11-07T22:43:13.108ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15752024-11-07T22:43:13.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39341 req_id = 705c30dc-d803-456b-aad4-9c65e0c3c953 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15762024-11-07T22:43:17.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33246
15772024-11-07T22:43:17.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33246 req_id = fd7586ca-f8d1-4a2a-8a45-c2bb8eebeec3 response_code = 200 uri = /vpc-routes
15782024-11-07T22:43:17.914ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
15792024-11-07T22:43:17.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33246 req_id = 7edd312d-563f-437b-be73-8f3fe5e0f630 response_code = 204 uri = /eip-gateways
15802024-11-07T22:43:18.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2071 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33246 req_id = a8de7e22-d934-4f3c-baf2-6f5d0fd960da response_code = 204 uri = /vpc-routes
15812024-11-07T22:43:21.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51646
15822024-11-07T22:43:21.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35900
15832024-11-07T22:43:21.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35900 req_id = 2c7f0bb1-4bc2-42a3-a8f3-2798820e210f response_code = 200 uri = /vpc-routes
15842024-11-07T22:43:21.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51646 req_id = 2cf0fec9-94db-4732-b109-7847086b6c1d response_code = 200 uri = /vpc-routes
15852024-11-07T22:43:21.279ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
15862024-11-07T22:43:21.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51646 req_id = 051eca75-a9cb-4fd1-959a-adaf43e7aea3 response_code = 204 uri = /eip-gateways
15872024-11-07T22:43:21.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58504
15882024-11-07T22:43:21.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58504 req_id = 9a2be80e-3df5-44aa-825b-d529ab4f1449 response_code = 200 uri = /vpc-routes
15892024-11-07T22:43:21.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51646 req_id = 632fc0ad-d7a8-4d1b-9248-6f98c093082b response_code = 204 uri = /vpc-routes
15902024-11-07T22:43:21.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43957
15912024-11-07T22:43:21.351ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
15922024-11-07T22:43:21.435ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
15932024-11-07T22:43:21.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157450 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43957 req_id = bb7c65af-f49e-41ff-9909-275ceee5b48f response_code = 204 uri = /switch-ports
15942024-11-07T22:43:21.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51503
15952024-11-07T22:43:21.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61728
15962024-11-07T22:43:21.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
15972024-11-07T22:43:21.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58504 req_id = 9084bf16-3387-4865-a4e2-9572ea1a51ce response_code = 204 uri = /eip-gateways
15982024-11-07T22:43:21.509ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
15992024-11-07T22:43:21.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57078
16002024-11-07T22:43:21.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6019 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61728 req_id = 5a967101-8815-423e-8fc6-b0d3a34049ca response_code = 200 uri = /v2p
16012024-11-07T22:43:21.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52763
16022024-11-07T22:43:21.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52763 req_id = 31225bf3-d217-4215-bab1-2e76b78a394e response_code = 200 uri = /v2p
16032024-11-07T22:43:21.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11555 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43957 req_id = daaf3f8e-0f44-498b-bb0a-8b6d43d923ef response_code = 200 uri = /network-bootstore-config
16042024-11-07T22:43:21.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58504 req_id = 236861fd-7c4c-4b9a-8072-e796aecab735 response_code = 204 uri = /vpc-routes
16052024-11-07T22:43:21.553ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
16062024-11-07T22:43:21.553ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16072024-11-07T22:43:21.553ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
16082024-11-07T22:43:21.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35900 req_id = 1190f575-0891-4db3-9486-e3c62fdf0f61 response_code = 204 uri = /eip-gateways
16092024-11-07T22:43:21.554ZINFOSledAgent (bootstore): Writing ledger to /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16102024-11-07T22:43:21.555ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
16112024-11-07T22:43:21.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43957 req_id = 55d0c252-a2f6-468c-b3c8-1dafcff5be1e response_code = 204 uri = /network-bootstore-config
16122024-11-07T22:43:21.562ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16132024-11-07T22:43:21.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35900 req_id = 9473ec9e-752a-4191-b7f9-9705f5924ad7 response_code = 204 uri = /vpc-routes
16142024-11-07T22:43:21.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59788
16152024-11-07T22:43:21.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59788 req_id = 65ac99f5-ea36-4e1a-af18-e5c800a4c036 response_code = 200 uri = /v2p
16162024-11-07T22:43:21.628ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16172024-11-07T22:43:21.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119621 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51503 req_id = f64be207-d8e3-4df1-8dc6-4e326ddb7ee6 response_code = 204 uri = /switch-ports
16182024-11-07T22:43:21.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 793 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51503 req_id = 42cd00a4-5e88-43de-9855-53e1309b97dc response_code = 200 uri = /network-bootstore-config
16192024-11-07T22:43:21.667ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16202024-11-07T22:43:21.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 210769 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57078 req_id = c9e255e7-ef7d-4816-bfe8-272f8f1adf84 response_code = 204 uri = /switch-ports
16212024-11-07T22:43:21.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57078 req_id = fb5bc544-bf56-48e6-868c-eaef2777cc52 response_code = 200 uri = /network-bootstore-config
16222024-11-07T22:43:26.102ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63928
16232024-11-07T22:43:26.102ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63928 req_id = cd00c721-f9f1-43ba-959f-728d066c68c1 response_code = 200 uri = /baseboard
16242024-11-07T22:43:51.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40943
16252024-11-07T22:43:51.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40943 req_id = 3df2e42e-5b94-4e6e-b554-6f4be940b6eb response_code = 200 uri = /vpc-routes
16262024-11-07T22:43:51.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45857
16272024-11-07T22:43:51.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45857 req_id = 2224cc41-5bfd-4e0b-a29b-3d36bfc743c7 response_code = 200 uri = /vpc-routes
16282024-11-07T22:43:51.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
16292024-11-07T22:43:51.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40943 req_id = f621c30a-4662-49b4-bef7-2051fca24a68 response_code = 204 uri = /eip-gateways
16302024-11-07T22:43:51.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40943 req_id = c94cbb99-6e3f-4a23-910f-ec62567aafb1 response_code = 204 uri = /vpc-routes
16312024-11-07T22:43:51.195ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
16322024-11-07T22:43:51.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45857 req_id = 1e1db630-09d1-417a-b982-d0cd523a1dbf response_code = 204 uri = /eip-gateways
16332024-11-07T22:43:51.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45857 req_id = 2091d8a7-a827-4aef-9de6-44d6ba15ebdb response_code = 204 uri = /vpc-routes
16342024-11-07T22:43:51.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56846
16352024-11-07T22:43:51.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56846 req_id = dd943423-b65e-4043-bf91-f880b074bfda response_code = 200 uri = /vpc-routes
16362024-11-07T22:43:51.307ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
16372024-11-07T22:43:51.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56846 req_id = b520ab62-1083-4dd0-837f-9254f2f504a3 response_code = 204 uri = /eip-gateways
16382024-11-07T22:43:51.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56846 req_id = 7007d811-c6b6-4d05-a303-bb8af569814f response_code = 204 uri = /vpc-routes
16392024-11-07T22:43:51.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48807
16402024-11-07T22:43:51.330ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16412024-11-07T22:43:51.374ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16422024-11-07T22:43:51.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112562 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48807 req_id = 65794a73-16c3-4d6c-8aed-0591339e9144 response_code = 204 uri = /switch-ports
16432024-11-07T22:43:51.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45539
16442024-11-07T22:43:51.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35957
16452024-11-07T22:43:51.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43780
16462024-11-07T22:43:51.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4562 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48807 req_id = 62507bb8-1343-41bd-a5f6-456a077057ff response_code = 200 uri = /network-bootstore-config
16472024-11-07T22:43:51.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51714
16482024-11-07T22:43:51.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 651 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45539 req_id = 1972542b-27d6-46ab-8540-7ab5b0c00d74 response_code = 200 uri = /v2p
16492024-11-07T22:43:51.448ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16502024-11-07T22:43:51.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51714 req_id = f928d103-c53c-4250-a864-dda182e6bba1 response_code = 200 uri = /v2p
16512024-11-07T22:43:51.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 472 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35957 req_id = bf75d584-c856-4095-980a-f58bcc57e46c response_code = 200 uri = /v2p
16522024-11-07T22:43:51.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43985
16532024-11-07T22:43:51.489ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16542024-11-07T22:43:51.550ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16552024-11-07T22:43:51.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43780 req_id = 957395a1-0362-454c-bfc3-67460398ac0b response_code = 204 uri = /switch-ports
16562024-11-07T22:43:51.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 759 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43780 req_id = b8e68787-f9c8-45d7-b7ed-5362210eddca response_code = 200 uri = /network-bootstore-config
16572024-11-07T22:43:51.594ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16582024-11-07T22:43:51.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173816 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43985 req_id = 751b2b00-f3e7-4e63-bcfe-ef2aa0aee9a7 response_code = 204 uri = /switch-ports
16592024-11-07T22:43:51.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43985 req_id = f9988b58-1ca7-4ad2-8c8d-97bd2b6eff6a response_code = 200 uri = /network-bootstore-config
16602024-11-07T22:43:56.136ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62783
16612024-11-07T22:43:56.136ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62783 req_id = 1295f6e1-022c-41ce-b887-626576d08b75 response_code = 200 uri = /baseboard
16622024-11-07T22:44:21.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34125
16632024-11-07T22:44:21.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34125 req_id = 7b152a49-37b9-464a-a750-f2500dd200f0 response_code = 200 uri = /vpc-routes
16642024-11-07T22:44:21.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60085
16652024-11-07T22:44:21.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60085 req_id = db467661-b0c9-44ba-90ae-2582130c1df9 response_code = 200 uri = /vpc-routes
16662024-11-07T22:44:21.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
16672024-11-07T22:44:21.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34125 req_id = f2e90b00-276b-43c8-a955-5fe9a44e367e response_code = 204 uri = /eip-gateways
16682024-11-07T22:44:21.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55538
16692024-11-07T22:44:21.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55538 req_id = 3c59ed42-b1f0-4f75-8bf3-35629655d0a7 response_code = 200 uri = /v2p
16702024-11-07T22:44:21.191ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
16712024-11-07T22:44:21.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60085 req_id = 0bae6d73-eefc-4b28-b639-566bf2ac62b8 response_code = 204 uri = /eip-gateways
16722024-11-07T22:44:21.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44857
16732024-11-07T22:44:21.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44857 req_id = e9219882-8c96-4e9c-9a3e-5e2f978cbd41 response_code = 200 uri = /v2p
16742024-11-07T22:44:21.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34125 req_id = 184f4de1-a50d-4462-9cda-6fb3e22dcdb5 response_code = 204 uri = /vpc-routes
16752024-11-07T22:44:21.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60085 req_id = 6861b561-1483-4313-993b-05ee1260a024 response_code = 204 uri = /vpc-routes
16762024-11-07T22:44:21.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37841
16772024-11-07T22:44:21.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37841 req_id = d3a6c221-678f-4e2c-8140-0991482fbe19 response_code = 200 uri = /vpc-routes
16782024-11-07T22:44:21.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61010
16792024-11-07T22:44:21.234ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16802024-11-07T22:44:21.275ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16812024-11-07T22:44:21.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61010 req_id = 9c36d147-9233-445d-8590-7b9912dbabac response_code = 204 uri = /switch-ports
16822024-11-07T22:44:21.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40832
16832024-11-07T22:44:21.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53749
16842024-11-07T22:44:21.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62025
16852024-11-07T22:44:21.333ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
16862024-11-07T22:44:21.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37841 req_id = 7fe4cd2f-8626-47e4-878a-72f75fc38276 response_code = 204 uri = /eip-gateways
16872024-11-07T22:44:21.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61010 req_id = f25160c3-d460-457f-b844-741624c6ac83 response_code = 200 uri = /network-bootstore-config
16882024-11-07T22:44:21.334ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16892024-11-07T22:44:21.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62025 req_id = bbb4393b-4e1c-45f8-83e2-e632c0b9af19 response_code = 200 uri = /v2p
16902024-11-07T22:44:21.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37841 req_id = 892da4cb-b391-42da-8d13-52a927a860b7 response_code = 204 uri = /vpc-routes
16912024-11-07T22:44:21.374ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16922024-11-07T22:44:21.427ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
16932024-11-07T22:44:21.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93119 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53749 req_id = cb6d41d2-8346-4c3d-b617-213bf75290da response_code = 204 uri = /switch-ports
16942024-11-07T22:44:21.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 695 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53749 req_id = 9b7885ff-e89f-4c20-ad2c-83506c9ce366 response_code = 200 uri = /network-bootstore-config
16952024-11-07T22:44:21.461ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
16962024-11-07T22:44:21.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175945 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40832 req_id = 579173da-c8b3-41c6-beda-2feded1f21aa response_code = 204 uri = /switch-ports
16972024-11-07T22:44:21.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40832 req_id = ee71f213-4957-42a3-8b21-f4a9c5911b6c response_code = 200 uri = /network-bootstore-config
16982024-11-07T22:44:26.171ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38160
16992024-11-07T22:44:26.171ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38160 req_id = 5edbe225-e24b-4040-9b4a-b492b379f29c response_code = 200 uri = /baseboard
17002024-11-07T22:44:51.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61585
17012024-11-07T22:44:51.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61585 req_id = c0ca73b3-ef02-40ee-9481-e563dd195462 response_code = 200 uri = /vpc-routes
17022024-11-07T22:44:51.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
17032024-11-07T22:44:51.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61585 req_id = 1b9b07bf-e328-47a6-857b-4c7ce799993e response_code = 204 uri = /eip-gateways
17042024-11-07T22:44:51.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61585 req_id = cb443c66-8879-4190-a8ac-02ec2991e49e response_code = 204 uri = /vpc-routes
17052024-11-07T22:44:51.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36228
17062024-11-07T22:44:51.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36228 req_id = d246b731-074d-42ca-ab03-9f9ab0c00b70 response_code = 200 uri = /vpc-routes
17072024-11-07T22:44:51.344ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
17082024-11-07T22:44:51.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36228 req_id = 46fc8b67-053c-41b0-8bc6-d371d512a762 response_code = 204 uri = /eip-gateways
17092024-11-07T22:44:51.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63491
17102024-11-07T22:44:51.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63491 req_id = 2adb0bff-45a8-4d0d-9c57-e3fd41f4c987 response_code = 200 uri = /vpc-routes
17112024-11-07T22:44:51.366ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
17122024-11-07T22:44:51.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63491 req_id = e4fa2e98-68da-4480-af2b-c13a8cd575c2 response_code = 204 uri = /eip-gateways
17132024-11-07T22:44:51.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63491 req_id = 16d588a9-ba0e-4711-8101-75e4e7317a7e response_code = 204 uri = /vpc-routes
17142024-11-07T22:44:51.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45769
17152024-11-07T22:44:51.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45769 req_id = 8e4fb856-689f-415a-9f70-477c4016066a response_code = 200 uri = /v2p
17162024-11-07T22:44:51.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36228 req_id = 22c16825-dabe-4dc6-904d-e01b371b3ca6 response_code = 204 uri = /vpc-routes
17172024-11-07T22:44:51.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57516
17182024-11-07T22:44:51.436ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17192024-11-07T22:44:51.472ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17202024-11-07T22:44:51.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85995 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57516 req_id = e413d162-65ba-46ed-8a05-886062e5e35d response_code = 204 uri = /switch-ports
17212024-11-07T22:44:51.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58095
17222024-11-07T22:44:51.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60651
17232024-11-07T22:44:51.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54585
17242024-11-07T22:44:51.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54585 req_id = 9bd0c9f3-6979-408c-8781-230e11cc5ffa response_code = 200 uri = /v2p
17252024-11-07T22:44:51.523ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17262024-11-07T22:44:51.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58095 req_id = 995eb012-bf9a-4041-8694-7176aa4f3dcc response_code = 200 uri = /v2p
17272024-11-07T22:44:51.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57516 req_id = 53850a9b-2f3c-4397-9f77-d219d5246c90 response_code = 200 uri = /network-bootstore-config
17282024-11-07T22:44:51.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34356
17292024-11-07T22:44:51.563ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17302024-11-07T22:44:51.622ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17312024-11-07T22:44:51.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99849 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60651 req_id = 3bdcd10b-88e4-4b4f-8a4e-3f5bec42f705 response_code = 204 uri = /switch-ports
17322024-11-07T22:44:51.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 534 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60651 req_id = ccae22df-be98-4dde-8cea-ef4c0c41f28a response_code = 200 uri = /network-bootstore-config
17332024-11-07T22:44:51.659ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17342024-11-07T22:44:51.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154768 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34356 req_id = 004575ef-a079-4b79-9265-00e7bf31d666 response_code = 204 uri = /switch-ports
17352024-11-07T22:44:51.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34356 req_id = a0adc68f-8fba-4395-a7ae-45eca0c1b6ef response_code = 200 uri = /network-bootstore-config
17362024-11-07T22:44:56.206ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55087
17372024-11-07T22:44:56.206ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55087 req_id = 29c45acf-44d5-44f0-9954-0d18c6d48547 response_code = 200 uri = /baseboard
17382024-11-07T22:45:21.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33067
17392024-11-07T22:45:21.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33067 req_id = dbffd2a1-ffa4-481c-831e-675117692323 response_code = 200 uri = /vpc-routes
17402024-11-07T22:45:21.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61888
17412024-11-07T22:45:21.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61888 req_id = 34a830d8-c4c3-4ea9-9dce-70b35dfa6aef response_code = 200 uri = /vpc-routes
17422024-11-07T22:45:21.075ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
17432024-11-07T22:45:21.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61888 req_id = 58e470c9-28d5-48e6-a56d-87eaf2529d34 response_code = 204 uri = /eip-gateways
17442024-11-07T22:45:21.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61888 req_id = 4fc0d66b-68ef-48ce-a4e4-bf3860bd65c7 response_code = 204 uri = /vpc-routes
17452024-11-07T22:45:21.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
17462024-11-07T22:45:21.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33067 req_id = 767bb052-2530-4102-a635-6c175c882e31 response_code = 204 uri = /eip-gateways
17472024-11-07T22:45:21.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33067 req_id = c46ed456-8790-4d0e-8b82-f62070d09aa9 response_code = 204 uri = /vpc-routes
17482024-11-07T22:45:21.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35336
17492024-11-07T22:45:21.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35336 req_id = 563333b3-e290-441f-87c4-94d247709b52 response_code = 200 uri = /vpc-routes
17502024-11-07T22:45:21.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59510
17512024-11-07T22:45:21.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59510 req_id = 4f74b7de-e846-49f0-aae9-6b72ab6538ca response_code = 200 uri = /v2p
17522024-11-07T22:45:21.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34817
17532024-11-07T22:45:21.186ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17542024-11-07T22:45:21.230ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17552024-11-07T22:45:21.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34817 req_id = 53111333-b9cc-47fd-873d-e840f01e02a9 response_code = 204 uri = /switch-ports
17562024-11-07T22:45:21.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38435
17572024-11-07T22:45:21.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50353
17582024-11-07T22:45:21.292ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17592024-11-07T22:45:21.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
17602024-11-07T22:45:21.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35336 req_id = 95b95f01-8958-4bfd-9ecd-efb1601d23f1 response_code = 204 uri = /eip-gateways
17612024-11-07T22:45:21.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34817 req_id = 0d8f106a-61a9-4bbc-9164-8a5ecf843e31 response_code = 200 uri = /network-bootstore-config
17622024-11-07T22:45:21.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50353 req_id = cffcaee6-7bb6-4fc1-8f9a-0bf29ea923e5 response_code = 200 uri = /v2p
17632024-11-07T22:45:21.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39929
17642024-11-07T22:45:21.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39929 req_id = 9536b4a4-4252-4526-ab8e-5e91dfb00f54 response_code = 200 uri = /v2p
17652024-11-07T22:45:21.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51297
17662024-11-07T22:45:21.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 801 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35336 req_id = 0fddbbbc-a52d-4d4d-a6b7-0fec125035c6 response_code = 204 uri = /vpc-routes
17672024-11-07T22:45:21.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17682024-11-07T22:45:21.392ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17692024-11-07T22:45:21.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100103 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38435 req_id = ec1351c4-0eb7-483f-ba32-15917e78050a response_code = 204 uri = /switch-ports
17702024-11-07T22:45:21.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 720 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38435 req_id = 4c621e40-18e7-4c6e-9640-eeb87ac08eb6 response_code = 200 uri = /network-bootstore-config
17712024-11-07T22:45:21.423ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17722024-11-07T22:45:21.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178928 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51297 req_id = 53b3946f-65e3-40d4-a65c-9e35cf26e48a response_code = 204 uri = /switch-ports
17732024-11-07T22:45:21.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51297 req_id = ead4bbfc-8aba-4654-a948-051e23ab0c04 response_code = 200 uri = /network-bootstore-config
17742024-11-07T22:45:26.240ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47824
17752024-11-07T22:45:26.241ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47824 req_id = 49572de2-07a6-480b-9b68-c87f5dc555e5 response_code = 200 uri = /baseboard
17762024-11-07T22:45:41.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
17772024-11-07T22:45:51.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46701
17782024-11-07T22:45:51.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46701 req_id = 94d4cebd-e827-4d8b-9d23-040cb515a61a response_code = 200 uri = /vpc-routes
17792024-11-07T22:45:51.276ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
17802024-11-07T22:45:51.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46701 req_id = 2bd37790-6a6b-4ab3-9c33-b3e19a0152ab response_code = 204 uri = /eip-gateways
17812024-11-07T22:45:51.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35097
17822024-11-07T22:45:51.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35097 req_id = 066b9078-f3e1-4e1b-ba17-0591b79034a4 response_code = 200 uri = /vpc-routes
17832024-11-07T22:45:51.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43294
17842024-11-07T22:45:51.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43294 req_id = 2b5e1823-2cb1-4613-ad87-0d856613070c response_code = 200 uri = /v2p
17852024-11-07T22:45:51.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46701 req_id = 6ad9e17f-3851-49f4-a451-630cb2c18e27 response_code = 204 uri = /vpc-routes
17862024-11-07T22:45:51.363ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
17872024-11-07T22:45:51.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35097 req_id = bdcb879d-1c1f-4b12-9d69-9d83f069bcf8 response_code = 204 uri = /eip-gateways
17882024-11-07T22:45:51.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34201
17892024-11-07T22:45:51.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35097 req_id = 7b8da27e-f41a-49a6-bac4-c0de387fc906 response_code = 204 uri = /vpc-routes
17902024-11-07T22:45:51.375ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17912024-11-07T22:45:51.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61956
17922024-11-07T22:45:51.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 379 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61956 req_id = a495c9e2-ca98-4458-9a1e-c45c660a09e4 response_code = 200 uri = /v2p
17932024-11-07T22:45:51.421ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
17942024-11-07T22:45:51.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62097
17952024-11-07T22:45:51.485ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
17962024-11-07T22:45:51.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34201 req_id = de7f5c3d-4652-4264-af7e-6b6d28fca142 response_code = 204 uri = /switch-ports
17972024-11-07T22:45:51.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 716 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34201 req_id = 41e43864-9018-4010-8518-424a10434c72 response_code = 200 uri = /network-bootstore-config
17982024-11-07T22:45:51.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48208
17992024-11-07T22:45:51.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48208 req_id = cd174d9d-6b1f-44f5-894b-1bc1d565d493 response_code = 200 uri = /vpc-routes
18002024-11-07T22:45:51.521ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18012024-11-07T22:45:51.542ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
18022024-11-07T22:45:51.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48208 req_id = 4a2ab5ae-5f4c-4a6a-be3a-6d6c4ec37baa response_code = 204 uri = /eip-gateways
18032024-11-07T22:45:51.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48208 req_id = 10e52aa6-4e0b-439f-8258-879d3118d5ef response_code = 204 uri = /vpc-routes
18042024-11-07T22:45:51.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138852 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62097 req_id = 7a9fb3f6-6958-42a0-8bb7-7b3c326d75cb response_code = 204 uri = /switch-ports
18052024-11-07T22:45:51.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62097 req_id = 10cc976c-9223-459d-adfa-a161903ca564 response_code = 200 uri = /network-bootstore-config
18062024-11-07T22:45:51.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49333
18072024-11-07T22:45:51.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49333 req_id = 4ff3f6f2-7193-49d2-98ce-8e88e0fc606d response_code = 200 uri = /v2p
18082024-11-07T22:45:51.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48964
18092024-11-07T22:45:51.610ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18102024-11-07T22:45:51.646ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18112024-11-07T22:45:51.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93143 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48964 req_id = 3bf82183-a4c4-40e1-ab14-dc56b12b7716 response_code = 204 uri = /switch-ports
18122024-11-07T22:45:51.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48964 req_id = 1d8664cd-6724-43b9-8320-bae558c9848c response_code = 200 uri = /network-bootstore-config
18132024-11-07T22:45:56.273ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39607
18142024-11-07T22:45:56.273ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39607 req_id = b857497a-8b85-4848-bf3f-d77869c6ba40 response_code = 200 uri = /baseboard
18152024-11-07T22:46:21.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49063
18162024-11-07T22:46:21.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49063 req_id = 3e13b7f1-de01-4aee-abb1-f9d6fa03aff9 response_code = 200 uri = /vpc-routes
18172024-11-07T22:46:21.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63204
18182024-11-07T22:46:21.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 21 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63204 req_id = aa0f2f68-9b35-4652-8915-42c602864d7c response_code = 200 uri = /vpc-routes
18192024-11-07T22:46:21.125ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
18202024-11-07T22:46:21.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63204 req_id = 3afd26c0-51ae-47e2-ae0c-5a78b9e1bf32 response_code = 204 uri = /eip-gateways
18212024-11-07T22:46:21.125ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
18222024-11-07T22:46:21.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49063 req_id = ce6252c0-b78d-4fa5-afdf-4390e7ac4b44 response_code = 204 uri = /eip-gateways
18232024-11-07T22:46:21.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49063 req_id = 87ccb542-8fd1-4ea0-9a38-1c6151d03b9f response_code = 204 uri = /vpc-routes
18242024-11-07T22:46:21.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63204 req_id = ffd083aa-03e9-457f-aee9-c447cf07c24a response_code = 204 uri = /vpc-routes
18252024-11-07T22:46:21.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33560
18262024-11-07T22:46:21.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33560 req_id = 892d72de-b60b-4eb6-bd01-a23077bc96df response_code = 200 uri = /v2p
18272024-11-07T22:46:21.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49779
18282024-11-07T22:46:21.203ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18292024-11-07T22:46:21.242ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18302024-11-07T22:46:21.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96345 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49779 req_id = 7c63a2d5-876f-491a-bab1-ffa7af6431a5 response_code = 204 uri = /switch-ports
18312024-11-07T22:46:21.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49690
18322024-11-07T22:46:21.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61656
18332024-11-07T22:46:21.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65319
18342024-11-07T22:46:21.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65319 req_id = 5057ce4a-8012-404f-b998-1c15b1a958cf response_code = 200 uri = /vpc-routes
18352024-11-07T22:46:21.300ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18362024-11-07T22:46:21.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49690 req_id = b92958c4-db76-4808-928f-05b66b0bf05f response_code = 200 uri = /v2p
18372024-11-07T22:46:21.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3869 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49779 req_id = da088cce-ab65-42dc-bf7f-18b0ba6a0466 response_code = 200 uri = /network-bootstore-config
18382024-11-07T22:46:21.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59974
18392024-11-07T22:46:21.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59974 req_id = b996420c-318d-4999-9952-7b43a0e3cec3 response_code = 200 uri = /v2p
18402024-11-07T22:46:21.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64342
18412024-11-07T22:46:21.337ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18422024-11-07T22:46:21.345ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
18432024-11-07T22:46:21.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65319 req_id = dc6f2499-845f-42e2-910a-552f2bed9573 response_code = 204 uri = /eip-gateways
18442024-11-07T22:46:21.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65319 req_id = 3f62f06c-e281-49c9-8da2-220452709b6d response_code = 204 uri = /vpc-routes
18452024-11-07T22:46:21.397ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18462024-11-07T22:46:21.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97092 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61656 req_id = 58fca9e0-5911-4f95-9c7f-775b4c4323b1 response_code = 204 uri = /switch-ports
18472024-11-07T22:46:21.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61656 req_id = 1b9d861e-431b-48ec-9bfb-3da57bb764c9 response_code = 200 uri = /network-bootstore-config
18482024-11-07T22:46:21.433ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18492024-11-07T22:46:21.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165092 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64342 req_id = d9d117c0-a2ce-45d3-8062-e6015726be82 response_code = 204 uri = /switch-ports
18502024-11-07T22:46:21.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64342 req_id = 12d6f315-8b0f-4c07-a2e8-469810b11b44 response_code = 200 uri = /network-bootstore-config
18512024-11-07T22:46:26.307ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62156
18522024-11-07T22:46:26.307ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62156 req_id = 15e7aaf1-2787-403f-9e57-5ea17b3bb806 response_code = 200 uri = /baseboard
18532024-11-07T22:46:51.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55732
18542024-11-07T22:46:51.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55732 req_id = 107536c0-8b26-4924-bd14-b5e69c11921e response_code = 200 uri = /vpc-routes
18552024-11-07T22:46:51.156ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
18562024-11-07T22:46:51.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55732 req_id = fb9e3fba-63ee-430c-b830-ce1e5eee823e response_code = 204 uri = /eip-gateways
18572024-11-07T22:46:51.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55732 req_id = 2c4400d1-3bbe-429f-a915-48d64d7d1e11 response_code = 204 uri = /vpc-routes
18582024-11-07T22:46:51.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42365
18592024-11-07T22:46:51.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42365 req_id = 8be0f9dd-2c9d-4d50-9aeb-61ba6506e5d2 response_code = 200 uri = /vpc-routes
18602024-11-07T22:46:51.227ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
18612024-11-07T22:46:51.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42365 req_id = 6106f81a-8a71-4f98-ab36-867c11a6ffd3 response_code = 204 uri = /eip-gateways
18622024-11-07T22:46:51.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42365 req_id = 9b99b9b3-9ccd-4f32-a22f-20a854c36db4 response_code = 204 uri = /vpc-routes
18632024-11-07T22:46:51.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35215
18642024-11-07T22:46:51.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35215 req_id = 60ea3ccf-0c68-4606-aa1e-bd07e60e1a86 response_code = 200 uri = /v2p
18652024-11-07T22:46:51.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44117
18662024-11-07T22:46:51.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44117 req_id = 7888d540-4b34-4016-b78f-0336f59c3426 response_code = 200 uri = /vpc-routes
18672024-11-07T22:46:51.357ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
18682024-11-07T22:46:51.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44117 req_id = 5b3dc01a-3f93-4b2b-904b-74720d7ef92d response_code = 204 uri = /eip-gateways
18692024-11-07T22:46:51.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61598
18702024-11-07T22:46:51.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18712024-11-07T22:46:51.405ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18722024-11-07T22:46:51.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91405 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61598 req_id = 4fce4c6f-9c16-44e6-b26f-0939475e5868 response_code = 204 uri = /switch-ports
18732024-11-07T22:46:51.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55371
18742024-11-07T22:46:51.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48185
18752024-11-07T22:46:51.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61598 req_id = b9969800-42ab-4c65-ba92-08ccd7480e0a response_code = 200 uri = /network-bootstore-config
18762024-11-07T22:46:51.459ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18772024-11-07T22:46:51.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55371 req_id = feddbfa4-72f2-4e52-8271-2c0c6a2aa42e response_code = 200 uri = /v2p
18782024-11-07T22:46:51.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36112
18792024-11-07T22:46:51.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36112 req_id = e365af34-ba93-4036-903f-df01171f03e9 response_code = 200 uri = /v2p
18802024-11-07T22:46:51.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 936 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44117 req_id = 747ce598-3714-43d3-83cb-89c6f686d405 response_code = 204 uri = /vpc-routes
18812024-11-07T22:46:51.502ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18822024-11-07T22:46:51.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101041 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48185 req_id = f07f5a84-f503-4009-b55c-f0b65aa56602 response_code = 204 uri = /switch-ports
18832024-11-07T22:46:51.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48185 req_id = f9d29f29-8791-4cfb-a5e2-439a7fe9c0fd response_code = 200 uri = /network-bootstore-config
18842024-11-07T22:46:51.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45289
18852024-11-07T22:46:51.712ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
18862024-11-07T22:46:51.752ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
18872024-11-07T22:46:51.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45289 req_id = 7ae83457-ff3b-485b-8977-3c55a9b0895f response_code = 204 uri = /switch-ports
18882024-11-07T22:46:51.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45289 req_id = cf340bae-4fec-4ab8-8d97-8b47b29436b2 response_code = 200 uri = /network-bootstore-config
18892024-11-07T22:46:56.342ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61248
18902024-11-07T22:46:56.342ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61248 req_id = b07a87b2-0814-4e42-9e73-cf27517db2a2 response_code = 200 uri = /baseboard
18912024-11-07T22:47:21.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43033
18922024-11-07T22:47:21.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43033 req_id = 6d81af16-f699-480f-aa13-abe5f45696b6 response_code = 200 uri = /v2p
18932024-11-07T22:47:21.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39149
18942024-11-07T22:47:21.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39149 req_id = 3ab8a4bc-86d8-462e-b1af-39f6c316ed35 response_code = 200 uri = /vpc-routes
18952024-11-07T22:47:21.117ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
18962024-11-07T22:47:21.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39149 req_id = dd387288-e8a0-4181-bc69-b10c2878aff3 response_code = 204 uri = /eip-gateways
18972024-11-07T22:47:21.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39149 req_id = 720688fc-309c-4725-80e4-a8c6e08315f8 response_code = 204 uri = /vpc-routes
18982024-11-07T22:47:21.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48240
18992024-11-07T22:47:21.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48240 req_id = 9e1cf664-84ca-4bfc-8949-19abf37f99da response_code = 200 uri = /vpc-routes
19002024-11-07T22:47:21.189ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
19012024-11-07T22:47:21.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48240 req_id = e4dcba90-fd59-43e8-9f3a-66f3e7333d12 response_code = 204 uri = /eip-gateways
19022024-11-07T22:47:21.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59056
19032024-11-07T22:47:21.197ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19042024-11-07T22:47:21.240ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19052024-11-07T22:47:21.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59056 req_id = cbb44271-4920-40de-84ef-f3be1c6d3493 response_code = 204 uri = /switch-ports
19062024-11-07T22:47:21.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40938
19072024-11-07T22:47:21.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63284
19082024-11-07T22:47:21.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49515
19092024-11-07T22:47:21.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59056 req_id = 49440d44-e54a-4338-8088-598b8170ac50 response_code = 200 uri = /network-bootstore-config
19102024-11-07T22:47:21.303ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19112024-11-07T22:47:21.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40938 req_id = 32b4d546-b373-4100-93fa-87e7d91deb46 response_code = 200 uri = /vpc-routes
19122024-11-07T22:47:21.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49515 req_id = cebf25fe-afc1-44ae-b62d-2452f4b77a2d response_code = 200 uri = /v2p
19132024-11-07T22:47:21.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4806 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48240 req_id = 41266615-ed7d-476f-b242-52c08e7454f1 response_code = 204 uri = /vpc-routes
19142024-11-07T22:47:21.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56504
19152024-11-07T22:47:21.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56504 req_id = ca3cc46b-41ee-417b-a74d-b7f975949fc7 response_code = 200 uri = /v2p
19162024-11-07T22:47:21.321ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
19172024-11-07T22:47:21.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40938 req_id = 22295935-8978-417b-8dbc-e6316390151a response_code = 204 uri = /eip-gateways
19182024-11-07T22:47:21.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 951 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40938 req_id = 8b2f9a98-a570-4938-8a77-a8aaecce16fa response_code = 204 uri = /vpc-routes
19192024-11-07T22:47:21.340ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19202024-11-07T22:47:21.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34712
19212024-11-07T22:47:21.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19222024-11-07T22:47:21.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93441 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63284 req_id = 5e73f397-a773-41d9-949a-0cc7b0d555b4 response_code = 204 uri = /switch-ports
19232024-11-07T22:47:21.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 627 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63284 req_id = ce5cbccc-3a44-4567-930a-c95316ad68dd response_code = 200 uri = /network-bootstore-config
19242024-11-07T22:47:21.432ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19252024-11-07T22:47:21.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34712 req_id = dc6cefcf-e77b-4d25-a4cd-8927ba0e17c0 response_code = 204 uri = /switch-ports
19262024-11-07T22:47:21.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34712 req_id = 67dcce23-0efb-4cec-99db-4c6a9cf0a8a4 response_code = 200 uri = /network-bootstore-config
19272024-11-07T22:47:26.379ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45915
19282024-11-07T22:47:26.379ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45915 req_id = 16e3b0a1-3e38-48bb-8431-b78951c3e434 response_code = 200 uri = /baseboard
19292024-11-07T22:47:51.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62344
19302024-11-07T22:47:51.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62344 req_id = 55495cee-200f-4f85-9d19-7de0860ff1a5 response_code = 200 uri = /v2p
19312024-11-07T22:47:51.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42752
19322024-11-07T22:47:51.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42752 req_id = 804bc009-e728-4d2e-a188-7cc7c0cb15a5 response_code = 200 uri = /vpc-routes
19332024-11-07T22:47:51.253ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
19342024-11-07T22:47:51.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42752 req_id = 92c5721a-8844-424e-aac2-4d0c0a1eae6b response_code = 204 uri = /eip-gateways
19352024-11-07T22:47:51.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42752 req_id = 9028e866-180d-415b-a4a7-bb30a28594b0 response_code = 204 uri = /vpc-routes
19362024-11-07T22:47:51.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52022
19372024-11-07T22:47:51.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52022 req_id = 67a68deb-c3b1-42ef-a771-d621942f41e9 response_code = 200 uri = /vpc-routes
19382024-11-07T22:47:51.318ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
19392024-11-07T22:47:51.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52022 req_id = 9c448e18-e0d1-459b-b5fe-3dd1f5be6685 response_code = 204 uri = /eip-gateways
19402024-11-07T22:47:51.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34317
19412024-11-07T22:47:51.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34317 req_id = 4eab7ee0-4945-46ae-98b6-93be99e8d88d response_code = 200 uri = /vpc-routes
19422024-11-07T22:47:51.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52022 req_id = 9269ec81-852d-40fa-bf18-9f6400d7d84e response_code = 204 uri = /vpc-routes
19432024-11-07T22:47:51.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50676
19442024-11-07T22:47:51.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19452024-11-07T22:47:51.412ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19462024-11-07T22:47:51.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104756 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50676 req_id = c94a0f19-2dbe-47c7-8b1c-6c0b7a4980a9 response_code = 204 uri = /switch-ports
19472024-11-07T22:47:51.473ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
19482024-11-07T22:47:51.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34317 req_id = b2645451-430e-4eb3-933e-2d7c393f457a response_code = 204 uri = /eip-gateways
19492024-11-07T22:47:51.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36058
19502024-11-07T22:47:51.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42344
19512024-11-07T22:47:51.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49994
19522024-11-07T22:47:51.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50676 req_id = d7e52f69-32bc-4204-8910-d5caf5fe75aa response_code = 200 uri = /network-bootstore-config
19532024-11-07T22:47:51.474ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19542024-11-07T22:47:51.474ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19552024-11-07T22:47:51.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42344 req_id = 329fae7c-0e3f-4c3d-888e-86c132c30fef response_code = 200 uri = /v2p
19562024-11-07T22:47:51.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19572024-11-07T22:47:51.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19582024-11-07T22:47:51.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19592024-11-07T22:47:51.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19602024-11-07T22:47:51.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19612024-11-07T22:47:51.474ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19622024-11-07T22:47:51.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36058 req_id = a4211e01-d585-4916-a261-dc9a050a61ae response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19632024-11-07T22:47:51.515ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19642024-11-07T22:47:51.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50237
19652024-11-07T22:47:51.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50237 req_id = 200adf3d-14fb-4a98-94cf-a4b3cd5f472c response_code = 200 uri = /v2p
19662024-11-07T22:47:51.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48218
19672024-11-07T22:47:51.544ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19682024-11-07T22:47:51.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19692024-11-07T22:47:51.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19702024-11-07T22:47:51.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19712024-11-07T22:47:51.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19722024-11-07T22:47:51.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19732024-11-07T22:47:51.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19742024-11-07T22:47:51.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48218 req_id = 723e6cdf-2c2a-4911-8d9a-9bb2eb67bf93 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19752024-11-07T22:47:51.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34317 req_id = 7f793d22-eabb-40dd-a0d0-456e315e6e89 response_code = 204 uri = /vpc-routes
19762024-11-07T22:47:51.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49994 req_id = b711a976-d80a-4889-8a22-b30853a4778f response_code = 204 uri = /switch-ports
19772024-11-07T22:47:51.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49994 req_id = 4154b2ec-4341-4323-a234-47a91d65a40c response_code = 200 uri = /network-bootstore-config
19782024-11-07T22:47:51.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65029
19792024-11-07T22:47:51.582ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19802024-11-07T22:47:51.582ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19812024-11-07T22:47:51.582ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19822024-11-07T22:47:51.582ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19832024-11-07T22:47:51.582ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19842024-11-07T22:47:51.582ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19852024-11-07T22:47:51.583ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19862024-11-07T22:47:51.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65029 req_id = bda3ffd4-ec98-4eab-b886-83658a3e3bff response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19872024-11-07T22:47:51.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37101
19882024-11-07T22:47:51.596ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
19892024-11-07T22:47:51.637ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
19902024-11-07T22:47:51.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104317 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37101 req_id = cffbcaf7-b6b5-4c57-800d-c71c442ddf8a response_code = 204 uri = /switch-ports
19912024-11-07T22:47:51.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37101 req_id = 11672c2a-18b1-4cf3-9d7a-2cac4e734718 response_code = 200 uri = /network-bootstore-config
19922024-11-07T22:47:56.413ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36755
19932024-11-07T22:47:56.413ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36755 req_id = 3953143f-62a3-436e-95e1-a3f4249ed155 response_code = 200 uri = /baseboard
19942024-11-07T22:48:21.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57378
19952024-11-07T22:48:21.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57378 req_id = 4620cad7-7356-4ba8-b7ca-0080b0b341c5 response_code = 200 uri = /vpc-routes
19962024-11-07T22:48:21.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39483
19972024-11-07T22:48:21.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39483 req_id = ecb35d5d-b355-4995-94f1-74109c9e9016 response_code = 200 uri = /vpc-routes
19982024-11-07T22:48:21.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
19992024-11-07T22:48:21.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57378 req_id = b4b196ec-95be-4832-a228-804f1f129971 response_code = 204 uri = /eip-gateways
20002024-11-07T22:48:21.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57378 req_id = c580e35d-09e3-421c-bd53-444225882c7a response_code = 204 uri = /vpc-routes
20012024-11-07T22:48:21.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45803
20022024-11-07T22:48:21.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20032024-11-07T22:48:21.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20042024-11-07T22:48:21.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124293 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45803 req_id = 967f9a83-5da4-4038-90dd-552c2ea81b8b response_code = 204 uri = /switch-ports
20052024-11-07T22:48:21.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52111
20062024-11-07T22:48:21.269ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
20072024-11-07T22:48:21.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39483 req_id = eecbcfbb-e93c-4ac4-b9e0-edca9d11d3cf response_code = 204 uri = /eip-gateways
20082024-11-07T22:48:21.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48549
20092024-11-07T22:48:21.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36241
20102024-11-07T22:48:21.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45803 req_id = 0f46f32f-b07c-4933-9fc3-1a0a2c3c6d82 response_code = 200 uri = /network-bootstore-config
20112024-11-07T22:48:21.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52111 req_id = c831c49b-3bf5-42cd-86d6-9dc4b9895d58 response_code = 200 uri = /v2p
20122024-11-07T22:48:21.270ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20132024-11-07T22:48:21.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48549 req_id = 1d610fbe-a6f3-40fa-931d-5a427db592bc response_code = 200 uri = /v2p
20142024-11-07T22:48:21.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39483 req_id = bc431c01-0b9a-47c2-aecc-f5a66e4f034d response_code = 204 uri = /vpc-routes
20152024-11-07T22:48:21.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64519
20162024-11-07T22:48:21.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64519 req_id = befae703-0d83-4465-9d92-fd6355a3e2e4 response_code = 200 uri = /vpc-routes
20172024-11-07T22:48:21.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38342
20182024-11-07T22:48:21.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
20192024-11-07T22:48:21.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64519 req_id = a68ccdd9-cb9d-4a69-bb85-cb79ab3cadf2 response_code = 204 uri = /eip-gateways
20202024-11-07T22:48:21.312ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20212024-11-07T22:48:21.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54811
20222024-11-07T22:48:21.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54811 req_id = 2206b456-983f-4806-9c86-46475a53d0d9 response_code = 200 uri = /v2p
20232024-11-07T22:48:21.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64519 req_id = 415d86a2-a003-4a17-9a8f-c51bd5bc5531 response_code = 204 uri = /vpc-routes
20242024-11-07T22:48:21.370ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20252024-11-07T22:48:21.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101102 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36241 req_id = 623e0612-2ad3-4139-82ca-e254e4c3e8b9 response_code = 204 uri = /switch-ports
20262024-11-07T22:48:21.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36241 req_id = 9a299284-e69d-472b-9e4c-1df4cb397c94 response_code = 200 uri = /network-bootstore-config
20272024-11-07T22:48:21.406ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20282024-11-07T22:48:21.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 159799 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38342 req_id = becf083f-fb48-49c7-9da1-29bab1689700 response_code = 204 uri = /switch-ports
20292024-11-07T22:48:21.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38342 req_id = 391bd690-d078-4638-95c4-af94b03b7597 response_code = 200 uri = /network-bootstore-config
20302024-11-07T22:48:26.449ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59928
20312024-11-07T22:48:26.449ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59928 req_id = 97273868-6462-4763-ba61-561446c0844b response_code = 200 uri = /baseboard
20322024-11-07T22:48:51.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44179
20332024-11-07T22:48:51.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44179 req_id = 938568c1-fd00-4cee-8799-6bb98537623f response_code = 200 uri = /vpc-routes
20342024-11-07T22:48:51.169ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
20352024-11-07T22:48:51.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44179 req_id = 0e068ef4-6df4-414f-8d11-ce38fed194fa response_code = 204 uri = /eip-gateways
20362024-11-07T22:48:51.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44179 req_id = d167d14b-dd75-40ed-a724-b818f4d2da5f response_code = 204 uri = /vpc-routes
20372024-11-07T22:48:51.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59328
20382024-11-07T22:48:51.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59328 req_id = 792eb6ff-cca8-4a76-89af-fbdc4a97504b response_code = 200 uri = /vpc-routes
20392024-11-07T22:48:51.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
20402024-11-07T22:48:51.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59328 req_id = 4bd2d96a-ce43-4262-90dc-491c5f509b68 response_code = 204 uri = /eip-gateways
20412024-11-07T22:48:51.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59328 req_id = 6f9b9d76-73f1-444c-b592-710568b2b54a response_code = 204 uri = /vpc-routes
20422024-11-07T22:48:51.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32795
20432024-11-07T22:48:51.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32795 req_id = d1737f89-1f76-445e-a355-bfcf7810aea3 response_code = 200 uri = /vpc-routes
20442024-11-07T22:48:51.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34058
20452024-11-07T22:48:51.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34058 req_id = 821edd88-32f2-4cc4-9c66-1a21bc038572 response_code = 200 uri = /v2p
20462024-11-07T22:48:51.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58684
20472024-11-07T22:48:51.408ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20482024-11-07T22:48:51.454ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20492024-11-07T22:48:51.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58684 req_id = 7790464a-4ceb-4e43-9154-0ee575d4f850 response_code = 204 uri = /switch-ports
20502024-11-07T22:48:51.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61732
20512024-11-07T22:48:51.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63469
20522024-11-07T22:48:51.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51504
20532024-11-07T22:48:51.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
20542024-11-07T22:48:51.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32795 req_id = fa9bfecd-4c6b-4c68-9bbb-778faeca3906 response_code = 204 uri = /eip-gateways
20552024-11-07T22:48:51.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58684 req_id = cbd525e3-9d97-423c-a786-343e0fc8ee9c response_code = 200 uri = /network-bootstore-config
20562024-11-07T22:48:51.521ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20572024-11-07T22:48:51.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63469 req_id = 6c63ca38-2425-4f32-a791-69fd44dd87c9 response_code = 200 uri = /v2p
20582024-11-07T22:48:51.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32795 req_id = af020572-9f08-42e1-8429-5ce829f1b382 response_code = 204 uri = /vpc-routes
20592024-11-07T22:48:51.565ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20602024-11-07T22:48:51.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41268
20612024-11-07T22:48:51.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41268 req_id = e62c97b0-0368-4aba-9794-75c983e42f4a response_code = 200 uri = /v2p
20622024-11-07T22:48:51.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51504 req_id = aca5ed6a-d12d-4652-9d56-518803752d55 response_code = 204 uri = /switch-ports
20632024-11-07T22:48:51.622ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20642024-11-07T22:48:51.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 546 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51504 req_id = f5c5cc24-fa07-42a3-9b34-2046fade4b6a response_code = 200 uri = /network-bootstore-config
20652024-11-07T22:48:51.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20662024-11-07T22:48:51.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193571 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61732 req_id = 8e7cf36e-cd64-4043-a0bd-c6a79cdfe8dc response_code = 204 uri = /switch-ports
20672024-11-07T22:48:51.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61732 req_id = 6571698f-11ce-4488-9239-069d0ef5d57f response_code = 200 uri = /network-bootstore-config
20682024-11-07T22:48:56.482ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52930
20692024-11-07T22:48:56.482ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52930 req_id = e13cb73b-6ed4-43d9-ac4d-889a8462caf5 response_code = 200 uri = /baseboard
20702024-11-07T22:49:21.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48609
20712024-11-07T22:49:21.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48609 req_id = 7b435134-9459-4ad8-bf56-2522052ec535 response_code = 200 uri = /vpc-routes
20722024-11-07T22:49:21.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
20732024-11-07T22:49:21.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48609 req_id = 304512d4-e790-4734-aea3-96e4cecb81b2 response_code = 204 uri = /eip-gateways
20742024-11-07T22:49:21.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34041
20752024-11-07T22:49:21.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34041 req_id = e1a98828-c811-4740-8ef2-77c4a858f7a5 response_code = 200 uri = /vpc-routes
20762024-11-07T22:49:21.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48609 req_id = 8fddef7d-1715-4ddd-94b0-c3b4246e139f response_code = 204 uri = /vpc-routes
20772024-11-07T22:49:21.170ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
20782024-11-07T22:49:21.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34041 req_id = 0404b024-fd7e-4133-bec8-5fb157c75c4a response_code = 204 uri = /eip-gateways
20792024-11-07T22:49:21.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2694 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34041 req_id = dcd938a7-5479-43d8-bccc-4b438aa781df response_code = 204 uri = /vpc-routes
20802024-11-07T22:49:21.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48824
20812024-11-07T22:49:21.193ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20822024-11-07T22:49:21.237ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20832024-11-07T22:49:21.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109965 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48824 req_id = 308b08e7-3bff-445e-b837-280659710cb7 response_code = 204 uri = /switch-ports
20842024-11-07T22:49:21.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64543
20852024-11-07T22:49:21.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64612
20862024-11-07T22:49:21.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41377
20872024-11-07T22:49:21.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47703
20882024-11-07T22:49:21.303ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
20892024-11-07T22:49:21.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41377 req_id = 2b78c9c9-efc8-4a2d-9cad-30328d318b7d response_code = 200 uri = /v2p
20902024-11-07T22:49:21.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64612 req_id = f1268c02-9eae-493b-90b5-da1cb36f9206 response_code = 200 uri = /v2p
20912024-11-07T22:49:21.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4723 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48824 req_id = 345e91c5-3f9e-4d47-bb31-f3cc31042b32 response_code = 200 uri = /network-bootstore-config
20922024-11-07T22:49:21.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4708 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64543 req_id = 884273c2-7bab-4b36-90cb-c3fba93abe37 response_code = 200 uri = /vpc-routes
20932024-11-07T22:49:21.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44680
20942024-11-07T22:49:21.347ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
20952024-11-07T22:49:21.352ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
20962024-11-07T22:49:21.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64543 req_id = 7aa84873-4233-4f34-9c63-4b74e219c2be response_code = 204 uri = /eip-gateways
20972024-11-07T22:49:21.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 722 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64543 req_id = 6039129e-f85d-43cb-a9f5-3681e5bcd413 response_code = 204 uri = /vpc-routes
20982024-11-07T22:49:21.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40597
20992024-11-07T22:49:21.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40597 req_id = 249e5499-5bcb-40cb-adf7-7ffed3eb766e response_code = 200 uri = /v2p
21002024-11-07T22:49:21.409ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21012024-11-07T22:49:21.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47703 req_id = dcc2541b-b4d8-411b-92fd-e2fa4a5afebf response_code = 204 uri = /switch-ports
21022024-11-07T22:49:21.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 594 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47703 req_id = e490b623-76dc-4a93-9db4-ea2216e0fc48 response_code = 200 uri = /network-bootstore-config
21032024-11-07T22:49:21.450ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21042024-11-07T22:49:21.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44680 req_id = 48cad1e4-82ef-4372-9d83-3851dedd15b1 response_code = 204 uri = /switch-ports
21052024-11-07T22:49:21.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44680 req_id = 9ecba98c-9252-4337-8c4d-e0fed53bf1e7 response_code = 200 uri = /network-bootstore-config
21062024-11-07T22:49:26.520ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54640
21072024-11-07T22:49:26.521ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54640 req_id = 15e262ad-2ad2-48d6-996d-3c848d175ebb response_code = 200 uri = /baseboard
21082024-11-07T22:49:51.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54006
21092024-11-07T22:49:51.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54006 req_id = cfed79e4-1ed6-43f7-b77e-78c821e14487 response_code = 200 uri = /v2p
21102024-11-07T22:49:51.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46299
21112024-11-07T22:49:51.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46299 req_id = 6813f8a8-ee31-4bf2-a813-6b7311ef90f3 response_code = 200 uri = /vpc-routes
21122024-11-07T22:49:51.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
21132024-11-07T22:49:51.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46299 req_id = 72fdfb7f-e98f-4629-9977-6e5d939ca087 response_code = 204 uri = /eip-gateways
21142024-11-07T22:49:51.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46299 req_id = 304bfb61-68f3-400d-a71b-4cae91abc033 response_code = 204 uri = /vpc-routes
21152024-11-07T22:49:51.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62059
21162024-11-07T22:49:51.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62059 req_id = 924825ec-eb6d-4192-9c05-749ae95ecf65 response_code = 200 uri = /vpc-routes
21172024-11-07T22:49:51.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36801
21182024-11-07T22:49:51.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36801 req_id = b32007b1-adf9-4bfd-bf9d-e10dff49df41 response_code = 200 uri = /vpc-routes
21192024-11-07T22:49:51.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50001
21202024-11-07T22:49:51.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50001 req_id = 77919e80-3414-4fa9-9043-0b6055007c6a response_code = 200 uri = /v2p
21212024-11-07T22:49:51.372ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
21222024-11-07T22:49:51.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62059 req_id = 0556c8e6-c92a-4234-8eef-3839fe4f8434 response_code = 204 uri = /eip-gateways
21232024-11-07T22:49:51.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49154
21242024-11-07T22:49:51.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21252024-11-07T22:49:51.418ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21262024-11-07T22:49:51.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103495 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49154 req_id = 17c11212-ecd2-47f3-9360-602f3989560d response_code = 204 uri = /switch-ports
21272024-11-07T22:49:51.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42704
21282024-11-07T22:49:51.478ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
21292024-11-07T22:49:51.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36801 req_id = 7f0bb95b-c149-47e5-bc05-eeb418ee728f response_code = 204 uri = /eip-gateways
21302024-11-07T22:49:51.478ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21312024-11-07T22:49:51.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 374 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62059 req_id = b765983c-01c9-4c9a-98ed-34999967fd21 response_code = 204 uri = /vpc-routes
21322024-11-07T22:49:51.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49154 req_id = 4fc11dfc-9988-48ce-9609-8fd222ef8630 response_code = 200 uri = /network-bootstore-config
21332024-11-07T22:49:51.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 762 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36801 req_id = 4507f255-70b1-4818-b292-7444c3cf7abe response_code = 204 uri = /vpc-routes
21342024-11-07T22:49:51.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41850
21352024-11-07T22:49:51.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41850 req_id = 6683979d-fb62-40a2-9ecd-df07f144b703 response_code = 200 uri = /v2p
21362024-11-07T22:49:51.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51067
21372024-11-07T22:49:51.524ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21382024-11-07T22:49:51.586ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21392024-11-07T22:49:51.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107708 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42704 req_id = 0ac742cd-ec47-47d2-b8ec-d7b26c19ffdf response_code = 204 uri = /switch-ports
21402024-11-07T22:49:51.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42704 req_id = b62b9c77-9539-4eef-9fb4-3829367520f4 response_code = 200 uri = /network-bootstore-config
21412024-11-07T22:49:51.626ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21422024-11-07T22:49:51.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171845 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51067 req_id = 74ea1add-beaa-4f6e-bc3e-1d6bc5d0daae response_code = 204 uri = /switch-ports
21432024-11-07T22:49:51.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51067 req_id = 535aa5d4-ff00-45c1-ba12-39635e59dbf6 response_code = 200 uri = /network-bootstore-config
21442024-11-07T22:49:56.554ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51957
21452024-11-07T22:49:56.554ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51957 req_id = e3c04493-b24e-44c9-a5de-8b7e8b7c4cc9 response_code = 200 uri = /baseboard
21462024-11-07T22:50:02.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21472024-11-07T22:50:02.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21482024-11-07T22:50:02.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21492024-11-07T22:50:02.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21502024-11-07T22:50:02.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21512024-11-07T22:50:02.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21522024-11-07T22:50:02.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21532024-11-07T22:50:02.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21542024-11-07T22:50:02.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21552024-11-07T22:50:12.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21562024-11-07T22:50:12.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21572024-11-07T22:50:12.045ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21582024-11-07T22:50:12.046ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21592024-11-07T22:50:12.047ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21602024-11-07T22:50:12.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21612024-11-07T22:50:12.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21622024-11-07T22:50:12.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21632024-11-07T22:50:12.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21642024-11-07T22:50:12.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21652024-11-07T22:50:12.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21662024-11-07T22:50:12.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21672024-11-07T22:50:12.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21682024-11-07T22:50:12.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21692024-11-07T22:50:12.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21702024-11-07T22:50:12.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21712024-11-07T22:50:12.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21722024-11-07T22:50:12.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21732024-11-07T22:50:21.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62297
21742024-11-07T22:50:21.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62297 req_id = 228deeff-b0fc-40bb-b1ca-67a49545bb57 response_code = 200 uri = /vpc-routes
21752024-11-07T22:50:21.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40655
21762024-11-07T22:50:21.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40655 req_id = 4023a998-f88e-4ac2-99f2-ce67314d7a07 response_code = 200 uri = /vpc-routes
21772024-11-07T22:50:21.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
21782024-11-07T22:50:21.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40655 req_id = d87e044f-2081-4c1e-bd4e-f22dc24550db response_code = 204 uri = /eip-gateways
21792024-11-07T22:50:21.113ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
21802024-11-07T22:50:21.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 20 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62297 req_id = 7be0b816-8333-4412-9d81-32a43b6e3d23 response_code = 204 uri = /eip-gateways
21812024-11-07T22:50:21.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40655 req_id = 2f433a8d-7e7c-4e35-87f9-ea70eb095360 response_code = 204 uri = /vpc-routes
21822024-11-07T22:50:21.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62297 req_id = 404649dd-759c-4408-91bb-0a643e01adf6 response_code = 204 uri = /vpc-routes
21832024-11-07T22:50:21.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42769
21842024-11-07T22:50:21.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53009
21852024-11-07T22:50:21.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21862024-11-07T22:50:21.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42769 req_id = a279275f-4dc5-4ce1-b4bf-65c274d6a9f3 response_code = 200 uri = /vpc-routes
21872024-11-07T22:50:21.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57796
21882024-11-07T22:50:21.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
21892024-11-07T22:50:21.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42769 req_id = f0c9651c-7e26-46c9-b135-dae505190676 response_code = 204 uri = /eip-gateways
21902024-11-07T22:50:21.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 932 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42769 req_id = 90bb06db-6a98-4b5b-b036-f1ebcc8e0363 response_code = 204 uri = /vpc-routes
21912024-11-07T22:50:21.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43453
21922024-11-07T22:50:21.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43453 req_id = 54c8e493-3b59-47ec-8f96-c2fc2b91296d response_code = 200 uri = /v2p
21932024-11-07T22:50:21.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
21942024-11-07T22:50:21.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39004
21952024-11-07T22:50:21.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39004 req_id = 3963ba45-7da1-4753-80b4-d76e6dbf5056 response_code = 200 uri = /v2p
21962024-11-07T22:50:21.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64348
21972024-11-07T22:50:21.269ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
21982024-11-07T22:50:21.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111216 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53009 req_id = 827766f1-cfa2-4289-b62a-9501ee5a4176 response_code = 204 uri = /switch-ports
21992024-11-07T22:50:21.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 762 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53009 req_id = fdd2241c-c652-4bab-904c-bd90f22b9489 response_code = 200 uri = /network-bootstore-config
22002024-11-07T22:50:21.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22012024-11-07T22:50:21.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64234
22022024-11-07T22:50:21.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64234 req_id = 96fa9fad-e3fd-43f8-be01-d0cfcda8285d response_code = 200 uri = /v2p
22032024-11-07T22:50:21.369ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22042024-11-07T22:50:21.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203574 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57796 req_id = bc10c43b-da83-4f65-b634-63a8549164a7 response_code = 204 uri = /switch-ports
22052024-11-07T22:50:21.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 718 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57796 req_id = 5eb95299-b5a1-4d96-b6ac-88748bbfc42f response_code = 200 uri = /network-bootstore-config
22062024-11-07T22:50:21.406ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22072024-11-07T22:50:21.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216060 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64348 req_id = 607d568d-b29c-472f-b630-ae654c21b908 response_code = 204 uri = /switch-ports
22082024-11-07T22:50:21.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64348 req_id = 7fe0b673-8350-45c4-9d95-3327421848ce response_code = 200 uri = /network-bootstore-config
22092024-11-07T22:50:22.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22102024-11-07T22:50:22.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22112024-11-07T22:50:22.047ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22122024-11-07T22:50:22.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22132024-11-07T22:50:22.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22142024-11-07T22:50:22.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22152024-11-07T22:50:22.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22162024-11-07T22:50:22.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22172024-11-07T22:50:22.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22182024-11-07T22:50:22.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22192024-11-07T22:50:22.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22202024-11-07T22:50:22.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22212024-11-07T22:50:22.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22222024-11-07T22:50:22.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22232024-11-07T22:50:22.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22242024-11-07T22:50:22.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22252024-11-07T22:50:22.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22262024-11-07T22:50:22.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22272024-11-07T22:50:26.591ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51729
22282024-11-07T22:50:26.591ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51729 req_id = 1ec2028c-7c42-45bc-8b18-ec5196ee1732 response_code = 200 uri = /baseboard
22292024-11-07T22:50:27.323ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22302024-11-07T22:50:27.323ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
22312024-11-07T22:50:27.355ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1721, tv_nsec: 444656982 } time_to_next_cleanup = 599.99999526s
22322024-11-07T22:50:32.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22332024-11-07T22:50:32.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22342024-11-07T22:50:32.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22352024-11-07T22:50:32.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22362024-11-07T22:50:32.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22372024-11-07T22:50:32.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22382024-11-07T22:50:32.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22392024-11-07T22:50:32.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22402024-11-07T22:50:32.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22412024-11-07T22:50:32.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22422024-11-07T22:50:32.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22432024-11-07T22:50:32.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22442024-11-07T22:50:32.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22452024-11-07T22:50:32.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22462024-11-07T22:50:32.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22472024-11-07T22:50:32.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22482024-11-07T22:50:32.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22492024-11-07T22:50:32.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22502024-11-07T22:50:41.773ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22512024-11-07T22:50:42.008ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22522024-11-07T22:50:42.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22532024-11-07T22:50:42.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22542024-11-07T22:50:42.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22552024-11-07T22:50:42.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22562024-11-07T22:50:42.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22572024-11-07T22:50:42.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22582024-11-07T22:50:42.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22592024-11-07T22:50:42.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22602024-11-07T22:50:42.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22612024-11-07T22:50:42.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22622024-11-07T22:50:42.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22632024-11-07T22:50:42.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22642024-11-07T22:50:42.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22652024-11-07T22:50:42.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22662024-11-07T22:50:42.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22672024-11-07T22:50:42.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22682024-11-07T22:50:42.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22692024-11-07T22:50:51.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49212
22702024-11-07T22:50:51.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49212 req_id = 08650bc6-9519-4527-aa4c-381b3d1f555d response_code = 200 uri = /vpc-routes
22712024-11-07T22:50:51.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
22722024-11-07T22:50:51.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49212 req_id = f840942c-ca4d-4f8f-a6b0-0c13d21923fb response_code = 204 uri = /eip-gateways
22732024-11-07T22:50:51.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42330
22742024-11-07T22:50:51.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42330 req_id = a187bde2-b1a2-4c6d-92ba-c26b13a73637 response_code = 200 uri = /v2p
22752024-11-07T22:50:51.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49212 req_id = d090a6cc-4f5e-4880-b930-5c7b265b0c34 response_code = 204 uri = /vpc-routes
22762024-11-07T22:50:51.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46807
22772024-11-07T22:50:51.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46807 req_id = 4f6d6a4c-7ae3-4353-ad96-f2b8d30c6c68 response_code = 200 uri = /vpc-routes
22782024-11-07T22:50:51.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50752
22792024-11-07T22:50:51.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50752 req_id = a73d7674-5b1e-49e4-b0d2-64168dc63260 response_code = 200 uri = /vpc-routes
22802024-11-07T22:50:51.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
22812024-11-07T22:50:51.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46807 req_id = 3768087c-10bd-4005-8b55-cc7260a5013b response_code = 204 uri = /eip-gateways
22822024-11-07T22:50:51.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46399
22832024-11-07T22:50:51.428ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22842024-11-07T22:50:51.473ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22852024-11-07T22:50:51.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105713 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46399 req_id = e15d4d25-3f49-41d5-a0a4-0d38aa6e5001 response_code = 204 uri = /switch-ports
22862024-11-07T22:50:51.534ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
22872024-11-07T22:50:51.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50752 req_id = f9651b1a-3994-4346-b626-34cac8c281b9 response_code = 204 uri = /eip-gateways
22882024-11-07T22:50:51.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59222
22892024-11-07T22:50:51.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39589
22902024-11-07T22:50:51.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40933
22912024-11-07T22:50:51.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46399 req_id = 5fd119a3-c9ed-4573-9676-a30e53e8862d response_code = 200 uri = /network-bootstore-config
22922024-11-07T22:50:51.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 490 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46807 req_id = db5e2de7-7fb6-4cf8-affb-b27eddddfe66 response_code = 204 uri = /vpc-routes
22932024-11-07T22:50:51.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59222 req_id = 34e1cf29-747b-4827-8d8a-496ee978465d response_code = 200 uri = /v2p
22942024-11-07T22:50:51.535ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
22952024-11-07T22:50:51.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39589 req_id = 40e16d34-9e56-473a-b9e8-e5fedef94fdd response_code = 200 uri = /v2p
22962024-11-07T22:50:51.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50752 req_id = 35356407-7956-48ba-8e4e-a0eb0fcd0487 response_code = 204 uri = /vpc-routes
22972024-11-07T22:50:51.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34595
22982024-11-07T22:50:51.578ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
22992024-11-07T22:50:51.634ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23002024-11-07T22:50:51.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99599 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40933 req_id = e1d9edec-2ff3-4b05-8250-c57b0e9c637e response_code = 204 uri = /switch-ports
23012024-11-07T22:50:51.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 677 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40933 req_id = 1b1cc070-2a02-4fd0-9362-d809dfca4796 response_code = 200 uri = /network-bootstore-config
23022024-11-07T22:50:51.666ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23032024-11-07T22:50:51.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150549 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34595 req_id = d7114efa-5d0a-4c4f-9dfd-ed28a5bd4f1b response_code = 204 uri = /switch-ports
23042024-11-07T22:50:51.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34595 req_id = 27312eed-745b-4823-9308-db161146825d response_code = 200 uri = /network-bootstore-config
23052024-11-07T22:50:52.011ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23062024-11-07T22:50:52.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23072024-11-07T22:50:52.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23082024-11-07T22:50:52.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23092024-11-07T22:50:52.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23102024-11-07T22:50:52.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23112024-11-07T22:50:52.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23122024-11-07T22:50:52.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23132024-11-07T22:50:52.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23142024-11-07T22:50:52.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23152024-11-07T22:50:52.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23162024-11-07T22:50:52.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23172024-11-07T22:50:52.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23182024-11-07T22:50:52.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23192024-11-07T22:50:52.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23202024-11-07T22:50:52.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23212024-11-07T22:50:52.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23222024-11-07T22:50:52.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23232024-11-07T22:50:56.626ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54728
23242024-11-07T22:50:56.626ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54728 req_id = 2b4f6aaa-bc4c-4d8e-bd11-57898be88796 response_code = 200 uri = /baseboard
23252024-11-07T22:51:02.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23262024-11-07T22:51:02.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23272024-11-07T22:51:02.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23282024-11-07T22:51:02.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23292024-11-07T22:51:02.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23302024-11-07T22:51:02.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23312024-11-07T22:51:02.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23322024-11-07T22:51:02.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23332024-11-07T22:51:02.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23342024-11-07T22:51:02.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23352024-11-07T22:51:02.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23362024-11-07T22:51:02.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23372024-11-07T22:51:02.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23382024-11-07T22:51:02.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23392024-11-07T22:51:02.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23402024-11-07T22:51:02.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23412024-11-07T22:51:02.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23422024-11-07T22:51:02.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23432024-11-07T22:51:12.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23442024-11-07T22:51:12.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23452024-11-07T22:51:12.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23462024-11-07T22:51:12.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23472024-11-07T22:51:12.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23482024-11-07T22:51:12.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23492024-11-07T22:51:12.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23502024-11-07T22:51:12.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23512024-11-07T22:51:12.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23522024-11-07T22:51:12.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23532024-11-07T22:51:12.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23542024-11-07T22:51:12.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23552024-11-07T22:51:12.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23562024-11-07T22:51:12.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23572024-11-07T22:51:12.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23582024-11-07T22:51:12.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23592024-11-07T22:51:12.078ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23602024-11-07T22:51:12.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23612024-11-07T22:51:21.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51935
23622024-11-07T22:51:21.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51935 req_id = 7ab282ce-56b4-439f-92d7-b23d47c475b4 response_code = 200 uri = /vpc-routes
23632024-11-07T22:51:21.118ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
23642024-11-07T22:51:21.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51935 req_id = b9187a4e-fd30-47ed-9ca8-153b5d33aa46 response_code = 204 uri = /eip-gateways
23652024-11-07T22:51:21.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59943
23662024-11-07T22:51:21.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59943 req_id = 7d9edbc0-a9f5-4b0d-8d32-cdb6c7179e35 response_code = 200 uri = /vpc-routes
23672024-11-07T22:51:21.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51935 req_id = 920db1fe-6a70-455e-8863-ae9bfd102911 response_code = 204 uri = /vpc-routes
23682024-11-07T22:51:21.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
23692024-11-07T22:51:21.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59943 req_id = 7883dd72-41ae-44ca-aef5-a0db1d966a9f response_code = 204 uri = /eip-gateways
23702024-11-07T22:51:21.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59943 req_id = cbbfee0a-54a2-4bc1-8d0e-1ba7a739f0ac response_code = 204 uri = /vpc-routes
23712024-11-07T22:51:21.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43666
23722024-11-07T22:51:21.177ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23732024-11-07T22:51:21.220ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23742024-11-07T22:51:21.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109285 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43666 req_id = fc17e24b-5f81-4822-b963-098ba1232cd9 response_code = 204 uri = /switch-ports
23752024-11-07T22:51:21.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55783
23762024-11-07T22:51:21.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39937
23772024-11-07T22:51:21.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39760
23782024-11-07T22:51:21.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48109
23792024-11-07T22:51:21.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54651
23802024-11-07T22:51:21.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39937 req_id = 5379836c-a9ea-48d2-9a70-86a367b7320f response_code = 200 uri = /vpc-routes
23812024-11-07T22:51:21.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48109 req_id = d9c7ae27-1716-45a1-a6ff-4cc1db5e2add response_code = 200 uri = /v2p
23822024-11-07T22:51:21.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39760 req_id = 3211619d-8d61-4081-95bc-6b8fe3f4b812 response_code = 200 uri = /v2p
23832024-11-07T22:51:21.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43666 req_id = d671abcf-577f-4181-b81a-bfbcce402763 response_code = 200 uri = /network-bootstore-config
23842024-11-07T22:51:21.288ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23852024-11-07T22:51:21.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55783 req_id = 00b68a06-52a2-4c0d-804a-e0624ea22c59 response_code = 200 uri = /v2p
23862024-11-07T22:51:21.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44469
23872024-11-07T22:51:21.329ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
23882024-11-07T22:51:21.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39937 req_id = 98c96125-2844-42c5-b789-385113f1abcc response_code = 204 uri = /eip-gateways
23892024-11-07T22:51:21.331ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23902024-11-07T22:51:21.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39937 req_id = ecc6dd0a-5a5c-4613-96f6-498d9a857303 response_code = 204 uri = /vpc-routes
23912024-11-07T22:51:21.391ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
23922024-11-07T22:51:21.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103505 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54651 req_id = ea3d5f4f-607d-4cfb-a23a-b2c1087d2096 response_code = 204 uri = /switch-ports
23932024-11-07T22:51:21.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 756 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54651 req_id = 6af208a8-9546-4680-a352-1d6bd53efb14 response_code = 200 uri = /network-bootstore-config
23942024-11-07T22:51:21.429ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
23952024-11-07T22:51:21.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193921 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44469 req_id = a5985140-dafa-4236-a88c-e9ca9a376834 response_code = 204 uri = /switch-ports
23962024-11-07T22:51:21.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44469 req_id = 5dfce68a-f843-4143-bc59-3b8fff83da67 response_code = 200 uri = /network-bootstore-config
23972024-11-07T22:51:22.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23982024-11-07T22:51:22.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23992024-11-07T22:51:22.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24002024-11-07T22:51:22.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24012024-11-07T22:51:22.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24022024-11-07T22:51:22.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24032024-11-07T22:51:22.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24042024-11-07T22:51:22.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24052024-11-07T22:51:22.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24062024-11-07T22:51:22.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24072024-11-07T22:51:22.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24082024-11-07T22:51:22.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24092024-11-07T22:51:22.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24102024-11-07T22:51:22.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24112024-11-07T22:51:22.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24122024-11-07T22:51:22.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24132024-11-07T22:51:22.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24142024-11-07T22:51:22.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24152024-11-07T22:51:26.660ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54389
24162024-11-07T22:51:26.660ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54389 req_id = 59b6ba44-c4c5-4feb-9012-48e0aad8185b response_code = 200 uri = /baseboard
24172024-11-07T22:51:32.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24182024-11-07T22:51:32.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24192024-11-07T22:51:32.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24202024-11-07T22:51:32.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24212024-11-07T22:51:32.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24222024-11-07T22:51:32.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24232024-11-07T22:51:32.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24242024-11-07T22:51:32.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24252024-11-07T22:51:32.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24262024-11-07T22:51:32.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24272024-11-07T22:51:32.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24282024-11-07T22:51:32.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24292024-11-07T22:51:32.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24302024-11-07T22:51:32.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24312024-11-07T22:51:32.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24322024-11-07T22:51:32.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24332024-11-07T22:51:32.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24342024-11-07T22:51:32.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24352024-11-07T22:51:42.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24362024-11-07T22:51:42.026ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24372024-11-07T22:51:42.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24382024-11-07T22:51:42.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24392024-11-07T22:51:42.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24402024-11-07T22:51:42.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24412024-11-07T22:51:42.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24422024-11-07T22:51:42.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24432024-11-07T22:51:42.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24442024-11-07T22:51:42.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24452024-11-07T22:51:42.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24462024-11-07T22:51:42.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24472024-11-07T22:51:42.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24482024-11-07T22:51:42.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24492024-11-07T22:51:42.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24502024-11-07T22:51:42.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24512024-11-07T22:51:42.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24522024-11-07T22:51:42.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24532024-11-07T22:51:51.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41307
24542024-11-07T22:51:51.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41307 req_id = d1a87e31-005a-4f5a-97d8-389d2d9746eb response_code = 200 uri = /vpc-routes
24552024-11-07T22:51:51.191ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
24562024-11-07T22:51:51.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41307 req_id = 024f78b2-d5d8-4a48-b618-927df01fe1a6 response_code = 204 uri = /eip-gateways
24572024-11-07T22:51:51.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41307 req_id = 1d2b2a36-ab4a-4daa-9399-a76b185561b9 response_code = 204 uri = /vpc-routes
24582024-11-07T22:51:51.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34995
24592024-11-07T22:51:51.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34995 req_id = da23bcc6-5b4e-4a85-b28c-d5713302a37d response_code = 200 uri = /vpc-routes
24602024-11-07T22:51:51.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45760
24612024-11-07T22:51:51.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45760 req_id = 7739ea34-b036-4c64-826a-e1394353484d response_code = 200 uri = /vpc-routes
24622024-11-07T22:51:51.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46752
24632024-11-07T22:51:51.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46752 req_id = 3a13edf4-f7bc-42f7-acee-9fb59b05608d response_code = 200 uri = /v2p
24642024-11-07T22:51:51.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
24652024-11-07T22:51:51.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34995 req_id = 7638be03-a5e1-407c-a4ad-48a3cc5c24af response_code = 204 uri = /eip-gateways
24662024-11-07T22:51:51.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34995 req_id = cb1ed001-1076-45bd-929f-9b989588d429 response_code = 204 uri = /vpc-routes
24672024-11-07T22:51:51.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
24682024-11-07T22:51:51.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45760 req_id = eb481979-eb84-4d45-a109-5e2a5d6d1e35 response_code = 204 uri = /eip-gateways
24692024-11-07T22:51:51.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52025
24702024-11-07T22:51:51.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52025 req_id = 4c0e9240-f718-43f5-a4fd-86e6b8766f76 response_code = 200 uri = /v2p
24712024-11-07T22:51:51.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46224
24722024-11-07T22:51:51.354ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24732024-11-07T22:51:51.397ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24742024-11-07T22:51:51.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105573 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46224 req_id = e3bf3f1b-fe90-4687-b811-9bf92ab4a83f response_code = 204 uri = /switch-ports
24752024-11-07T22:51:51.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38343
24762024-11-07T22:51:51.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46224 req_id = 9a994943-fb23-4fca-980c-d8fba5174793 response_code = 200 uri = /network-bootstore-config
24772024-11-07T22:51:51.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38343 req_id = 3c7445bd-dbf5-4260-bd1b-b51db73f9163 response_code = 200 uri = /v2p
24782024-11-07T22:51:51.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45760 req_id = a488e586-be8b-48e9-b39f-3a8b814dd563 response_code = 204 uri = /vpc-routes
24792024-11-07T22:51:51.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49101
24802024-11-07T22:51:51.504ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24812024-11-07T22:51:51.545ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24822024-11-07T22:51:51.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49101 req_id = 2d3ed8b7-3749-48a0-b174-c067a132ffd0 response_code = 204 uri = /switch-ports
24832024-11-07T22:51:51.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48366
24842024-11-07T22:51:51.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49101 req_id = 564a348d-6a3a-4bcb-8cf5-1136a8c2e0d4 response_code = 200 uri = /network-bootstore-config
24852024-11-07T22:51:51.608ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
24862024-11-07T22:51:51.651ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
24872024-11-07T22:51:51.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96588 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48366 req_id = 739be09a-aa53-4525-a760-a863c1106481 response_code = 204 uri = /switch-ports
24882024-11-07T22:51:51.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48366 req_id = 129065ef-8bb2-4e69-976b-efdc1ec478e4 response_code = 200 uri = /network-bootstore-config
24892024-11-07T22:51:52.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24902024-11-07T22:51:52.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24912024-11-07T22:51:52.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24922024-11-07T22:51:52.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24932024-11-07T22:51:52.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24942024-11-07T22:51:52.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24952024-11-07T22:51:52.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24962024-11-07T22:51:52.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24972024-11-07T22:51:52.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24982024-11-07T22:51:52.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
24992024-11-07T22:51:52.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25002024-11-07T22:51:52.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25012024-11-07T22:51:52.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25022024-11-07T22:51:52.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25032024-11-07T22:51:52.078ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25042024-11-07T22:51:52.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25052024-11-07T22:51:52.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25062024-11-07T22:51:52.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25072024-11-07T22:51:56.696ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52003
25082024-11-07T22:51:56.696ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52003 req_id = b2458534-f78d-41db-ac88-b696e08efb97 response_code = 200 uri = /baseboard
25092024-11-07T22:52:02.030ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25102024-11-07T22:52:02.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25112024-11-07T22:52:02.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25122024-11-07T22:52:02.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25132024-11-07T22:52:02.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25142024-11-07T22:52:02.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25152024-11-07T22:52:02.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25162024-11-07T22:52:02.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25172024-11-07T22:52:02.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25182024-11-07T22:52:02.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25192024-11-07T22:52:02.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25202024-11-07T22:52:02.078ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25212024-11-07T22:52:02.078ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25222024-11-07T22:52:02.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25232024-11-07T22:52:02.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25242024-11-07T22:52:02.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25252024-11-07T22:52:02.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25262024-11-07T22:52:02.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25272024-11-07T22:52:12.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25282024-11-07T22:52:12.033ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25292024-11-07T22:52:12.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25302024-11-07T22:52:12.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25312024-11-07T22:52:12.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25322024-11-07T22:52:12.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25332024-11-07T22:52:12.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25342024-11-07T22:52:12.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25352024-11-07T22:52:12.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25362024-11-07T22:52:12.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25372024-11-07T22:52:12.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25382024-11-07T22:52:12.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25392024-11-07T22:52:12.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25402024-11-07T22:52:12.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25412024-11-07T22:52:12.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25422024-11-07T22:52:12.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25432024-11-07T22:52:12.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25442024-11-07T22:52:12.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25452024-11-07T22:52:21.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53776
25462024-11-07T22:52:21.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53776 req_id = d9d28274-9808-4b0d-879a-4511bc78bb85 response_code = 200 uri = /vpc-routes
25472024-11-07T22:52:21.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64779
25482024-11-07T22:52:21.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64779 req_id = 3eddc8ab-43eb-4515-8d9e-756557991f22 response_code = 200 uri = /vpc-routes
25492024-11-07T22:52:21.074ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
25502024-11-07T22:52:21.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53776 req_id = 6b751d3b-4821-4890-8b79-daf53c6023c2 response_code = 204 uri = /eip-gateways
25512024-11-07T22:52:21.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53776 req_id = 020f8ce4-395a-42b0-9e20-bb8b705dd0f6 response_code = 204 uri = /vpc-routes
25522024-11-07T22:52:21.088ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
25532024-11-07T22:52:21.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64779 req_id = 1f76dcf7-9d34-4ad4-9c8d-4238a97249c5 response_code = 204 uri = /eip-gateways
25542024-11-07T22:52:21.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64779 req_id = 4c343e88-122f-402d-af97-0e562d7fad93 response_code = 204 uri = /vpc-routes
25552024-11-07T22:52:21.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52825
25562024-11-07T22:52:21.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52825 req_id = 692cda2d-84fa-46eb-bf84-900b56e0bd29 response_code = 200 uri = /v2p
25572024-11-07T22:52:21.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44142
25582024-11-07T22:52:21.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25592024-11-07T22:52:21.189ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25602024-11-07T22:52:21.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117993 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44142 req_id = 7df6d093-d124-4b50-8eae-55cf716d2b85 response_code = 204 uri = /switch-ports
25612024-11-07T22:52:21.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55778
25622024-11-07T22:52:21.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46451
25632024-11-07T22:52:21.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52481
25642024-11-07T22:52:21.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43419
25652024-11-07T22:52:21.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44142 req_id = e14a5a0e-de5c-4b97-b906-3704122e127c response_code = 200 uri = /network-bootstore-config
25662024-11-07T22:52:21.263ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25672024-11-07T22:52:21.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46451 req_id = 5c6bfa40-1db1-4737-98eb-88a43a426400 response_code = 200 uri = /vpc-routes
25682024-11-07T22:52:21.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55778 req_id = a2bfa76d-8c5e-4e1f-aef6-e9217859e56a response_code = 200 uri = /v2p
25692024-11-07T22:52:21.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59331
25702024-11-07T22:52:21.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59331 req_id = bc65dccd-8f1a-4489-b3a2-8eb7b39860ad response_code = 200 uri = /v2p
25712024-11-07T22:52:21.305ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
25722024-11-07T22:52:21.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46451 req_id = ff3e64ce-96d9-4d42-ba3b-e66df5d2847f response_code = 204 uri = /eip-gateways
25732024-11-07T22:52:21.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25742024-11-07T22:52:21.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46451 req_id = 0be29b56-e6d8-43b4-b964-f7b01ea0a34c response_code = 204 uri = /vpc-routes
25752024-11-07T22:52:21.370ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
25762024-11-07T22:52:21.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106629 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43419 req_id = ab51b2da-337c-4ccf-b70b-991be2f1d00f response_code = 204 uri = /switch-ports
25772024-11-07T22:52:21.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 707 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43419 req_id = a6f3205e-fd61-43d5-8913-80f5118c2367 response_code = 200 uri = /network-bootstore-config
25782024-11-07T22:52:21.408ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
25792024-11-07T22:52:21.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203993 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52481 req_id = 1f1fae41-9a11-4825-9407-093f4e7b526e response_code = 204 uri = /switch-ports
25802024-11-07T22:52:21.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52481 req_id = 0291266c-650f-414d-b484-ce2730f4a73f response_code = 200 uri = /network-bootstore-config
25812024-11-07T22:52:22.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25822024-11-07T22:52:22.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25832024-11-07T22:52:22.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25842024-11-07T22:52:22.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25852024-11-07T22:52:22.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25862024-11-07T22:52:22.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25872024-11-07T22:52:22.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25882024-11-07T22:52:22.078ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25892024-11-07T22:52:22.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25902024-11-07T22:52:22.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25912024-11-07T22:52:22.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25922024-11-07T22:52:22.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25932024-11-07T22:52:22.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25942024-11-07T22:52:22.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25952024-11-07T22:52:22.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25962024-11-07T22:52:22.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25972024-11-07T22:52:22.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25982024-11-07T22:52:22.092ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
25992024-11-07T22:52:26.729ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36233
26002024-11-07T22:52:26.729ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36233 req_id = 6d6958b2-3aa5-4eaa-9e95-ff680cc683ef response_code = 200 uri = /baseboard
26012024-11-07T22:52:32.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26022024-11-07T22:52:32.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26032024-11-07T22:52:32.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26042024-11-07T22:52:32.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26052024-11-07T22:52:32.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26062024-11-07T22:52:32.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26072024-11-07T22:52:32.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26082024-11-07T22:52:32.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26092024-11-07T22:52:32.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26102024-11-07T22:52:32.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26112024-11-07T22:52:32.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26122024-11-07T22:52:32.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26132024-11-07T22:52:32.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26142024-11-07T22:52:32.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26152024-11-07T22:52:32.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26162024-11-07T22:52:32.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26172024-11-07T22:52:32.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26182024-11-07T22:52:32.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26192024-11-07T22:52:42.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26202024-11-07T22:52:42.041ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26212024-11-07T22:52:42.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26222024-11-07T22:52:42.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26232024-11-07T22:52:42.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26242024-11-07T22:52:42.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26252024-11-07T22:52:42.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26262024-11-07T22:52:42.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26272024-11-07T22:52:42.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26282024-11-07T22:52:42.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26292024-11-07T22:52:42.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26302024-11-07T22:52:42.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26312024-11-07T22:52:42.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26322024-11-07T22:52:42.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26332024-11-07T22:52:42.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26342024-11-07T22:52:42.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26352024-11-07T22:52:42.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26362024-11-07T22:52:42.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
26372024-11-07T22:52:51.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65463
26382024-11-07T22:52:51.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65463 req_id = f6521c71-71a0-490a-bf2a-98ec9d2aa784 response_code = 200 uri = /vpc-routes
26392024-11-07T22:52:51.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
26402024-11-07T22:52:51.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65463 req_id = 5e7489db-a5ce-4970-ab35-cc270d698906 response_code = 204 uri = /eip-gateways
26412024-11-07T22:52:51.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65463 req_id = 9ba10cdd-f374-49a9-b172-758a7436bb18 response_code = 204 uri = /vpc-routes
26422024-11-07T22:52:51.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56714
26432024-11-07T22:52:51.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56714 req_id = 2d02255f-8370-4ecb-a180-d703e6ff1157 response_code = 200 uri = /vpc-routes
26442024-11-07T22:52:51.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37137
26452024-11-07T22:52:51.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37137 req_id = 25150d2e-de97-4697-9a1c-ac3905d0e7a8 response_code = 200 uri = /vpc-routes
26462024-11-07T22:52:51.434ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
26472024-11-07T22:52:51.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56714 req_id = a224107d-825f-41bf-9bdc-08accebd0ae1 response_code = 204 uri = /eip-gateways
26482024-11-07T22:52:51.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57217
26492024-11-07T22:52:51.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57217 req_id = 70ebd8b2-7fc9-417c-a506-506ded5b7847 response_code = 200 uri = /v2p
26502024-11-07T22:52:51.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38334
26512024-11-07T22:52:51.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38334 req_id = 0b650808-b72e-418d-9828-2c483cd86ec1 response_code = 200 uri = /v2p
26522024-11-07T22:52:51.498ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
26532024-11-07T22:52:51.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37137 req_id = 1126ea3f-978e-4134-a15e-7168d94490b3 response_code = 204 uri = /eip-gateways
26542024-11-07T22:52:51.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37137 req_id = 15328bad-03de-4cf0-8763-00f166b64606 response_code = 204 uri = /vpc-routes
26552024-11-07T22:52:51.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42853
26562024-11-07T22:52:51.511ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
26572024-11-07T22:52:51.511ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
26582024-11-07T22:52:51.511ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:177
26592024-11-07T22:52:51.511ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:177
26602024-11-07T22:52:51.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 881 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56714 req_id = fae457bf-e439-4321-bc07-f55cf298d8ee response_code = 204 uri = /vpc-routes
26612024-11-07T22:52:51.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43405
26622024-11-07T22:52:51.525ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26632024-11-07T22:52:51.578ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26642024-11-07T22:52:51.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43405 req_id = 669990a8-6e05-48d9-b896-37b86487dd14 response_code = 204 uri = /switch-ports
26652024-11-07T22:52:51.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47883
26662024-11-07T22:52:51.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34369
26672024-11-07T22:52:51.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47660
26682024-11-07T22:52:51.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 379 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43405 req_id = a522a21d-76ce-4c64-91fb-a1500aed6738 response_code = 200 uri = /network-bootstore-config
26692024-11-07T22:52:51.658ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
26702024-11-07T22:52:51.658ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
26712024-11-07T22:52:51.658ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:177
26722024-11-07T22:52:51.658ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
26732024-11-07T22:52:51.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 395 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47660 req_id = 04061911-58ee-4db7-9f75-a2716011129d response_code = 200 uri = /v2p
26742024-11-07T22:52:51.658ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:177
26752024-11-07T22:52:51.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65379
26762024-11-07T22:52:51.684ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
26772024-11-07T22:52:51.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45697
26782024-11-07T22:52:51.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47853
26792024-11-07T22:52:51.687ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26802024-11-07T22:52:51.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26812024-11-07T22:52:51.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26822024-11-07T22:52:51.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26832024-11-07T22:52:51.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26842024-11-07T22:52:51.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26852024-11-07T22:52:51.687ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26862024-11-07T22:52:51.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47853 req_id = e12b281c-1e5b-44a8-9fd5-d1b665f5f621 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26872024-11-07T22:52:51.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52556
26882024-11-07T22:52:51.711ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
26892024-11-07T22:52:51.722ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26902024-11-07T22:52:51.722ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26912024-11-07T22:52:51.723ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26922024-11-07T22:52:51.723ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26932024-11-07T22:52:51.723ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26942024-11-07T22:52:51.723ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26952024-11-07T22:52:51.723ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26962024-11-07T22:52:51.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6072 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52556 req_id = 3f25108a-4f36-4bd8-adce-5ac0f4228160 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26972024-11-07T22:52:51.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62335
26982024-11-07T22:52:51.752ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26992024-11-07T22:52:51.752ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27002024-11-07T22:52:51.752ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27012024-11-07T22:52:51.752ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27022024-11-07T22:52:51.752ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27032024-11-07T22:52:51.752ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27042024-11-07T22:52:51.752ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27052024-11-07T22:52:51.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4543 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62335 req_id = a414e755-2df8-4c82-b815-68739eac9e18 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27062024-11-07T22:52:51.786ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27072024-11-07T22:52:51.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128577 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34369 req_id = 791ae822-4faa-4bed-aeab-9c41d51c11b7 response_code = 204 uri = /switch-ports
27082024-11-07T22:52:51.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34369 req_id = def70562-f492-41e7-9056-b395fe4bfd56 response_code = 200 uri = /network-bootstore-config
27092024-11-07T22:52:51.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 302574 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42853 req_id = ae2ff988-2d74-4638-940e-6735c2e34389 response_code = 200 uri = /inventory
27102024-11-07T22:52:51.829ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27112024-11-07T22:52:51.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 210633 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45697 req_id = c851a20c-2cf0-4c78-91ea-90756debbc36 response_code = 204 uri = /switch-ports
27122024-11-07T22:52:51.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45697 req_id = bfe058b0-f3a2-42cc-8ab7-585f2dd4dec2 response_code = 200 uri = /network-bootstore-config
27132024-11-07T22:52:51.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 293689 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47883 req_id = 546d4cda-99f0-48d4-9d7b-92b6a4d62c9c response_code = 200 uri = /inventory
27142024-11-07T22:52:51.951ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27152024-11-07T22:52:51.951ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/config/omicron-zones.json file = common/src/ledger.rs:177
27162024-11-07T22:52:51.956ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/config/omicron-zones.json file = common/src/ledger.rs:177
27172024-11-07T22:52:52.047ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27182024-11-07T22:52:52.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27192024-11-07T22:52:52.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27202024-11-07T22:52:52.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27212024-11-07T22:52:52.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27222024-11-07T22:52:52.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27232024-11-07T22:52:52.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27242024-11-07T22:52:52.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27252024-11-07T22:52:52.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27262024-11-07T22:52:52.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27272024-11-07T22:52:52.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27282024-11-07T22:52:52.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27292024-11-07T22:52:52.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27302024-11-07T22:52:52.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27312024-11-07T22:52:52.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27322024-11-07T22:52:52.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27332024-11-07T22:52:52.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27342024-11-07T22:52:52.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27352024-11-07T22:52:52.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 527802 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65379 req_id = 6b8165ab-c4aa-4d1e-b9b6-be30040eb529 response_code = 200 uri = /inventory
27362024-11-07T22:52:56.761ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56592
27372024-11-07T22:52:56.762ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56592 req_id = b9933312-b5a4-483b-91f8-0a6467600e37 response_code = 200 uri = /baseboard
27382024-11-07T22:53:02.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27392024-11-07T22:53:02.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27402024-11-07T22:53:02.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27412024-11-07T22:53:02.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27422024-11-07T22:53:02.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27432024-11-07T22:53:02.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27442024-11-07T22:53:02.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27452024-11-07T22:53:02.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27462024-11-07T22:53:02.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27472024-11-07T22:53:02.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27482024-11-07T22:53:02.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27492024-11-07T22:53:02.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27502024-11-07T22:53:02.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27512024-11-07T22:53:02.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27522024-11-07T22:53:02.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27532024-11-07T22:53:02.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27542024-11-07T22:53:02.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27552024-11-07T22:53:02.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27562024-11-07T22:53:12.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27572024-11-07T22:53:12.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27582024-11-07T22:53:12.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27592024-11-07T22:53:12.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27602024-11-07T22:53:12.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27612024-11-07T22:53:12.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27622024-11-07T22:53:12.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27632024-11-07T22:53:12.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27642024-11-07T22:53:12.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27652024-11-07T22:53:12.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27662024-11-07T22:53:12.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27672024-11-07T22:53:12.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27682024-11-07T22:53:12.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27692024-11-07T22:53:12.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27702024-11-07T22:53:12.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27712024-11-07T22:53:12.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27722024-11-07T22:53:12.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27732024-11-07T22:53:12.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
27742024-11-07T22:53:21.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57932
27752024-11-07T22:53:21.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57932 req_id = cc19a20b-d2fa-488d-aeab-7759bb03ea36 response_code = 200 uri = /vpc-routes
27762024-11-07T22:53:21.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50155
27772024-11-07T22:53:21.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50155 req_id = 6ba7b1aa-0315-4d1d-8d96-8ce36143c5b5 response_code = 200 uri = /vpc-routes
27782024-11-07T22:53:21.108ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
27792024-11-07T22:53:21.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50155 req_id = 7126eac1-75af-4c50-8398-35659c538ecd response_code = 204 uri = /eip-gateways
27802024-11-07T22:53:21.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50155 req_id = f20341c0-6ab6-4732-940e-28212065712f response_code = 204 uri = /vpc-routes
27812024-11-07T22:53:21.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61402
27822024-11-07T22:53:21.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61402 req_id = cbf67917-ad4e-43c6-9db0-8113922bfe57 response_code = 200 uri = /v2p
27832024-11-07T22:53:21.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51883
27842024-11-07T22:53:21.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51883 req_id = a886815f-1217-4794-9a6c-a7a2aef5f90d response_code = 200 uri = /vpc-routes
27852024-11-07T22:53:21.133ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
27862024-11-07T22:53:21.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57932 req_id = 762127d0-6bc8-473f-8a78-f3b1185d4246 response_code = 204 uri = /eip-gateways
27872024-11-07T22:53:21.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57932 req_id = b7d45497-d50d-4e85-91df-f6dcb4a114fc response_code = 204 uri = /vpc-routes
27882024-11-07T22:53:21.144ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
27892024-11-07T22:53:21.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51883 req_id = be8d12ad-7b87-4013-80af-aab3f5558620 response_code = 204 uri = /eip-gateways
27902024-11-07T22:53:21.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51883 req_id = 8988d7d6-cc91-4c50-a5ca-296a6505eead response_code = 204 uri = /vpc-routes
27912024-11-07T22:53:21.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58907
27922024-11-07T22:53:21.188ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
27932024-11-07T22:53:21.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
27942024-11-07T22:53:21.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111657 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58907 req_id = d99a748a-8c0d-488a-b860-a857929717fe response_code = 204 uri = /switch-ports
27952024-11-07T22:53:21.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40381
27962024-11-07T22:53:21.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47202
27972024-11-07T22:53:21.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44840
27982024-11-07T22:53:21.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46655
27992024-11-07T22:53:21.300ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
28002024-11-07T22:53:21.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58907 req_id = a3532bc5-bb18-4075-bfb7-f7f90cba2c8a response_code = 200 uri = /network-bootstore-config
28012024-11-07T22:53:21.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4510 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44840 req_id = 0f08e506-9fc3-4024-b799-8ba99dd4ab26 response_code = 200 uri = /v2p
28022024-11-07T22:53:21.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40381 req_id = 67b8dbbc-86bb-4947-b1b0-025d4c91c0d8 response_code = 200 uri = /v2p
28032024-11-07T22:53:21.341ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
28042024-11-07T22:53:21.405ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
28052024-11-07T22:53:21.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104706 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46655 req_id = 692f1b63-16ea-446d-b8ba-23ddd0ad6c11 response_code = 204 uri = /switch-ports
28062024-11-07T22:53:21.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 583 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46655 req_id = b733431f-0f80-4e80-8b17-df1ff6382539 response_code = 200 uri = /network-bootstore-config
28072024-11-07T22:53:21.443ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
28082024-11-07T22:53:21.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203320 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47202 req_id = 282eec82-1703-49ba-8d45-5d840911a186 response_code = 204 uri = /switch-ports
28092024-11-07T22:53:21.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47202 req_id = 9c9f2064-6efa-42c0-9752-324e379a86ea response_code = 200 uri = /network-bootstore-config
28102024-11-07T22:53:22.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28112024-11-07T22:53:22.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28122024-11-07T22:53:22.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28132024-11-07T22:53:22.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28142024-11-07T22:53:22.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28152024-11-07T22:53:22.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28162024-11-07T22:53:22.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28172024-11-07T22:53:22.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28182024-11-07T22:53:22.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28192024-11-07T22:53:22.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28202024-11-07T22:53:22.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28212024-11-07T22:53:22.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28222024-11-07T22:53:22.092ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28232024-11-07T22:53:22.092ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28242024-11-07T22:53:22.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28252024-11-07T22:53:22.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28262024-11-07T22:53:22.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28272024-11-07T22:53:22.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28282024-11-07T22:53:26.795ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58265
28292024-11-07T22:53:26.796ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58265 req_id = d6177a46-e70d-4215-ac76-f6caaea8aee8 response_code = 200 uri = /baseboard
28302024-11-07T22:53:32.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28312024-11-07T22:53:32.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28322024-11-07T22:53:32.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28332024-11-07T22:53:32.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28342024-11-07T22:53:32.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28352024-11-07T22:53:32.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28362024-11-07T22:53:32.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28372024-11-07T22:53:32.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28382024-11-07T22:53:32.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28392024-11-07T22:53:32.092ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28402024-11-07T22:53:32.092ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28412024-11-07T22:53:32.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28422024-11-07T22:53:32.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28432024-11-07T22:53:32.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28442024-11-07T22:53:32.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28452024-11-07T22:53:32.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28462024-11-07T22:53:32.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28472024-11-07T22:53:32.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28482024-11-07T22:53:42.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28492024-11-07T22:53:42.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28502024-11-07T22:53:42.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28512024-11-07T22:53:42.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28522024-11-07T22:53:42.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28532024-11-07T22:53:42.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28542024-11-07T22:53:42.092ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28552024-11-07T22:53:42.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28562024-11-07T22:53:42.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28572024-11-07T22:53:42.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28582024-11-07T22:53:42.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28592024-11-07T22:53:42.095ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28602024-11-07T22:53:42.095ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28612024-11-07T22:53:42.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28622024-11-07T22:53:42.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28632024-11-07T22:53:42.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28642024-11-07T22:53:42.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28652024-11-07T22:53:42.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28662024-11-07T22:53:51.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34864
28672024-11-07T22:53:51.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34864 req_id = 777f3087-6f06-4c83-96c1-750ff3e121ee response_code = 200 uri = /v2p
28682024-11-07T22:53:51.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43057
28692024-11-07T22:53:51.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43057 req_id = 889a86e9-af80-4faa-b84b-b8ccc77f58dc response_code = 200 uri = /vpc-routes
28702024-11-07T22:53:51.213ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
28712024-11-07T22:53:51.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43057 req_id = 634f7d40-c62b-4c60-b085-5a832a9e7bc9 response_code = 204 uri = /eip-gateways
28722024-11-07T22:53:51.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53017
28732024-11-07T22:53:51.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53017 req_id = 557ac69e-4993-4322-ad38-9b35c4f93f48 response_code = 200 uri = /vpc-routes
28742024-11-07T22:53:51.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43057 req_id = 902dbd1a-cf44-4a0e-bd32-9350d2bad3e2 response_code = 204 uri = /vpc-routes
28752024-11-07T22:53:51.267ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
28762024-11-07T22:53:51.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53017 req_id = 1bce51c8-4193-4ec0-ab1a-9467c2f2c55c response_code = 204 uri = /eip-gateways
28772024-11-07T22:53:51.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53017 req_id = 78789d87-ca1d-4ea5-a5fe-42f205450107 response_code = 204 uri = /vpc-routes
28782024-11-07T22:53:51.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33414
28792024-11-07T22:53:51.326ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
28802024-11-07T22:53:51.373ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
28812024-11-07T22:53:51.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33414 req_id = f781fd29-9c7e-4a8c-8d2c-b14fea99c702 response_code = 204 uri = /switch-ports
28822024-11-07T22:53:51.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46969
28832024-11-07T22:53:51.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39755
28842024-11-07T22:53:51.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65373
28852024-11-07T22:53:51.436ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
28862024-11-07T22:53:51.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65373 req_id = d3b8f8f7-640b-4aac-b8bb-00aaa12cb897 response_code = 200 uri = /vpc-routes
28872024-11-07T22:53:51.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4718 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33414 req_id = f0dfcb9f-b26c-4ac9-9f5a-dd74ae73ce49 response_code = 200 uri = /network-bootstore-config
28882024-11-07T22:53:51.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4762 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46969 req_id = bd2b7c76-c8d5-4b15-920a-398a1d6838ec response_code = 200 uri = /v2p
28892024-11-07T22:53:51.478ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
28902024-11-07T22:53:51.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65373 req_id = 6f63d020-3be2-4e24-8a25-c0312d973e18 response_code = 204 uri = /eip-gateways
28912024-11-07T22:53:51.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
28922024-11-07T22:53:51.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65373 req_id = 67ee2c2f-ae12-4d4d-933c-3147a49d9aea response_code = 204 uri = /vpc-routes
28932024-11-07T22:53:51.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32833
28942024-11-07T22:53:51.548ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
28952024-11-07T22:53:51.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112770 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39755 req_id = 52b61b2d-89d7-4cb3-be10-b20785e44e86 response_code = 204 uri = /switch-ports
28962024-11-07T22:53:51.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 743 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39755 req_id = cffb7b1c-0c56-41c5-b8ff-d767ceac9bcc response_code = 200 uri = /network-bootstore-config
28972024-11-07T22:53:51.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48848
28982024-11-07T22:53:51.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48848 req_id = 21efcdfe-ff75-4e09-85e3-8213b245a0b3 response_code = 200 uri = /v2p
28992024-11-07T22:53:51.587ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29002024-11-07T22:53:51.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139929 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32833 req_id = 5f9fa0a9-5a81-4b67-b0d6-4b66d42ae0b1 response_code = 204 uri = /switch-ports
29012024-11-07T22:53:51.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32833 req_id = dcdd8eab-27c9-41c1-8431-a082b708100e response_code = 200 uri = /network-bootstore-config
29022024-11-07T22:53:52.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29032024-11-07T22:53:52.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29042024-11-07T22:53:52.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29052024-11-07T22:53:52.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29062024-11-07T22:53:52.092ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29072024-11-07T22:53:52.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29082024-11-07T22:53:52.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29092024-11-07T22:53:52.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29102024-11-07T22:53:52.095ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29112024-11-07T22:53:52.095ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29122024-11-07T22:53:52.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29132024-11-07T22:53:52.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29142024-11-07T22:53:52.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29152024-11-07T22:53:52.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29162024-11-07T22:53:52.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29172024-11-07T22:53:52.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29182024-11-07T22:53:52.107ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29192024-11-07T22:53:52.108ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29202024-11-07T22:53:56.832ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61861
29212024-11-07T22:53:56.832ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61861 req_id = 93048afb-5245-4bd0-9ed7-fbae1ab30e05 response_code = 200 uri = /baseboard
29222024-11-07T22:54:02.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29232024-11-07T22:54:02.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29242024-11-07T22:54:02.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29252024-11-07T22:54:02.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29262024-11-07T22:54:02.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29272024-11-07T22:54:02.095ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29282024-11-07T22:54:02.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29292024-11-07T22:54:02.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29302024-11-07T22:54:02.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29312024-11-07T22:54:02.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29322024-11-07T22:54:02.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29332024-11-07T22:54:02.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29342024-11-07T22:54:02.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29352024-11-07T22:54:02.100ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29362024-11-07T22:54:02.100ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29372024-11-07T22:54:02.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29382024-11-07T22:54:02.108ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29392024-11-07T22:54:02.110ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29402024-11-07T22:54:12.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29412024-11-07T22:54:12.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29422024-11-07T22:54:12.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29432024-11-07T22:54:12.095ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29442024-11-07T22:54:12.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29452024-11-07T22:54:12.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29462024-11-07T22:54:12.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29472024-11-07T22:54:12.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29482024-11-07T22:54:12.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29492024-11-07T22:54:12.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29502024-11-07T22:54:12.100ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29512024-11-07T22:54:12.100ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29522024-11-07T22:54:12.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29532024-11-07T22:54:12.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29542024-11-07T22:54:12.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29552024-11-07T22:54:12.107ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29562024-11-07T22:54:12.110ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29572024-11-07T22:54:12.112ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29582024-11-07T22:54:21.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59663
29592024-11-07T22:54:21.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59663 req_id = 9b833cf9-5c7d-4c04-a555-9a93e8749512 response_code = 200 uri = /vpc-routes
29602024-11-07T22:54:21.101ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
29612024-11-07T22:54:21.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59663 req_id = 7b19d241-bb58-475a-b064-e55525acea1f response_code = 204 uri = /eip-gateways
29622024-11-07T22:54:21.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61774
29632024-11-07T22:54:21.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 20 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61774 req_id = bd9d5bdd-00fa-4c48-947d-1f11b2fb6869 response_code = 200 uri = /vpc-routes
29642024-11-07T22:54:21.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59663 req_id = d4dfbaed-4bcb-4401-8a1e-175ef0bf3c01 response_code = 204 uri = /vpc-routes
29652024-11-07T22:54:21.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59765
29662024-11-07T22:54:21.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59765 req_id = 1e731552-6565-44d0-bf3b-6b1fdee7a618 response_code = 200 uri = /vpc-routes
29672024-11-07T22:54:21.165ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
29682024-11-07T22:54:21.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61774 req_id = b974cf28-f0a9-4ea7-a949-224d62fa1c5c response_code = 204 uri = /eip-gateways
29692024-11-07T22:54:21.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61774 req_id = a1a695b7-2605-4725-a023-3aa616cafd65 response_code = 204 uri = /vpc-routes
29702024-11-07T22:54:21.183ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
29712024-11-07T22:54:21.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59765 req_id = a334064c-33c0-4c60-bd9d-2896751c09c5 response_code = 204 uri = /eip-gateways
29722024-11-07T22:54:21.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40789
29732024-11-07T22:54:21.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
29742024-11-07T22:54:21.236ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29752024-11-07T22:54:21.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40789 req_id = 4239241f-8737-4bee-bf65-675c0f879258 response_code = 204 uri = /switch-ports
29762024-11-07T22:54:21.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56928
29772024-11-07T22:54:21.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38293
29782024-11-07T22:54:21.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62647
29792024-11-07T22:54:21.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45715
29802024-11-07T22:54:21.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40898
29812024-11-07T22:54:21.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38293 req_id = c0155abf-95e3-4f75-9a8f-f054696d7460 response_code = 200 uri = /v2p
29822024-11-07T22:54:21.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56928 req_id = 96b40641-5939-434c-9f33-f125e196e67d response_code = 200 uri = /v2p
29832024-11-07T22:54:21.304ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
29842024-11-07T22:54:21.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 490 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40789 req_id = 929ff24a-c349-47b8-aaa1-4def598c098d response_code = 200 uri = /network-bootstore-config
29852024-11-07T22:54:21.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 603 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59765 req_id = ec047b9f-b673-427e-b121-fa03a12f16d1 response_code = 204 uri = /vpc-routes
29862024-11-07T22:54:21.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45715 req_id = c7c7e564-1998-4b71-9254-2dae231160c6 response_code = 200 uri = /v2p
29872024-11-07T22:54:21.346ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29882024-11-07T22:54:21.408ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
29892024-11-07T22:54:21.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104943 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40898 req_id = 0f98e26e-6fd1-4127-bb58-3476a09e6407 response_code = 204 uri = /switch-ports
29902024-11-07T22:54:21.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 702 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40898 req_id = 98523701-8730-4092-8ebc-ed33b04636c2 response_code = 200 uri = /network-bootstore-config
29912024-11-07T22:54:21.447ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
29922024-11-07T22:54:21.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204619 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62647 req_id = 58e0c524-b342-4c19-9f80-9679fc548efb response_code = 204 uri = /switch-ports
29932024-11-07T22:54:21.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62647 req_id = dfaf5a73-e9ef-44bf-8752-77d3e9db4741 response_code = 200 uri = /network-bootstore-config
29942024-11-07T22:54:22.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29952024-11-07T22:54:22.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29962024-11-07T22:54:22.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29972024-11-07T22:54:22.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29982024-11-07T22:54:22.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29992024-11-07T22:54:22.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30002024-11-07T22:54:22.100ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30012024-11-07T22:54:22.100ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30022024-11-07T22:54:22.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30032024-11-07T22:54:22.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30042024-11-07T22:54:22.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30052024-11-07T22:54:22.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30062024-11-07T22:54:22.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30072024-11-07T22:54:22.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30082024-11-07T22:54:22.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30092024-11-07T22:54:22.109ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30102024-11-07T22:54:22.111ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30112024-11-07T22:54:22.113ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30122024-11-07T22:54:26.866ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57194
30132024-11-07T22:54:26.866ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57194 req_id = 81c6500e-a8a5-4f83-9fa2-cc2c888089e6 response_code = 200 uri = /baseboard
30142024-11-07T22:54:32.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30152024-11-07T22:54:32.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30162024-11-07T22:54:32.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30172024-11-07T22:54:32.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30182024-11-07T22:54:32.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30192024-11-07T22:54:32.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30202024-11-07T22:54:32.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30212024-11-07T22:54:32.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30222024-11-07T22:54:32.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30232024-11-07T22:54:32.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30242024-11-07T22:54:32.105ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30252024-11-07T22:54:32.105ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30262024-11-07T22:54:32.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30272024-11-07T22:54:32.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30282024-11-07T22:54:32.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30292024-11-07T22:54:32.110ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30302024-11-07T22:54:32.114ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30312024-11-07T22:54:32.114ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30322024-11-07T22:54:41.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63742
30332024-11-07T22:54:41.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63742 req_id = 9d7049c1-ebf7-45e8-bdbe-d51907c8d379 response_code = 200 uri = /v2p
30342024-11-07T22:54:41.414ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6366755) }
30352024-11-07T22:54:41.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63742 req_id = 2aee7293-93d7-4660-825a-d5115b568937 response_code = 204 uri = /v2p
30362024-11-07T22:54:41.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45718
30372024-11-07T22:54:41.589ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 86be4e76-66cd-4978-b88a-9d78e18c2cfd, kind: Instance { id: 6a504631-68b5-4b07-90c2-b9e9b949ee1a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6366755), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86be4e76-66cd-4978-b88a-9d78e18c2cfd, kind: Instance { id: 6a504631-68b5-4b07-90c2-b9e9b949ee1a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6366755), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86be4e76-66cd-4978-b88a-9d78e18c2cfd, kind: Instance { id: 6a504631-68b5-4b07-90c2-b9e9b949ee1a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6366755), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6366755))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86be4e76-66cd-4978-b88a-9d78e18c2cfd, kind: Instance { id: 6a504631-68b5-4b07-90c2-b9e9b949ee1a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6366755), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-195fb73b5e3", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 57d9c04f-03af-41cc-93d0-9a706b8eda16, read_only_parent: Some(Volume { block_size: 512, id: 3cb271f1-5ea8-4453-b150-e99f0406279a, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: af83f92f-55fe-4413-8348-8bb0f78d3d78, key: Some("G1jSKXd+QDScwkuD8rDejVIf3b60UrpopkuxeumIiss="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 57d9c04f-03af-41cc-93d0-9a706b8eda16, key: Some("Qbz1aO2Yr7Dlyf0KCxVQnSChaXBHUAsWBRRnDZrjtj4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-195fb73b5e3" }] }), cloud_init_bytes: Some(..) } instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a metadata = InstanceMetadata { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, project_id: 2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-07T22:54:41.585617402Z }
30382024-11-07T22:54:41.589ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a migration_id = None propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30392024-11-07T22:54:41.589ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a migration_id = None propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 86be4e76-66cd-4978-b88a-9d78e18c2cfd, kind: Instance { id: 6a504631-68b5-4b07-90c2-b9e9b949ee1a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6366755), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86be4e76-66cd-4978-b88a-9d78e18c2cfd, kind: Instance { id: 6a504631-68b5-4b07-90c2-b9e9b949ee1a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6366755), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86be4e76-66cd-4978-b88a-9d78e18c2cfd, kind: Instance { id: 6a504631-68b5-4b07-90c2-b9e9b949ee1a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6366755), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6366755))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86be4e76-66cd-4978-b88a-9d78e18c2cfd, kind: Instance { id: 6a504631-68b5-4b07-90c2-b9e9b949ee1a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6366755), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-195fb73b5e3", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 57d9c04f-03af-41cc-93d0-9a706b8eda16, read_only_parent: Some(Volume { block_size: 512, id: 3cb271f1-5ea8-4453-b150-e99f0406279a, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: af83f92f-55fe-4413-8348-8bb0f78d3d78, key: Some("G1jSKXd+QDScwkuD8rDejVIf3b60UrpopkuxeumIiss="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 57d9c04f-03af-41cc-93d0-9a706b8eda16, key: Some("Qbz1aO2Yr7Dlyf0KCxVQnSChaXBHUAsWBRRnDZrjtj4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-195fb73b5e3" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-07T22:54:41.585617402Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
30402024-11-07T22:54:41.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4702 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45718 req_id = aa52a702-48ed-4096-bcaf-e432a834d21e response_code = 200 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
30412024-11-07T22:54:41.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46702
30422024-11-07T22:54:41.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 738 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46702 req_id = 0c7aa7cb-7793-405d-b801-147004f8a5d7 response_code = 200 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532/state
30432024-11-07T22:54:41.707ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 6366755 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30442024-11-07T22:54:41.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
30452024-11-07T22:54:41.757ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532 file = illumos-utils/src/zone.rs:325 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30462024-11-07T22:54:41.780ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532 file = illumos-utils/src/zone.rs:363 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30472024-11-07T22:54:41.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64792
30482024-11-07T22:54:41.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64792 req_id = 4114bb2e-76bd-4b56-b8f6-533d01973f9a response_code = 200 uri = /vpc-routes
30492024-11-07T22:54:41.847ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {86be4e76-66cd-4978-b88a-9d78e18c2cfd: {10.151.1.175: {670a3278-63eb-4d0f-9671-edf66650b9f3}, 10.151.1.176: {670a3278-63eb-4d0f-9671-edf66650b9f3}}} }
30502024-11-07T22:54:42.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30512024-11-07T22:54:42.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30522024-11-07T22:54:42.100ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30532024-11-07T22:54:42.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30542024-11-07T22:54:42.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30552024-11-07T22:54:42.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30562024-11-07T22:54:42.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30572024-11-07T22:54:42.105ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30582024-11-07T22:54:42.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30592024-11-07T22:54:42.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30602024-11-07T22:54:42.107ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30612024-11-07T22:54:42.107ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30622024-11-07T22:54:42.108ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30632024-11-07T22:54:42.108ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30642024-11-07T22:54:42.109ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30652024-11-07T22:54:42.111ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30662024-11-07T22:54:42.115ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30672024-11-07T22:54:42.116ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30682024-11-07T22:54:42.974ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30692024-11-07T22:54:42.974ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 zone = oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532
30702024-11-07T22:54:43.163ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 52.368823ms file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 zone = oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532
30712024-11-07T22:54:43.232ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 94.106635ms file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 zone = oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532
30722024-11-07T22:54:43.345ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 107.171454ms file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 zone = oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532
30732024-11-07T22:54:43.470ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 290.890834ms file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 zone = oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532
30742024-11-07T22:54:43.782ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 950.402333ms file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 zone = oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532
30752024-11-07T22:54:44.747ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 1.107785523s file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 zone = oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532
30762024-11-07T22:54:45.869ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 1.447774697s file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 zone = oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532
30772024-11-07T22:54:47.330ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 1.07387628s file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 zone = oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532
30782024-11-07T22:54:48.438ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532 file = sled-agent/src/instance.rs:1787 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30792024-11-07T22:54:48.449ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 71.239994ms file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30802024-11-07T22:54:48.533ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 72.915705ms file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30812024-11-07T22:54:48.617ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532") failed: Property not found. retry in 136.180865ms file = illumos-utils/src/svc.rs:36 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30822024-11-07T22:54:48.765ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30832024-11-07T22:54:48.800ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30842024-11-07T22:54:48.936ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30852024-11-07T22:54:48.937ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30862024-11-07T22:54:48.937ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-07T22:54:48.937144005Z } file = sled-agent/src/instance.rs:780 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30872024-11-07T22:54:48.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7090974 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64792 req_id = 4458d15a-5ad6-45e1-9a4c-6ec8640f1a50 response_code = 204 uri = /eip-gateways
30882024-11-07T22:54:48.937ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-07T22:54:48.937144005Z } propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30892024-11-07T22:54:48.937ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-07T22:54:48.937144005Z }, migration_in: None, migration_out: None }
30902024-11-07T22:54:48.963ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-07T22:54:48.963003093Z } file = sled-agent/src/instance.rs:780 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30912024-11-07T22:54:48.963ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-07T22:54:48.963003093Z } propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
30922024-11-07T22:54:48.963ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-07T22:54:48.963003093Z }, migration_in: None, migration_out: None }
30932024-11-07T22:54:49.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64792 req_id = b0855156-111f-4e5a-a8b5-71fdffe36d6b response_code = 204 uri = /vpc-routes
30942024-11-07T22:54:51.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58695
30952024-11-07T22:54:51.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58695 req_id = 3505284b-b03b-4788-a8cb-bab23d949d5f response_code = 200 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532/state
30962024-11-07T22:54:51.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32989
30972024-11-07T22:54:51.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32989 req_id = d454b3af-c26f-4f1a-8d06-4cf4d596486b response_code = 200 uri = /vpc-routes
30982024-11-07T22:54:51.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64273
30992024-11-07T22:54:51.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64273 req_id = f7765175-b8e5-435d-9cc7-69e361d07b2b response_code = 200 uri = /vpc-routes
31002024-11-07T22:54:51.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61520
31012024-11-07T22:54:51.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61520 req_id = af0f55e0-eb37-40ac-8ff8-6c4e63ab51f7 response_code = 200 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532/state
31022024-11-07T22:54:51.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56139
31032024-11-07T22:54:51.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56139 req_id = 6cdc4b43-38cf-4f67-bc47-0082de7e354a response_code = 200 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532/state
31042024-11-07T22:54:51.298ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {86be4e76-66cd-4978-b88a-9d78e18c2cfd: {10.151.1.175: {670a3278-63eb-4d0f-9671-edf66650b9f3}, 10.151.1.176: {670a3278-63eb-4d0f-9671-edf66650b9f3}}} }
31052024-11-07T22:54:51.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64273 req_id = 24440f47-ad6a-40be-b380-69d0027816a8 response_code = 204 uri = /eip-gateways
31062024-11-07T22:54:51.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64273 req_id = ed2aca41-5894-48fd-9522-aeab1a8a8968 response_code = 204 uri = /vpc-routes
31072024-11-07T22:54:51.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50375
31082024-11-07T22:54:51.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50375 req_id = 441e42d4-7678-4027-8199-ad6eb9e714ec response_code = 200 uri = /vpc-routes
31092024-11-07T22:54:51.346ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {86be4e76-66cd-4978-b88a-9d78e18c2cfd: {10.151.1.175: {670a3278-63eb-4d0f-9671-edf66650b9f3}, 10.151.1.176: {670a3278-63eb-4d0f-9671-edf66650b9f3}}} }
31102024-11-07T22:54:51.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32989 req_id = 4a58ffe9-fbbb-4029-9112-b9a55059a416 response_code = 204 uri = /eip-gateways
31112024-11-07T22:54:51.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54617
31122024-11-07T22:54:51.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54617 req_id = 19db825b-8fbe-4568-85c6-fbe40c2cbb6c response_code = 200 uri = /v2p
31132024-11-07T22:54:51.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32989 req_id = d31ef7e5-0dd5-4e68-907c-a573a3289aa0 response_code = 204 uri = /vpc-routes
31142024-11-07T22:54:51.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56315
31152024-11-07T22:54:51.392ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
31162024-11-07T22:54:51.449ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
31172024-11-07T22:54:51.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136671 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56315 req_id = 8f46e3f9-4c3a-4157-ae90-9afa93f327eb response_code = 204 uri = /switch-ports
31182024-11-07T22:54:51.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37571
31192024-11-07T22:54:51.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47914
31202024-11-07T22:54:51.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35209
31212024-11-07T22:54:51.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56315 req_id = d46dc2de-1cf4-4b40-8905-65109153ba3c response_code = 200 uri = /network-bootstore-config
31222024-11-07T22:54:51.529ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {86be4e76-66cd-4978-b88a-9d78e18c2cfd: {10.151.1.175: {670a3278-63eb-4d0f-9671-edf66650b9f3}, 10.151.1.176: {670a3278-63eb-4d0f-9671-edf66650b9f3}}} }
31232024-11-07T22:54:51.529ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
31242024-11-07T22:54:51.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50375 req_id = cfa96483-181a-41b3-b267-b44fe5602a96 response_code = 204 uri = /eip-gateways
31252024-11-07T22:54:51.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7034 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35209 req_id = a52e2d38-6208-43b2-9416-3ab37b7b3642 response_code = 200 uri = /v2p
31262024-11-07T22:54:51.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33105
31272024-11-07T22:54:51.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33105 req_id = 6db8e14b-2fda-40a4-9234-7a12df71144a response_code = 200 uri = /v2p
31282024-11-07T22:54:51.573ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
31292024-11-07T22:54:51.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 924 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50375 req_id = 3d4b4446-5fc5-4840-8ba3-3549fa63cd20 response_code = 204 uri = /vpc-routes
31302024-11-07T22:54:51.640ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4082
31312024-11-07T22:54:51.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111328 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47914 req_id = dff332b2-f249-4d9b-81df-21bf27b9d0d5 response_code = 204 uri = /switch-ports
31322024-11-07T22:54:51.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47914 req_id = 6f54fcf0-01ed-4fad-8ee1-eb98a05f864f response_code = 200 uri = /network-bootstore-config
31332024-11-07T22:54:51.685ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4106
31342024-11-07T22:54:51.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37571 req_id = 0055bc61-d9a7-4731-be4a-de9836c6288f response_code = 204 uri = /switch-ports
31352024-11-07T22:54:51.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37571 req_id = ef9b7e6e-bea4-4716-83f2-d60d0a3a472d response_code = 200 uri = /network-bootstore-config
31362024-11-07T22:54:52.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31372024-11-07T22:54:52.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31382024-11-07T22:54:52.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31392024-11-07T22:54:52.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31402024-11-07T22:54:52.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31412024-11-07T22:54:52.105ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31422024-11-07T22:54:52.107ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31432024-11-07T22:54:52.107ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31442024-11-07T22:54:52.108ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31452024-11-07T22:54:52.109ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31462024-11-07T22:54:52.109ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31472024-11-07T22:54:52.110ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31482024-11-07T22:54:52.110ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31492024-11-07T22:54:52.111ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31502024-11-07T22:54:52.111ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31512024-11-07T22:54:52.113ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31522024-11-07T22:54:52.116ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31532024-11-07T22:54:52.118ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31542024-11-07T22:54:56.899ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43050
31552024-11-07T22:54:56.899ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43050 req_id = dffe6c78-d6e1-4f1d-962e-696123eb589b response_code = 200 uri = /baseboard
31562024-11-07T22:54:59.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62965
31572024-11-07T22:54:59.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62965 req_id = a49b899b-deb7-464b-a56d-4fd781332dad response_code = 200 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532/state
31582024-11-07T22:54:59.204ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-07T22:54:59.204360866Z } file = sled-agent/src/instance.rs:780 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
31592024-11-07T22:54:59.204ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-07T22:54:59.204360866Z } propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
31602024-11-07T22:54:59.204ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-07T22:54:59.204360866Z }, migration_in: None, migration_out: None }
31612024-11-07T22:54:59.216ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-07T22:54:59.216356269Z } file = sled-agent/src/instance.rs:780 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
31622024-11-07T22:54:59.216ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-07T22:54:59.216356269Z } propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
31632024-11-07T22:54:59.216ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
31642024-11-07T22:54:59.216ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
31652024-11-07T22:54:59.216ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 11444876640333642768 n_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31662024-11-07T22:54:59.216ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 6081137351529368024 n_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31672024-11-07T22:54:59.216ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
31682024-11-07T22:54:59.216ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/78d3f5b9-3b9e-4e0a-b58c-a32a7f958f71/debug/bundle/zone", "/pool/int/fa6fb39a-dddd-477d-9120-b0fab05e8b5a/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/896a209a-9e6b-4a3e-85d1-8128327ab969/crypt/debug", "/pool/ext/542fb670-2cd7-4cb9-9a65-01ef014dcdb4/crypt/debug", "/pool/ext/6bcd12fd-a17a-4b71-b93d-84590e442e65/crypt/debug", "/pool/ext/079e3938-061f-42e6-b89a-4de48c877f70/crypt/debug", "/pool/ext/e246880a-4d88-4441-a6d6-a9e42d69d6eb/crypt/debug", "/pool/ext/6a8d312b-1855-4f59-8964-cdc4c8aad9f3/crypt/debug", "/pool/ext/c38ffc78-518d-45b9-9391-e3e1820de913/crypt/debug", "/pool/ext/aa1b0888-f629-45fb-b793-272240a5e638/crypt/debug", "/pool/ext/3f19b51d-8f23-4736-b0f1-315ae26a980a/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532
31692024-11-07T22:54:59.878ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532", bundle_id: 40933553-ec57-40bf-aed1-0100e0e24e6a }, time_created: 2024-11-07T22:54:59.217148271Z, version: 0, cause: TerminatedInstance }
31702024-11-07T22:54:59.878ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_b5cf5868-7c76-4d62-9b7a-b461419dc532 file = sled-agent/src/instance.rs:1032 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
31712024-11-07T22:55:01.642ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
31722024-11-07T22:55:01.661ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(6366755), kind: System }
31732024-11-07T22:55:01.661ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(6366755), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
31742024-11-07T22:55:01.662ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-07T22:55:01.662114925Z }, migration_in: None, migration_out: None }
31752024-11-07T22:55:01.717ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-07T22:55:01.662114925Z }, migration_in: None, migration_out: None }
31762024-11-07T22:55:01.719ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
31772024-11-07T22:55:02.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31782024-11-07T22:55:02.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31792024-11-07T22:55:02.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31802024-11-07T22:55:02.105ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31812024-11-07T22:55:02.105ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31822024-11-07T22:55:02.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31832024-11-07T22:55:02.109ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31842024-11-07T22:55:02.110ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31852024-11-07T22:55:02.111ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31862024-11-07T22:55:02.111ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31872024-11-07T22:55:02.112ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31882024-11-07T22:55:02.112ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31892024-11-07T22:55:02.113ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31902024-11-07T22:55:02.113ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31912024-11-07T22:55:02.114ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31922024-11-07T22:55:02.114ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31932024-11-07T22:55:02.118ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31942024-11-07T22:55:02.120ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31952024-11-07T22:55:02.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43482
31962024-11-07T22:55:02.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43482 req_id = dcf295a6-5d23-4f6e-bc63-6bc53ba96839 response_code = 200 uri = /vpc-routes
31972024-11-07T22:55:02.250ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
31982024-11-07T22:55:02.250ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
31992024-11-07T22:55:02.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43482 req_id = 480fc1d5-f164-4612-a396-69562578ed54 response_code = 204 uri = /eip-gateways
32002024-11-07T22:55:02.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43482 req_id = 57973cb1-c84f-4b90-8e1f-136a04cf71eb response_code = 204 uri = /vpc-routes
32012024-11-07T22:55:02.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35586
32022024-11-07T22:55:02.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35586 req_id = 33bef7cf-e61c-4ef3-87ba-5fdd9b16a3bf response_code = 200 uri = /v2p
32032024-11-07T22:55:02.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65535
32042024-11-07T22:55:02.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65535 req_id = 0fc9d01c-2e46-400e-ac6e-1fbe24156ecb response_code = 200 uri = /v2p
32052024-11-07T22:55:02.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36582
32062024-11-07T22:55:02.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36582 req_id = a2a33cf6-9539-44c3-8eef-4819dcd16bdd response_code = 200 uri = /vpc-routes
32072024-11-07T22:55:02.567ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
32082024-11-07T22:55:02.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36582 req_id = 1933cdab-a470-4f71-be35-6cef791feb89 response_code = 204 uri = /eip-gateways
32092024-11-07T22:55:02.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36582 req_id = 5208ac6a-c2a0-4964-b867-28d7481bc09b response_code = 204 uri = /vpc-routes
32102024-11-07T22:55:03.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39882
32112024-11-07T22:55:03.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39882 req_id = 22212213-065f-4ce2-89af-e195ea899c51 response_code = 200 uri = /vpc-routes
32122024-11-07T22:55:03.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 values = ExternalIpGatewayMap { mappings: {} }
32132024-11-07T22:55:03.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39882 req_id = daa78e98-67e6-48f0-a4a0-cc1f9fea1946 response_code = 204 uri = /eip-gateways
32142024-11-07T22:55:03.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39882 req_id = ad1ba0f5-771d-41df-9d75-7e69078a0d32 response_code = 204 uri = /vpc-routes