Max level shown:
1 [ Nov 1 08:17:53 Enabled. ]
2 [ Nov 1 08:17:53 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 1 08:17:53 Method "start" exited with status 0. ]
4 [ Nov 1 08:17:53 Rereading configuration. ]
5 [ Nov 1 08:17:53 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-01T08:17:53.666ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-01T08:17:53.666ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-01T08:17:53.718ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-01T08:17:53.718ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-01T08:17:53.833ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-01T08:17:53.842ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-01T08:17:53.850ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-01T08:17:54.452ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-01T08:17:54.592ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-01T08:17:54.592ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-01T08:17:54.592ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-01T08:17:54.592ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-01T08:17:54.592ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-01T08:17:54.592ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-01T08:17:54.596ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-01T08:17:54.596ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-01T08:17:54.596ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-01T08:17:54.596ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-01T08:17:54.596ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-01T08:17:54.596ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-01T08:17:54.596ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-11-01T08:17:54.596ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-01T08:17:54.596ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-01T08:17:54.607ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-01T08:17:54.607ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool)
322024-11-01T08:17:54.707ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal }
332024-11-01T08:17:55.189ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-11-01T08:17:55.189ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-01T08:17:55.189ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-01T08:17:55.189ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-01T08:17:55.189ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
382024-11-01T08:17:55.189ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
392024-11-01T08:17:55.189ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
402024-11-01T08:17:55.189ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
412024-11-01T08:17:55.189ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
422024-11-01T08:17:55.189ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
432024-11-01T08:17:55.198ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
442024-11-01T08:17:55.198ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool)
452024-11-01T08:17:55.288ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal }
462024-11-01T08:17:55.771ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
472024-11-01T08:17:55.771ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
482024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
492024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
502024-11-01T08:17:55.771ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
512024-11-01T08:17:55.771ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
522024-11-01T08:17:55.771ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
532024-11-01T08:17:55.771ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
542024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
552024-11-01T08:17:55.771ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
562024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
572024-11-01T08:17:55.771ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
582024-11-01T08:17:55.771ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
592024-11-01T08:17:55.771ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
602024-11-01T08:17:55.771ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
612024-11-01T08:17:55.771ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
622024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
632024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
642024-11-01T08:17:55.771ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
652024-11-01T08:17:55.771ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
662024-11-01T08:17:55.771ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
672024-11-01T08:17:55.771ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
682024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
692024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
702024-11-01T08:17:55.771ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
712024-11-01T08:17:55.771ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
722024-11-01T08:17:55.771ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
732024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
742024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
752024-11-01T08:17:55.771ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
762024-11-01T08:17:55.771ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
772024-11-01T08:17:55.771ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
782024-11-01T08:17:55.771ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
792024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
802024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
812024-11-01T08:17:55.771ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
822024-11-01T08:17:55.771ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
832024-11-01T08:17:55.771ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
842024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862024-11-01T08:17:55.771ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
872024-11-01T08:17:55.771ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
882024-11-01T08:17:55.771ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
892024-11-01T08:17:55.771ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
902024-11-01T08:17:55.771ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-11-01T08:17:55.771ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
922024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-11-01T08:17:55.771ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
952024-11-01T08:17:55.771ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
962024-11-01T08:17:55.771ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972024-11-01T08:17:55.771ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
982024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
992024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002024-11-01T08:17:55.771ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1012024-11-01T08:17:55.771ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022024-11-01T08:17:55.771ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1032024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1042024-11-01T08:17:55.771ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1052024-11-01T08:17:55.771ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1062024-11-01T08:17:55.771ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1072024-11-01T08:17:55.771ZINFOSledAgent (bootstore): No ledger in /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-11-01T08:17:55.771ZINFOSledAgent (bootstore): No ledger in /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-11-01T08:17:55.771ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1102024-11-01T08:17:55.771ZINFOSledAgent (bootstore): No ledger in /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1112024-11-01T08:17:55.771ZINFOSledAgent (bootstore): No ledger in /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1122024-11-01T08:17:55.771ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1132024-11-01T08:17:55.771ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1142024-11-01T08:17:55.771ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1152024-11-01T08:17:55.783ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:733
1162024-11-01T08:17:55.783ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 4640, tv_nsec: 249884275 } time_to_next_cleanup = 599.999902568s
1172024-11-01T08:17:55.783ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3909
1182024-11-01T08:17:55.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1192024-11-01T08:17:55.783ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/sled-agent-request.json file = common/src/ledger.rs:188
1202024-11-01T08:17:55.785ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/sled-agent-request.json file = common/src/ledger.rs:188
1212024-11-01T08:17:55.786ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1222024-11-01T08:17:55.788ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1232024-11-01T08:17:55.788ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1074
1242024-11-01T08:17:55.788ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1252024-11-01T08:17:55.788ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1262024-11-01T08:17:55.788ZINFOSledAgent (RSS): No ledger in /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-11-01T08:17:55.788ZINFOSledAgent (RSS): No ledger in /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-11-01T08:17:55.788ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1137
1292024-11-01T08:17:55.788ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1302024-11-01T08:17:55.788ZINFOSledAgent (RSS): No ledger in /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/rss-sled-plan.json file = common/src/ledger.rs:188
1312024-11-01T08:17:55.788ZINFOSledAgent (RSS): No ledger in /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/rss-sled-plan.json file = common/src/ledger.rs:188
1322024-11-01T08:17:55.788ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1179
1332024-11-01T08:17:55.788ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1342024-11-01T08:17:55.788ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1352024-11-01T08:17:55.788ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1362024-11-01T08:17:55.788ZINFOSledAgent (RSS): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1372024-11-01T08:17:55.788ZINFOSledAgent (RSS): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1382024-11-01T08:17:55.789ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f7fe3bf0-db6a-428d-8129-f334aa61483d (sled), rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1392024-11-01T08:17:55.789ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1213
1402024-11-01T08:17:55.789ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1412024-11-01T08:17:55.789ZINFOSledAgent (bootstore): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1422024-11-01T08:17:55.789ZINFOSledAgent (bootstore): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1432024-11-01T08:17:55.789ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1442024-11-01T08:17:55.789ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f7fe3bf0-db6a-428d-8129-f334aa61483d (sled), rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1452024-11-01T08:17:55.790ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4206
1462024-11-01T08:17:55.790ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4588
1472024-11-01T08:17:55.794ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1482024-11-01T08:17:55.800ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1492024-11-01T08:17:55.800ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1502024-11-01T08:17:55.805ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1512024-11-01T08:17:55.805ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1522024-11-01T08:17:55.805ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:43109
1532024-11-01T08:17:55.805ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f7fe3bf0-db6a-428d-8129-f334aa61483d (sled), rack_id: 8166ec96-9c84-4ebd-9efb-796280106790, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1542024-11-01T08:17:55.805ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1552024-11-01T08:17:55.805ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1562024-11-01T08:17:55.805ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1572024-11-01T08:17:55.805ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1582024-11-01T08:17:55.805ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1592024-11-01T08:17:55.805ZINFOSledAgent (StorageManager): No ledger in /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1602024-11-01T08:17:55.805ZINFOSledAgent (StorageManager): No ledger in /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1612024-11-01T08:17:55.805ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1622024-11-01T08:17:55.805ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1632024-11-01T08:17:55.805ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1642024-11-01T08:17:55.805ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1652024-11-01T08:17:55.805ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1662024-11-01T08:17:55.805ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1672024-11-01T08:17:55.822ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1682024-11-01T08:17:55.843ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1692024-11-01T08:17:55.861ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1702024-11-01T08:17:55.886ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
1712024-11-01T08:17:55.886ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1722024-11-01T08:17:55.886ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1732024-11-01T08:17:55.886ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
1742024-11-01T08:17:55.889ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 59.946061ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3bd0e700-a5d8-401e-8f72-73ae6c7b2c1e", "content-length": "124", "date": "Fri, 01 Nov 2024 08:17:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3bd0e700-a5d8-401e-8f72-73ae6c7b2c1e" } file = clients/ddm-admin-client/src/lib.rs:177
1752024-11-01T08:17:55.899ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_437cc0f8-cee4-4fe4-a027-42fa12428505/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1762024-11-01T08:17:55.923ZINFOSledAgent: successfully created encrypted zvol: name="oxi_437cc0f8-cee4-4fe4-a027-42fa12428505/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1772024-11-01T08:17:55.923ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_437cc0f8-cee4-4fe4-a027-42fa12428505/swap" file = sled-agent/src/swap_device.rs:96
1782024-11-01T08:17:55.928ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
1792024-11-01T08:17:55.928ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1802024-11-01T08:17:55.928ZINFOSledAgent (BackingFs): Ensuring dataset oxi_437cc0f8-cee4-4fe4-a027-42fa12428505/backing/fmd file = sled-agent/src/backing_fs.rs:138
1812024-11-01T08:17:55.950ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-01T08:17:55.951ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 104.481964ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6a4906ac-e674-462b-b160-f8782cdadd89", "content-length": "124", "date": "Fri, 01 Nov 2024 08:17:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6a4906ac-e674-462b-b160-f8782cdadd89" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-01T08:17:56.018ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1842024-11-01T08:17:56.056ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1852024-11-01T08:17:56.056ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 72.48291ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4d43b8e2-dbbe-40ec-b9a0-f1f26ceee194", "content-length": "124", "date": "Fri, 01 Nov 2024 08:17:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4d43b8e2-dbbe-40ec-b9a0-f1f26ceee194" } file = clients/ddm-admin-client/src/lib.rs:177
1862024-11-01T08:17:56.130ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-11-01T08:17:56.131ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 87.778788ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c3a16193-6f54-427a-b1c0-784044aaeb77", "content-length": "124", "date": "Fri, 01 Nov 2024 08:17:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c3a16193-6f54-427a-b1c0-784044aaeb77" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-11-01T08:17:56.220ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-01T08:17:56.221ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 121.226783ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4591f79e-ad28-4c97-8a15-6d4596d58471", "content-length": "124", "date": "Fri, 01 Nov 2024 08:17:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4591f79e-ad28-4c97-8a15-6d4596d58471" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-01T08:17:56.237ZINFOSledAgent (BackingFs): Mounting oxi_437cc0f8-cee4-4fe4-a027-42fa12428505/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1912024-11-01T08:17:56.251ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1922024-11-01T08:17:56.251ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1932024-11-01T08:17:56.251ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1942024-11-01T08:17:56.251ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1952024-11-01T08:17:56.343ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1962024-11-01T08:17:56.343ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 206.919704ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a4134abc-ea10-4809-9e57-028cd2cddf65", "content-length": "124", "date": "Fri, 01 Nov 2024 08:17:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a4134abc-ea10-4809-9e57-028cd2cddf65" } file = clients/ddm-admin-client/src/lib.rs:177
1972024-11-01T08:17:56.551ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1982024-11-01T08:17:56.552ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 385.093027ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "34541e89-1472-485f-b7bf-9aee33867b90", "content-length": "124", "date": "Fri, 01 Nov 2024 08:17:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "34541e89-1472-485f-b7bf-9aee33867b90" } file = clients/ddm-admin-client/src/lib.rs:177
1992024-11-01T08:17:56.939ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2002024-11-01T08:17:56.984ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2012024-11-01T08:17:56.990ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:63635 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2022024-11-01T08:17:56.990ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2032024-11-01T08:17:56.990ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:63635 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = f7fe3bf0-db6a-428d-8129-f334aa61483d sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2042024-11-01T08:17:56.991ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 254.609532ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2052024-11-01T08:17:56.992ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2062024-11-01T08:17:56.992ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2072024-11-01T08:17:56.992ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:917 underlay_address = fd00:1122:3344:101::1
2082024-11-01T08:17:56.992ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2092024-11-01T08:17:57.248ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 437.241608ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2102024-11-01T08:17:57.686ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.463319852s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2112024-11-01T08:17:59.151ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.077151058s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2122024-11-01T08:17:59.464ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2664
2132024-11-01T08:17:59.464ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2882
2142024-11-01T08:17:59.464ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2534
2152024-11-01T08:17:59.464ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2581
2162024-11-01T08:17:59.464ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2963
2172024-11-01T08:17:59.464ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3005
2182024-11-01T08:17:59.466ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2807
2192024-11-01T08:17:59.467ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2575
2202024-11-01T08:17:59.467ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='2bd8d4c6-9800-41ac-b72e-4afab6fc2f46'/> <propval type="astring" name="rack_id" value='8166ec96-9c84-4ebd-9efb-796280106790'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fea1:8726'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='f7fe3bf0-db6a-428d-8129-f334aa61483d'/> <propval type="astring" name="rack_id" value='8166ec96-9c84-4ebd-9efb-796280106790'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='f7fe3bf0-db6a-428d-8129-f334aa61483d'/> <propval type="astring" name="rack_uuid" value='8166ec96-9c84-4ebd-9efb-796280106790'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='f7fe3bf0-db6a-428d-8129-f334aa61483d'/> <propval type="astring" name="rack_uuid" value='8166ec96-9c84-4ebd-9efb-796280106790'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2212024-11-01T08:17:59.467ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2222024-11-01T08:17:59.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 36.598828ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-01T08:17:59.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 66.897645ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-01T08:18:00.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 171.797478ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-01T08:18:00.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 285.922006ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-01T08:18:00.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 795.153397ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-01T08:18:01.230ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.809264357s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2282024-11-01T08:18:01.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 743.319596ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-01T08:18:02.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.474094398s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302024-11-01T08:18:03.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 821.08471ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2312024-11-01T08:18:04.041ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.508790224s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2322024-11-01T08:18:04.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 839.864336ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2332024-11-01T08:18:05.900ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/f7fe3bf0-db6a-428d-8129-f334aa61483d) file = sled-agent/src/nexus.rs:527 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2342024-11-01T08:18:05.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2352024-11-01T08:18:05.930ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2362024-11-01T08:18:05.931ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2372024-11-01T08:18:05.931ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2382024-11-01T08:18:05.931ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2392024-11-01T08:18:05.931ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2402024-11-01T08:18:05.932ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2412024-11-01T08:18:05.932ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2422024-11-01T08:18:05.932ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None }], bgp: [], bfd: [] })))
2432024-11-01T08:18:05.932ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3909
2442024-11-01T08:18:05.932ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:43109
2452024-11-01T08:18:06.117ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2462024-11-01T08:18:06.117ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2472024-11-01T08:18:06.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2482024-11-01T08:18:06.117ZINFOSledAgent (RSS): No ledger in /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2492024-11-01T08:18:06.117ZINFOSledAgent (RSS): No ledger in /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2502024-11-01T08:18:06.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2512024-11-01T08:18:06.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2522024-11-01T08:18:06.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2532024-11-01T08:18:06.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2542024-11-01T08:18:06.123ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4230 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2552024-11-01T08:18:06.123ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4246
2562024-11-01T08:18:06.123ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2572024-11-01T08:18:06.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63477
2582024-11-01T08:18:06.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2592024-11-01T08:18:06.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2602024-11-01T08:18:06.398ZINFOSledAgent (ServiceManager): No ledger in /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:188
2612024-11-01T08:18:06.398ZINFOSledAgent (ServiceManager): No ledger in /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:188
2622024-11-01T08:18:06.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63477 req_id = aee28338-e0f2-45f9-98eb-d6c2bf1ad489 response_code = 200 uri = /inventory
2632024-11-01T08:18:06.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41347
2642024-11-01T08:18:06.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41347 req_id = f233eb2a-7f15-4c8a-a44e-41c07146ccab response_code = 200 uri = /sled-role
2652024-11-01T08:18:06.430ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2662024-11-01T08:18:06.430ZINFOSledAgent (RSS): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2672024-11-01T08:18:06.431ZINFOSledAgent (RSS): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2682024-11-01T08:18:06.431ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:886
2692024-11-01T08:18:06.460ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: ca3cadb7-c6af-40fd-bc9c-c72595e94876, pool_id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 8b0f040a-4516-434f-bd9d-89b15b219db3, pool_id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a219e23d-eb8a-4ae4-a86d-6726b477e14b, pool_id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e0b42db1-de3f-4c49-b408-fd5ab23d9a59, pool_id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 4ae35d6d-2661-4fcf-85ee-0e7e5af71e4b, pool_id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: b5ef3569-771f-48e9-9c6a-9c3de9957186, pool_id: bc7c6e7d-afb2-4573-b1cd-22c23c48ada9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 538863e5-c402-44f0-84fe-45f7cc318fc0, pool_id: 8b236217-c0e1-4577-a9da-0a2d7b6af284 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: df86fcbd-565c-4bcb-a192-e887e2815c71, pool_id: fd3db670-6bf7-4efd-bc98-fba2dadc0267 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 5006413e-e766-449e-b468-66da876e737c, pool_id: e1e3ff7c-24ad-4b58-b036-90d5df3d681f (zpool) }] } file = sled-agent/src/rack_setup/service.rs:376 sled_address = [fd00:1122:3344:101::1]:12345
2702024-11-01T08:18:06.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46970
2712024-11-01T08:18:06.461ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:886 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2722024-11-01T08:18:06.461ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: ca3cadb7-c6af-40fd-bc9c-c72595e94876, pool_id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 8b0f040a-4516-434f-bd9d-89b15b219db3, pool_id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a219e23d-eb8a-4ae4-a86d-6726b477e14b, pool_id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e0b42db1-de3f-4c49-b408-fd5ab23d9a59, pool_id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 4ae35d6d-2661-4fcf-85ee-0e7e5af71e4b, pool_id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: b5ef3569-771f-48e9-9c6a-9c3de9957186, pool_id: bc7c6e7d-afb2-4573-b1cd-22c23c48ada9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 538863e5-c402-44f0-84fe-45f7cc318fc0, pool_id: 8b236217-c0e1-4577-a9da-0a2d7b6af284 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: df86fcbd-565c-4bcb-a192-e887e2815c71, pool_id: fd3db670-6bf7-4efd-bc98-fba2dadc0267 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 5006413e-e766-449e-b468-66da876e737c, pool_id: e1e3ff7c-24ad-4b58-b036-90d5df3d681f (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2732024-11-01T08:18:06.461ZINFOSledAgent (StorageManager): No ledger in /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2742024-11-01T08:18:06.461ZINFOSledAgent (StorageManager): No ledger in /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2752024-11-01T08:18:06.461ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2762024-11-01T08:18:06.461ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2772024-11-01T08:18:06.461ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2782024-11-01T08:18:06.461ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2792024-11-01T08:18:06.461ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2802024-11-01T08:18:06.587ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2812024-11-01T08:18:06.587ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool)
2822024-11-01T08:18:07.034ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f7fe3bf0-db6a-428d-8129-f334aa61483d) file = sled-agent/src/probe_manager.rs:231 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2832024-11-01T08:18:07.035ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4464916228705759239 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2842024-11-01T08:18:07.035ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18116858079738301630 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2852024-11-01T08:18:07.233ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
2862024-11-01T08:18:07.282ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }
2872024-11-01T08:18:07.290ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:225
2882024-11-01T08:18:07.290ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:227
2892024-11-01T08:18:07.290ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:231
2902024-11-01T08:18:07.290ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:233
2912024-11-01T08:18:07.290ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-11-01T08:18:07.290ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-11-01T08:18:07.290ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
2942024-11-01T08:18:07.325ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952024-11-01T08:18:07.333ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8c13d012-7fe1-48a4-8f49-bd4b8f1c925d/crypt/zone file = sled-storage/src/dataset.rs:288
2962024-11-01T08:18:07.504ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8c13d012-7fe1-48a4-8f49-bd4b8f1c925d file = sled-storage/src/dataset.rs:374
2972024-11-01T08:18:07.512ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2982024-11-01T08:18:07.512ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2992024-11-01T08:18:07.512ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
3002024-11-01T08:18:07.512ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012024-11-01T08:18:07.512ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
3022024-11-01T08:18:07.522ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3032024-11-01T08:18:07.522ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool)
3042024-11-01T08:18:07.609ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }
3052024-11-01T08:18:07.617ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:225
3062024-11-01T08:18:07.617ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:227
3072024-11-01T08:18:07.617ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:231
3082024-11-01T08:18:07.617ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:233
3092024-11-01T08:18:07.617ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-11-01T08:18:07.617ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-11-01T08:18:07.617ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3122024-11-01T08:18:07.650ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132024-11-01T08:18:07.658ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6b307b27-321f-475e-9d0a-7877e7e97d8e/crypt/zone file = sled-storage/src/dataset.rs:288
3142024-11-01T08:18:07.827ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6b307b27-321f-475e-9d0a-7877e7e97d8e file = sled-storage/src/dataset.rs:374
3152024-11-01T08:18:07.835ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3162024-11-01T08:18:07.835ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3172024-11-01T08:18:07.835ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3182024-11-01T08:18:07.835ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192024-11-01T08:18:07.835ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3202024-11-01T08:18:07.844ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3212024-11-01T08:18:07.844ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool)
3222024-11-01T08:18:07.937ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }
3232024-11-01T08:18:07.944ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:225
3242024-11-01T08:18:07.944ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:227
3252024-11-01T08:18:07.944ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:231
3262024-11-01T08:18:07.944ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:233
3272024-11-01T08:18:07.944ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-11-01T08:18:07.944ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-11-01T08:18:07.944ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3302024-11-01T08:18:07.979ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312024-11-01T08:18:07.987ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8ced4573-45f7-474a-9fb1-aea34b9e8e79/crypt/zone file = sled-storage/src/dataset.rs:288
3322024-11-01T08:18:08.038ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f7fe3bf0-db6a-428d-8129-f334aa61483d) file = sled-agent/src/probe_manager.rs:231 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
3332024-11-01T08:18:08.156ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8ced4573-45f7-474a-9fb1-aea34b9e8e79 file = sled-storage/src/dataset.rs:374
3342024-11-01T08:18:08.164ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3352024-11-01T08:18:08.164ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3362024-11-01T08:18:08.164ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3372024-11-01T08:18:08.164ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382024-11-01T08:18:08.164ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3392024-11-01T08:18:08.173ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3402024-11-01T08:18:08.173ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool)
3412024-11-01T08:18:08.265ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }
3422024-11-01T08:18:08.272ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:225
3432024-11-01T08:18:08.272ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:227
3442024-11-01T08:18:08.272ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:231
3452024-11-01T08:18:08.272ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:233
3462024-11-01T08:18:08.272ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-11-01T08:18:08.272ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-11-01T08:18:08.272ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3492024-11-01T08:18:08.306ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-11-01T08:18:08.313ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2594f9a2-060c-4e4e-b29d-e5f6940f72cb/crypt/zone file = sled-storage/src/dataset.rs:288
3512024-11-01T08:18:08.470ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2594f9a2-060c-4e4e-b29d-e5f6940f72cb file = sled-storage/src/dataset.rs:374
3522024-11-01T08:18:08.477ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3532024-11-01T08:18:08.477ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3542024-11-01T08:18:08.477ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3552024-11-01T08:18:08.477ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562024-11-01T08:18:08.477ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3572024-11-01T08:18:08.486ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3582024-11-01T08:18:08.486ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f2d00bfb-9004-4347-be63-b51172722fd1 (zpool)
3592024-11-01T08:18:08.578ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }
3602024-11-01T08:18:08.585ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:225
3612024-11-01T08:18:08.585ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:227
3622024-11-01T08:18:08.585ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:231
3632024-11-01T08:18:08.585ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:233
3642024-11-01T08:18:08.585ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-11-01T08:18:08.585ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-11-01T08:18:08.585ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3672024-11-01T08:18:08.617ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682024-11-01T08:18:08.625ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f2d00bfb-9004-4347-be63-b51172722fd1/crypt/zone file = sled-storage/src/dataset.rs:288
3692024-11-01T08:18:08.787ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f2d00bfb-9004-4347-be63-b51172722fd1 file = sled-storage/src/dataset.rs:374
3702024-11-01T08:18:08.794ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3712024-11-01T08:18:08.794ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3722024-11-01T08:18:08.794ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3732024-11-01T08:18:08.794ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742024-11-01T08:18:08.794ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3752024-11-01T08:18:08.804ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3762024-11-01T08:18:08.804ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bc7c6e7d-afb2-4573-b1cd-22c23c48ada9 (zpool)
3772024-11-01T08:18:08.901ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: bc7c6e7d-afb2-4573-b1cd-22c23c48ada9 (zpool), kind: External }
3782024-11-01T08:18:08.909ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:225
3792024-11-01T08:18:08.909ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:227
3802024-11-01T08:18:08.909ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:231
3812024-11-01T08:18:08.909ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:233
3822024-11-01T08:18:08.909ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-11-01T08:18:08.909ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-11-01T08:18:08.909ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3852024-11-01T08:18:08.943ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862024-11-01T08:18:08.949ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bc7c6e7d-afb2-4573-b1cd-22c23c48ada9/crypt/zone file = sled-storage/src/dataset.rs:288
3872024-11-01T08:18:09.040ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f7fe3bf0-db6a-428d-8129-f334aa61483d) file = sled-agent/src/probe_manager.rs:231 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
3882024-11-01T08:18:09.123ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bc7c6e7d-afb2-4573-b1cd-22c23c48ada9 file = sled-storage/src/dataset.rs:374
3892024-11-01T08:18:09.130ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3902024-11-01T08:18:09.130ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3912024-11-01T08:18:09.130ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3922024-11-01T08:18:09.130ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932024-11-01T08:18:09.130ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3942024-11-01T08:18:09.140ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3952024-11-01T08:18:09.140ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8b236217-c0e1-4577-a9da-0a2d7b6af284 (zpool)
3962024-11-01T08:18:09.238ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 8b236217-c0e1-4577-a9da-0a2d7b6af284 (zpool), kind: External }
3972024-11-01T08:18:09.246ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:225
3982024-11-01T08:18:09.246ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:227
3992024-11-01T08:18:09.246ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:231
4002024-11-01T08:18:09.246ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:233
4012024-11-01T08:18:09.246ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-11-01T08:18:09.246ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-11-01T08:18:09.246ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4042024-11-01T08:18:09.280ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-11-01T08:18:09.288ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8b236217-c0e1-4577-a9da-0a2d7b6af284/crypt/zone file = sled-storage/src/dataset.rs:288
4062024-11-01T08:18:09.458ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8b236217-c0e1-4577-a9da-0a2d7b6af284 file = sled-storage/src/dataset.rs:374
4072024-11-01T08:18:09.466ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4082024-11-01T08:18:09.466ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4092024-11-01T08:18:09.466ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4102024-11-01T08:18:09.466ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112024-11-01T08:18:09.466ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4122024-11-01T08:18:09.475ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4132024-11-01T08:18:09.475ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fd3db670-6bf7-4efd-bc98-fba2dadc0267 (zpool)
4142024-11-01T08:18:09.568ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: fd3db670-6bf7-4efd-bc98-fba2dadc0267 (zpool), kind: External }
4152024-11-01T08:18:09.577ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:225
4162024-11-01T08:18:09.577ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:227
4172024-11-01T08:18:09.577ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:231
4182024-11-01T08:18:09.577ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:233
4192024-11-01T08:18:09.577ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-11-01T08:18:09.577ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-11-01T08:18:09.577ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4222024-11-01T08:18:09.613ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232024-11-01T08:18:09.621ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fd3db670-6bf7-4efd-bc98-fba2dadc0267/crypt/zone file = sled-storage/src/dataset.rs:288
4242024-11-01T08:18:09.785ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fd3db670-6bf7-4efd-bc98-fba2dadc0267 file = sled-storage/src/dataset.rs:374
4252024-11-01T08:18:09.792ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4262024-11-01T08:18:09.792ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4272024-11-01T08:18:09.792ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4282024-11-01T08:18:09.792ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4292024-11-01T08:18:09.792ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4302024-11-01T08:18:09.802ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4312024-11-01T08:18:09.802ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e1e3ff7c-24ad-4b58-b036-90d5df3d681f (zpool)
4322024-11-01T08:18:09.896ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: e1e3ff7c-24ad-4b58-b036-90d5df3d681f (zpool), kind: External }
4332024-11-01T08:18:09.904ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:225
4342024-11-01T08:18:09.904ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:227
4352024-11-01T08:18:09.904ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:231
4362024-11-01T08:18:09.904ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:233
4372024-11-01T08:18:09.904ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4382024-11-01T08:18:09.904ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4392024-11-01T08:18:09.904ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4402024-11-01T08:18:09.939ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4412024-11-01T08:18:09.947ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e1e3ff7c-24ad-4b58-b036-90d5df3d681f/crypt/zone file = sled-storage/src/dataset.rs:288
4422024-11-01T08:18:10.042ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f7fe3bf0-db6a-428d-8129-f334aa61483d) file = sled-agent/src/probe_manager.rs:231 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
4432024-11-01T08:18:10.120ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e1e3ff7c-24ad-4b58-b036-90d5df3d681f file = sled-storage/src/dataset.rs:374
4442024-11-01T08:18:10.128ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4452024-11-01T08:18:10.128ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4462024-11-01T08:18:10.128ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-11-01T08:18:10.128ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 437cc0f8-cee4-4fe4-a027-42fa12428505 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26aa577c-6bd9-4461-bfa2-1f0c7ce2e973 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc7c6e7d-afb2-4573-b1cd-22c23c48ada9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8b236217-c0e1-4577-a9da-0a2d7b6af284 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd3db670-6bf7-4efd-bc98-fba2dadc0267 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e1e3ff7c-24ad-4b58-b036-90d5df3d681f (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4482024-11-01T08:18:10.128ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4492024-11-01T08:18:10.128ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4502024-11-01T08:18:10.128ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4512024-11-01T08:18:10.129ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:890 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
4522024-11-01T08:18:10.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4532024-11-01T08:18:10.129ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:916 generation = Generation(1) sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
4542024-11-01T08:18:10.129ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:921 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
4552024-11-01T08:18:10.129ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:926 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
4562024-11-01T08:18:10.129ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
4572024-11-01T08:18:10.129ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:932 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
4582024-11-01T08:18:10.129ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4592024-11-01T08:18:10.129ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:937 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
4602024-11-01T08:18:10.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3668314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46970 req_id = 0a009d11-53f4-47d2-b4a7-7e08d06de867 response_code = 200 uri = /omicron-physical-disks
4612024-11-01T08:18:10.160ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 726c5ac9-9d5f-4339-8159-0a04793fd959 (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4bab0cba-a00a-4740-88aa-0040e016028d (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
4622024-11-01T08:18:10.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43120
4632024-11-01T08:18:10.161ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4642024-11-01T08:18:10.161ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }
4652024-11-01T08:18:10.208ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4662024-11-01T08:18:10.208ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }
4672024-11-01T08:18:10.253ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4682024-11-01T08:18:10.254ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4692024-11-01T08:18:10.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4702024-11-01T08:18:10.298ZINFOSledAgent (ServiceManager): No ledger in /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:188
4712024-11-01T08:18:10.298ZINFOSledAgent (ServiceManager): No ledger in /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:188
4722024-11-01T08:18:10.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4732024-11-01T08:18:10.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4742024-11-01T08:18:10.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4752024-11-01T08:18:10.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4762024-11-01T08:18:10.391ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d file = illumos-utils/src/zone.rs:325
4772024-11-01T08:18:10.395ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25 file = illumos-utils/src/zone.rs:325
4782024-11-01T08:18:10.398ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959 file = illumos-utils/src/zone.rs:325
4792024-11-01T08:18:10.411ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d file = illumos-utils/src/zone.rs:363
4802024-11-01T08:18:10.415ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25 file = illumos-utils/src/zone.rs:363
4812024-11-01T08:18:10.418ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959 file = illumos-utils/src/zone.rs:363
4822024-11-01T08:18:11.044ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f7fe3bf0-db6a-428d-8129-f334aa61483d) file = sled-agent/src/probe_manager.rs:231 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
4832024-11-01T08:18:11.934ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4842024-11-01T08:18:12.412ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4852024-11-01T08:18:12.412ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4862024-11-01T08:18:12.412ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4872024-11-01T08:18:12.892ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4882024-11-01T08:18:12.892ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
4892024-11-01T08:18:12.896ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
4902024-11-01T08:18:12.899ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4912024-11-01T08:18:12.899ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d
4922024-11-01T08:18:13.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25") failed: Property not found. retry in 61.697597ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
4932024-11-01T08:18:13.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d") failed: Property not found. retry in 63.620852ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d
4942024-11-01T08:18:13.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959") failed: Property not found. retry in 32.325348ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
4952024-11-01T08:18:13.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959") failed: Property not found. retry in 66.02186ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
4962024-11-01T08:18:13.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25") failed: Property not found. retry in 133.052072ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
4972024-11-01T08:18:13.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d") failed: Property not found. retry in 82.098903ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d
4982024-11-01T08:18:13.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25") failed: Property not found. retry in 166.046937ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
4992024-11-01T08:18:13.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959") failed: Property not found. retry in 136.723575ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
5002024-11-01T08:18:13.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d") failed: Property not found. retry in 204.291804ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d
5012024-11-01T08:18:13.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25") failed: Property not found. retry in 336.204794ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
5022024-11-01T08:18:13.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959") failed: Property not found. retry in 414.610296ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
5032024-11-01T08:18:13.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d") failed: Property not found. retry in 231.738835ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d
5042024-11-01T08:18:14.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25") failed: Property not found. retry in 601.678553ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
5052024-11-01T08:18:14.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d") failed: Property not found. retry in 1.085270702s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d
5062024-11-01T08:18:14.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959") failed: Property not found. retry in 958.822324ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
5072024-11-01T08:18:14.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25") failed: Property not found. retry in 1.472157172s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
5082024-11-01T08:18:15.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d") failed: Property not found. retry in 1.019930547s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d
5092024-11-01T08:18:15.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959") failed: Property not found. retry in 622.723042ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
5102024-11-01T08:18:15.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959") failed: Property not found. retry in 872.728929ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
5112024-11-01T08:18:15.901ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4906608592411392604 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
5122024-11-01T08:18:15.901ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12395559553821316831 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
5132024-11-01T08:18:15.930ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4254
5142024-11-01T08:18:15.930ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4264 gateway = fd00:1122:3344:101::1
5152024-11-01T08:18:15.937ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4343
5162024-11-01T08:18:16.041ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4391
5172024-11-01T08:18:16.041ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4418
5182024-11-01T08:18:16.086ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4431
5192024-11-01T08:18:16.086ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4295
5202024-11-01T08:18:16.146ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4337
5212024-11-01T08:18:16.146ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4398 rack_subnet = fd00:1122:3344::
5222024-11-01T08:18:16.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25") failed: Property not found. retry in 1.083693218s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
5232024-11-01T08:18:16.168ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4409
5242024-11-01T08:18:16.168ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4451
5252024-11-01T08:18:16.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:55129
5262024-11-01T08:18:16.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:55129 req_id = 174b8a9b-d185-4744-a3bd-04c6572b5cb1 response_code = 200 uri = /sled-identifiers
5272024-11-01T08:18:16.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d") failed: Property not found. retry in 1.397909198s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d
5282024-11-01T08:18:16.236ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4483
5292024-11-01T08:18:16.236ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4489
5302024-11-01T08:18:16.325ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4530
5312024-11-01T08:18:16.325ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5322024-11-01T08:18:16.357ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5332024-11-01T08:18:16.389ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5342024-11-01T08:18:16.389ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:724
5352024-11-01T08:18:16.390ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:727 uptime = 0
5362024-11-01T08:18:16.390ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5372024-11-01T08:18:16.425ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
5382024-11-01T08:18:16.473ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5392024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5402024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5412024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5422024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5432024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5442024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5452024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5462024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5472024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5482024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5492024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5502024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5512024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5522024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5532024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5542024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5552024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5562024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5572024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5582024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5592024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5602024-11-01T08:18:16.473ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5612024-11-01T08:18:16.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959") failed: Property not found. retry in 980.862205ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
5622024-11-01T08:18:17.037ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4464916228705759239 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
5632024-11-01T08:18:17.037ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18116858079738301630 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
5642024-11-01T08:18:17.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25") failed: Property not found. retry in 629.102049ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
5652024-11-01T08:18:17.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d") failed: Property not found. retry in 989.328809ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d
5662024-11-01T08:18:17.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959") failed: Property not found. retry in 911.53906ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
5672024-11-01T08:18:17.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25") failed: Property not found. retry in 891.987063ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
5682024-11-01T08:18:18.796ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_4bab0cba-a00a-4740-88aa-0040e016028d
5692024-11-01T08:18:18.796ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25
5702024-11-01T08:18:18.796ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_726c5ac9-9d5f-4339-8159-0a04793fd959
5712024-11-01T08:18:18.796ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5722024-11-01T08:18:18.797ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5732024-11-01T08:18:18.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8636333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43120 req_id = e4210f49-1c05-4860-bc00-b4453c721a0b response_code = 204 uri = /omicron-zones
5742024-11-01T08:18:18.799ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5752024-11-01T08:18:18.925ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 100.177344ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:596
5762024-11-01T08:18:19.044ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5772024-11-01T08:18:19.092ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5782024-11-01T08:18:19.139ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:612
5792024-11-01T08:18:19.139ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5802024-11-01T08:18:19.171ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5812024-11-01T08:18:19.172ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5822024-11-01T08:18:19.172ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5832024-11-01T08:18:19.201ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 726c5ac9-9d5f-4339-8159-0a04793fd959 (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4bab0cba-a00a-4740-88aa-0040e016028d (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b147fa7f-3428-4120-b9b6-e7400f1abc34, kind: Service { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f }, name: Name("ntp-96a31375-0890-4f8c-8a97-514c48ef1c2f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 110])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
5842024-11-01T08:18:19.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41465
5852024-11-01T08:18:19.201ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5862024-11-01T08:18:19.201ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }
5872024-11-01T08:18:19.221ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5882024-11-01T08:18:19.221ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }
5892024-11-01T08:18:19.239ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5902024-11-01T08:18:19.239ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5912024-11-01T08:18:19.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5922024-11-01T08:18:19.257ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
5932024-11-01T08:18:19.257ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
5942024-11-01T08:18:19.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5952024-11-01T08:18:19.269ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5962024-11-01T08:18:19.301ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5972024-11-01T08:18:19.302ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5982024-11-01T08:18:19.302ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5992024-11-01T08:18:19.331ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 214, 110]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
6002024-11-01T08:18:19.331ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = boundary_ntp
6012024-11-01T08:18:19.332ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
6022024-11-01T08:18:19.332ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
6032024-11-01T08:18:19.332ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
6042024-11-01T08:18:19.334ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6052024-11-01T08:18:19.359ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f file = illumos-utils/src/zone.rs:325
6062024-11-01T08:18:19.376ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f file = illumos-utils/src/zone.rs:363
6072024-11-01T08:18:20.002ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6082024-11-01T08:18:20.002ZINFOSledAgent (ServiceManager): Booting oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6092024-11-01T08:18:20.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f") failed: Property not found. retry in 50.004552ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6102024-11-01T08:18:20.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f") failed: Property not found. retry in 96.804371ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6112024-11-01T08:18:20.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f") failed: Property not found. retry in 193.628839ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6122024-11-01T08:18:20.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f") failed: Property not found. retry in 432.480975ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6132024-11-01T08:18:20.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f") failed: Property not found. retry in 622.039251ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6142024-11-01T08:18:21.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f") failed: Property not found. retry in 757.41439ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6152024-11-01T08:18:22.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f") failed: Property not found. retry in 765.341479ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6162024-11-01T08:18:23.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f") failed: Property not found. retry in 1.17744991s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6172024-11-01T08:18:24.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f") failed: Property not found. retry in 1.170344372s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6182024-11-01T08:18:25.529ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f
6192024-11-01T08:18:25.529ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6202024-11-01T08:18:25.529ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6212024-11-01T08:18:25.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6328784 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41465 req_id = 20743632-ad07-4a9b-bce1-254e79c025dd response_code = 204 uri = /omicron-zones
6222024-11-01T08:18:25.532ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:653
6232024-11-01T08:18:25.562ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6242024-11-01T08:18:25.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33140
6252024-11-01T08:18:25.570ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6262024-11-01T08:18:25.570ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8508 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33140 req_id = eb197de0-0ebf-42c0-bd5d-8f87224513e2 response_code = 500 uri = /timesync
6272024-11-01T08:18:25.573ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6282024-11-01T08:18:25.721ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6292024-11-01T08:18:25.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38142
6302024-11-01T08:18:25.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4906608592411392604 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
6312024-11-01T08:18:25.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12395559553821316831 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
6322024-11-01T08:18:27.039ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4464916228705759239 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
6332024-11-01T08:18:27.039ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18116858079738301630 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
6342024-11-01T08:18:28.624ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10518976386191550302 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
6352024-11-01T08:18:28.628ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16875054237975220264 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
6362024-11-01T08:18:28.800ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11895048710487218110 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
6372024-11-01T08:18:29.730ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6382024-11-01T08:18:29.730ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008694 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38142 req_id = eb889c7b-131b-4bbf-a52e-70efe3825e77 response_code = 500 uri = /timesync
6392024-11-01T08:18:29.732ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6402024-11-01T08:18:29.899ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6412024-11-01T08:18:29.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51464
6422024-11-01T08:18:29.908ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6432024-11-01T08:18:29.908ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8629 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51464 req_id = cc5ee3c0-a3f9-47ff-afca-1593879c24c5 response_code = 500 uri = /timesync
6442024-11-01T08:18:29.911ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6452024-11-01T08:18:30.078ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6462024-11-01T08:18:30.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47344
6472024-11-01T08:18:33.718ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_96a31375-0890-4f8c-8a97-514c48ef1c2f': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6482024-11-01T08:18:33.719ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4009095 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47344 req_id = 15b8cac3-638c-45d6-b2d2-e87c3529d50c response_code = 500 uri = /timesync
6492024-11-01T08:18:33.721ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6502024-11-01T08:18:33.923ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6512024-11-01T08:18:33.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47579
6522024-11-01T08:18:33.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8634 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47579 req_id = 13a198ee-ab66-4ea1-bcda-cd2b7ff04c6c response_code = 200 uri = /timesync
6532024-11-01T08:18:33.936ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.000363835 } file = sled-agent/src/rack_setup/service.rs:661
6542024-11-01T08:18:33.936ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6552024-11-01T08:18:34.220ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 148.909241ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
6562024-11-01T08:18:34.263ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6572024-11-01T08:18:34.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56641
6582024-11-01T08:18:34.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 23962 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56641 req_id = cbfde9cd-09d5-4e9a-a78d-66eff8906a17 response_code = 200 uri = /timesync
6592024-11-01T08:18:34.291ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730449113.9066849, correction: -0.0016763 } file = sled-agent/src/rack_setup/service.rs:661
6602024-11-01T08:18:34.291ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1299
6612024-11-01T08:18:34.321ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 726c5ac9-9d5f-4339-8159-0a04793fd959 (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4bab0cba-a00a-4740-88aa-0040e016028d (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b147fa7f-3428-4120-b9b6-e7400f1abc34, kind: Service { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f }, name: Name("ntp-96a31375-0890-4f8c-8a97-514c48ef1c2f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 110])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } } } }, OmicronZoneConfig { id: d588b3ca-163c-4422-b2d3-241b3d44c0ef (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } } } }, OmicronZoneConfig { id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618 (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } } } }, OmicronZoneConfig { id: 69997811-f894-47fe-abc7-e42112788355 (service), filesystem_pool: Some(ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External } } } }, OmicronZoneConfig { id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b (service), filesystem_pool: Some(ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
6622024-11-01T08:18:34.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58959
6632024-11-01T08:18:34.321ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6642024-11-01T08:18:34.321ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652024-11-01T08:18:34.342ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6662024-11-01T08:18:34.342ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }
6672024-11-01T08:18:34.361ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6682024-11-01T08:18:34.361ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6692024-11-01T08:18:34.379ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6702024-11-01T08:18:34.379ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Cockroach }, responder: ... }
6712024-11-01T08:18:34.432ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d588b3ca-163c-4422-b2d3-241b3d44c0ef, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6722024-11-01T08:18:34.432ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d588b3ca-163c-4422-b2d3-241b3d44c0ef, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Cockroach }, responder: ... }
6732024-11-01T08:18:34.482ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6742024-11-01T08:18:34.482ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Cockroach }, responder: ... }
6752024-11-01T08:18:34.542ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69997811-f894-47fe-abc7-e42112788355, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6762024-11-01T08:18:34.542ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 69997811-f894-47fe-abc7-e42112788355, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Cockroach }, responder: ... }
6772024-11-01T08:18:34.593ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6782024-11-01T08:18:34.593ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
6792024-11-01T08:18:34.643ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6802024-11-01T08:18:34.643ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
6812024-11-01T08:18:34.643ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
6822024-11-01T08:18:34.643ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6832024-11-01T08:18:34.675ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
6842024-11-01T08:18:34.675ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
6852024-11-01T08:18:34.675ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
6862024-11-01T08:18:34.675ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
6872024-11-01T08:18:34.675ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
6882024-11-01T08:18:34.675ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b", TimeNotSynchronized), ("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97", TimeNotSynchronized), ("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618", TimeNotSynchronized), ("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355", TimeNotSynchronized), ("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 354752 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58959 req_id = c7151e6f-05e9-49a3-a463-4159d1ac4c26 response_code = 500 uri = /omicron-zones
6892024-11-01T08:18:34.676ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c7151e6f-05e9-49a3-a463-4159d1ac4c26", "content-length": "124", "date": "Fri, 01 Nov 2024 08:18:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c7151e6f-05e9-49a3-a463-4159d1ac4c26" } file = sled-agent/src/rack_setup/service.rs:496 retry_after = 93.792255ms sled_address = [fd00:1122:3344:101::1]:12345
6902024-11-01T08:18:34.771ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 726c5ac9-9d5f-4339-8159-0a04793fd959 (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4bab0cba-a00a-4740-88aa-0040e016028d (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b147fa7f-3428-4120-b9b6-e7400f1abc34, kind: Service { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f }, name: Name("ntp-96a31375-0890-4f8c-8a97-514c48ef1c2f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 110])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } } } }, OmicronZoneConfig { id: d588b3ca-163c-4422-b2d3-241b3d44c0ef (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } } } }, OmicronZoneConfig { id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618 (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } } } }, OmicronZoneConfig { id: 69997811-f894-47fe-abc7-e42112788355 (service), filesystem_pool: Some(ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External } } } }, OmicronZoneConfig { id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b (service), filesystem_pool: Some(ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
6912024-11-01T08:18:34.771ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6922024-11-01T08:18:34.771ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6932024-11-01T08:18:34.789ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6942024-11-01T08:18:34.789ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }
6952024-11-01T08:18:34.807ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
6962024-11-01T08:18:34.807ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6972024-11-01T08:18:34.825ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
6982024-11-01T08:18:34.825ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Cockroach }, responder: ... }
6992024-11-01T08:18:34.842ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d588b3ca-163c-4422-b2d3-241b3d44c0ef, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7002024-11-01T08:18:34.843ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d588b3ca-163c-4422-b2d3-241b3d44c0ef, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Cockroach }, responder: ... }
7012024-11-01T08:18:34.860ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7022024-11-01T08:18:34.860ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7032024-11-01T08:18:34.877ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69997811-f894-47fe-abc7-e42112788355, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7042024-11-01T08:18:34.878ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 69997811-f894-47fe-abc7-e42112788355, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Cockroach }, responder: ... }
7052024-11-01T08:18:34.895ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7062024-11-01T08:18:34.895ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7072024-11-01T08:18:34.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7082024-11-01T08:18:34.913ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
7092024-11-01T08:18:34.913ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
7102024-11-01T08:18:34.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7112024-11-01T08:18:34.946ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
7122024-11-01T08:18:34.946ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
7132024-11-01T08:18:34.946ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
7142024-11-01T08:18:34.946ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
7152024-11-01T08:18:34.946ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
7162024-11-01T08:18:34.946ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef", TimeNotSynchronized), ("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355", TimeNotSynchronized), ("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b", TimeNotSynchronized), ("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97", TimeNotSynchronized), ("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 175244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58959 req_id = 02e0c5f6-6f08-4d0b-8227-8eab6c4900aa response_code = 500 uri = /omicron-zones
7172024-11-01T08:18:34.946ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "02e0c5f6-6f08-4d0b-8227-8eab6c4900aa", "content-length": "124", "date": "Fri, 01 Nov 2024 08:18:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "02e0c5f6-6f08-4d0b-8227-8eab6c4900aa" } file = sled-agent/src/rack_setup/service.rs:496 retry_after = 68.401308ms sled_address = [fd00:1122:3344:101::1]:12345
7182024-11-01T08:18:35.015ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 726c5ac9-9d5f-4339-8159-0a04793fd959 (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4bab0cba-a00a-4740-88aa-0040e016028d (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b147fa7f-3428-4120-b9b6-e7400f1abc34, kind: Service { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f }, name: Name("ntp-96a31375-0890-4f8c-8a97-514c48ef1c2f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 110])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } } } }, OmicronZoneConfig { id: d588b3ca-163c-4422-b2d3-241b3d44c0ef (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } } } }, OmicronZoneConfig { id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618 (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } } } }, OmicronZoneConfig { id: 69997811-f894-47fe-abc7-e42112788355 (service), filesystem_pool: Some(ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External } } } }, OmicronZoneConfig { id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b (service), filesystem_pool: Some(ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
7192024-11-01T08:18:35.016ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7202024-11-01T08:18:35.016ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7212024-11-01T08:18:35.034ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7222024-11-01T08:18:35.034ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }
7232024-11-01T08:18:35.051ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7242024-11-01T08:18:35.051ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7252024-11-01T08:18:35.069ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7262024-11-01T08:18:35.069ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Cockroach }, responder: ... }
7272024-11-01T08:18:35.084ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d588b3ca-163c-4422-b2d3-241b3d44c0ef, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7282024-11-01T08:18:35.084ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d588b3ca-163c-4422-b2d3-241b3d44c0ef, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Cockroach }, responder: ... }
7292024-11-01T08:18:35.102ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7302024-11-01T08:18:35.102ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7312024-11-01T08:18:35.119ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69997811-f894-47fe-abc7-e42112788355, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7322024-11-01T08:18:35.119ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 69997811-f894-47fe-abc7-e42112788355, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Cockroach }, responder: ... }
7332024-11-01T08:18:35.135ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7342024-11-01T08:18:35.135ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7352024-11-01T08:18:35.152ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7362024-11-01T08:18:35.152ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
7372024-11-01T08:18:35.153ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
7382024-11-01T08:18:35.153ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7392024-11-01T08:18:35.184ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
7402024-11-01T08:18:35.184ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
7412024-11-01T08:18:35.184ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
7422024-11-01T08:18:35.184ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
7432024-11-01T08:18:35.184ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3277 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
7442024-11-01T08:18:35.184ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b", TimeNotSynchronized), ("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97", TimeNotSynchronized), ("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355", TimeNotSynchronized), ("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618", TimeNotSynchronized), ("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 168595 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58959 req_id = b3db8adb-efe0-40a1-a320-36bf16092d16 response_code = 500 uri = /omicron-zones
7452024-11-01T08:18:35.184ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b3db8adb-efe0-40a1-a320-36bf16092d16", "content-length": "124", "date": "Fri, 01 Nov 2024 08:18:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b3db8adb-efe0-40a1-a320-36bf16092d16" } file = sled-agent/src/rack_setup/service.rs:496 retry_after = 87.769175ms sled_address = [fd00:1122:3344:101::1]:12345
7462024-11-01T08:18:35.273ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 726c5ac9-9d5f-4339-8159-0a04793fd959 (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4bab0cba-a00a-4740-88aa-0040e016028d (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b147fa7f-3428-4120-b9b6-e7400f1abc34, kind: Service { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f }, name: Name("ntp-96a31375-0890-4f8c-8a97-514c48ef1c2f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 110])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } } } }, OmicronZoneConfig { id: d588b3ca-163c-4422-b2d3-241b3d44c0ef (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } } } }, OmicronZoneConfig { id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618 (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } } } }, OmicronZoneConfig { id: 69997811-f894-47fe-abc7-e42112788355 (service), filesystem_pool: Some(ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External } } } }, OmicronZoneConfig { id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b (service), filesystem_pool: Some(ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
7472024-11-01T08:18:35.273ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7482024-11-01T08:18:35.273ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7492024-11-01T08:18:35.292ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7502024-11-01T08:18:35.292ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }
7512024-11-01T08:18:35.309ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
7522024-11-01T08:18:35.309ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7532024-11-01T08:18:35.326ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7542024-11-01T08:18:35.326ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Cockroach }, responder: ... }
7552024-11-01T08:18:35.344ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d588b3ca-163c-4422-b2d3-241b3d44c0ef, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7562024-11-01T08:18:35.344ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d588b3ca-163c-4422-b2d3-241b3d44c0ef, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Cockroach }, responder: ... }
7572024-11-01T08:18:35.362ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7582024-11-01T08:18:35.362ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7592024-11-01T08:18:35.380ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69997811-f894-47fe-abc7-e42112788355, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7602024-11-01T08:18:35.380ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 69997811-f894-47fe-abc7-e42112788355, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Cockroach }, responder: ... }
7612024-11-01T08:18:35.398ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
7622024-11-01T08:18:35.398ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
7632024-11-01T08:18:35.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7642024-11-01T08:18:35.416ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
7652024-11-01T08:18:35.416ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
7662024-11-01T08:18:35.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7672024-11-01T08:18:35.500ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7682024-11-01T08:18:35.500ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7692024-11-01T08:18:35.500ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7702024-11-01T08:18:35.500ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7712024-11-01T08:18:35.500ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
7722024-11-01T08:18:35.582ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618 file = illumos-utils/src/zone.rs:325
7732024-11-01T08:18:35.586ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97 file = illumos-utils/src/zone.rs:325
7742024-11-01T08:18:35.590ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef file = illumos-utils/src/zone.rs:325
7752024-11-01T08:18:35.594ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355 file = illumos-utils/src/zone.rs:325
7762024-11-01T08:18:35.598ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b file = illumos-utils/src/zone.rs:325
7772024-11-01T08:18:35.603ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618 file = illumos-utils/src/zone.rs:363
7782024-11-01T08:18:35.607ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97 file = illumos-utils/src/zone.rs:363
7792024-11-01T08:18:35.611ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef file = illumos-utils/src/zone.rs:363
7802024-11-01T08:18:35.616ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355 file = illumos-utils/src/zone.rs:363
7812024-11-01T08:18:35.621ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b file = illumos-utils/src/zone.rs:363
7822024-11-01T08:18:38.463ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2d5b3dd9-0b90-4f50-9390-f13ea5e12c97'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7832024-11-01T08:18:38.463ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
7842024-11-01T08:18:38.468ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d588b3ca-163c-4422-b2d3-241b3d44c0ef'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7852024-11-01T08:18:38.468ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
7862024-11-01T08:18:38.521ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d8a6e4a9-9e45-4c06-b98c-77d8196e707b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7872024-11-01T08:18:38.522ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
7882024-11-01T08:18:38.528ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='69997811-f894-47fe-abc7-e42112788355'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7892024-11-01T08:18:38.528ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
7902024-11-01T08:18:38.571ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7912024-11-01T08:18:38.571ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
7922024-11-01T08:18:38.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 60.112434ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
7932024-11-01T08:18:38.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 36.891471ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
7942024-11-01T08:18:38.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 27.810051ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
7952024-11-01T08:18:38.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 137.820649ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
7962024-11-01T08:18:38.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 44.260824ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
7972024-11-01T08:18:38.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 57.451414ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
7982024-11-01T08:18:38.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 96.176114ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
7992024-11-01T08:18:39.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 63.618412ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8002024-11-01T08:18:39.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 119.203529ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8012024-11-01T08:18:39.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 170.691687ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8022024-11-01T08:18:39.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 120.561476ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8032024-11-01T08:18:39.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 220.739858ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8042024-11-01T08:18:39.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 71.063892ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8052024-11-01T08:18:40.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 242.006179ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8062024-11-01T08:18:40.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 512.038025ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8072024-11-01T08:18:40.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 236.612978ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8082024-11-01T08:18:40.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 368.143012ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8092024-11-01T08:18:40.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 159.967376ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8102024-11-01T08:18:41.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 1.114421862s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8112024-11-01T08:18:41.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 1.029873543s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8122024-11-01T08:18:41.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 461.545318ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8132024-11-01T08:18:41.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 456.768282ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8142024-11-01T08:18:41.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 644.385974ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8152024-11-01T08:18:41.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 548.497212ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8162024-11-01T08:18:41.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 1.126727724s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8172024-11-01T08:18:41.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 857.815951ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8182024-11-01T08:18:42.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 1.236218807s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8192024-11-01T08:18:42.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 830.552558ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8202024-11-01T08:18:42.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 1.491294282s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8212024-11-01T08:18:42.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 1.022598253s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8222024-11-01T08:18:42.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 767.669743ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8232024-11-01T08:18:43.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 1.13113609s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8242024-11-01T08:18:43.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 1.252319782s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8252024-11-01T08:18:43.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 1.315025099s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8262024-11-01T08:18:43.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 968.227984ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8272024-11-01T08:18:43.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 1.384067234s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8282024-11-01T08:18:44.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 1.153905307s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8292024-11-01T08:18:44.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 1.283620715s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8302024-11-01T08:18:44.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 918.816338ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8312024-11-01T08:18:44.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 984.657801ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8322024-11-01T08:18:45.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 1.362137016s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8332024-11-01T08:18:45.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 982.494194ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8342024-11-01T08:18:45.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 681.457637ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8352024-11-01T08:18:45.759ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42528
8362024-11-01T08:18:45.760ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42528 req_id = d9dc8efd-61f8-4a15-b6a0-724fd99fab1e response_code = 200 uri = /baseboard
8372024-11-01T08:18:45.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 1.40191128s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8382024-11-01T08:18:45.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 680.150177ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8392024-11-01T08:18:46.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 858.708238ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8402024-11-01T08:18:46.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 860.538834ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8412024-11-01T08:18:46.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 1.300478799s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8422024-11-01T08:18:46.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 1.440167771s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8432024-11-01T08:18:47.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 1.106243293s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8442024-11-01T08:18:47.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 1.354553717s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8452024-11-01T08:18:47.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 785.020055ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8462024-11-01T08:18:47.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 1.49983651s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8472024-11-01T08:18:48.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 1.079666466s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8482024-11-01T08:18:48.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 684.88349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8492024-11-01T08:18:48.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 1.455761548s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8502024-11-01T08:18:48.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 1.118407323s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8512024-11-01T08:18:48.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 888.257202ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8522024-11-01T08:18:49.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 756.464207ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8532024-11-01T08:18:49.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 804.45277ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8542024-11-01T08:18:49.419ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 610.80776ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
8552024-11-01T08:18:49.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 672.755196ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8562024-11-01T08:18:49.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 1.006073167s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8572024-11-01T08:18:49.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 671.538877ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8582024-11-01T08:18:49.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 1.327687471s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8592024-11-01T08:18:50.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 1.163453179s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8602024-11-01T08:18:50.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 1.17634501s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8612024-11-01T08:18:50.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 1.308483386s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8622024-11-01T08:18:50.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 575.09484ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8632024-11-01T08:18:51.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 717.123652ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8642024-11-01T08:18:51.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 673.330118ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8652024-11-01T08:18:51.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 1.018440504s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8662024-11-01T08:18:51.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 1.299894103s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8672024-11-01T08:18:51.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 1.265039303s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8682024-11-01T08:18:51.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 992.501858ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8692024-11-01T08:18:52.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 1.488011617s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8702024-11-01T08:18:52.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 692.531186ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8712024-11-01T08:18:52.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 706.831187ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8722024-11-01T08:18:52.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 712.311176ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8732024-11-01T08:18:53.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 596.389931ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8742024-11-01T08:18:53.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 582.483603ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8752024-11-01T08:18:53.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 512.926099ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8762024-11-01T08:18:53.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 604.06883ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8772024-11-01T08:18:53.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 980.964417ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8782024-11-01T08:18:53.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b") failed: Property not found. retry in 845.779384ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8792024-11-01T08:18:53.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef") failed: Property not found. retry in 1.474925902s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8802024-11-01T08:18:54.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618") failed: Property not found. retry in 1.461314647s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8812024-11-01T08:18:54.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355") failed: Property not found. retry in 529.791347ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8822024-11-01T08:18:54.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 1.385010299s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8832024-11-01T08:18:56.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 704.71767ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8842024-11-01T08:18:56.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 946.640565ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8852024-11-01T08:18:58.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 1.317538711s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8862024-11-01T08:18:59.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 1.419907924s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8872024-11-01T08:19:00.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 561.893928ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8882024-11-01T08:19:01.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 1.496261856s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8892024-11-01T08:19:02.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 828.859024ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8902024-11-01T08:19:03.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97") failed: Property not found. retry in 888.68383ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8912024-11-01T08:19:04.659ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618
8922024-11-01T08:19:04.659ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_2d5b3dd9-0b90-4f50-9390-f13ea5e12c97
8932024-11-01T08:19:04.659ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_d588b3ca-163c-4422-b2d3-241b3d44c0ef
8942024-11-01T08:19:04.659ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_69997811-f894-47fe-abc7-e42112788355
8952024-11-01T08:19:04.659ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_d8a6e4a9-9e45-4c06-b98c-77d8196e707b
8962024-11-01T08:19:04.659ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8972024-11-01T08:19:04.666ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8982024-11-01T08:19:04.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29534604 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58959 req_id = b43fb49b-1a55-457c-98f8-5fa7336cb21a response_code = 204 uri = /omicron-zones
8992024-11-01T08:19:04.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54056
9002024-11-01T08:19:05.228ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3705
9012024-11-01T08:19:16.526ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3723
9022024-11-01T08:19:20.416ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3746
9032024-11-01T08:19:20.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 15576226 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:54056 req_id = 01d924bf-7820-447d-8d76-8d66ebd2b5ac response_code = 204 uri = /cockroachdb
9042024-11-01T08:19:20.416ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56225
9052024-11-01T08:19:20.417ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56225 req_id = cfb3d715-5e66-41e9-a63c-01ebb9efd068 response_code = 200 uri = /baseboard
9062024-11-01T08:19:20.421ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 999.539825ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
9072024-11-01T08:19:20.451ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 726c5ac9-9d5f-4339-8159-0a04793fd959 (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4bab0cba-a00a-4740-88aa-0040e016028d (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b147fa7f-3428-4120-b9b6-e7400f1abc34, kind: Service { id: 96a31375-0890-4f8c-8a97-514c48ef1c2f }, name: Name("ntp-96a31375-0890-4f8c-8a97-514c48ef1c2f"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 110])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } } } }, OmicronZoneConfig { id: d588b3ca-163c-4422-b2d3-241b3d44c0ef (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } } } }, OmicronZoneConfig { id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618 (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } } } }, OmicronZoneConfig { id: 69997811-f894-47fe-abc7-e42112788355 (service), filesystem_pool: Some(ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External } } } }, OmicronZoneConfig { id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b (service), filesystem_pool: Some(ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External } } } }, OmicronZoneConfig { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: b67ad34e-9649-4b18-90ef-aca56d949585 (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 (service), filesystem_pool: Some(ZpoolName { id: e1e3ff7c-24ad-4b58-b036-90d5df3d681f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 05b98a5a-6633-46a8-a87e-d44dea0d2ec7 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: ae5d1094-15ea-4074-8704-b606ab48ccac (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } } } }, OmicronZoneConfig { id: 8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2 (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 79a3b8c3-61e7-47ce-b115-28a92b208638 (service), filesystem_pool: Some(ZpoolName { id: 8b236217-c0e1-4577-a9da-0a2d7b6af284 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 3d9e6fd8-adcb-46a4-a34d-929b7235144a (service), filesystem_pool: Some(ZpoolName { id: fd3db670-6bf7-4efd-bc98-fba2dadc0267 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: fe67150d-6875-4360-bf6e-e262996f9543 (service), filesystem_pool: Some(ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External } } } }, OmicronZoneConfig { id: e435841f-5e20-4041-aa3b-c234ef351e0a (service), filesystem_pool: Some(ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External } } } }, OmicronZoneConfig { id: 70adb8a4-b4de-470e-a9cd-b7e15e8f2e47 (service), filesystem_pool: Some(ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External } } } }, OmicronZoneConfig { id: d6343cf3-f536-4ba8-a489-7150c54b7be8 (service), filesystem_pool: Some(ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ce66874-ebff-468e-b086-ca55340137cd (service), filesystem_pool: Some(ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 966837d7-ea0d-4f7f-a324-1c89432bce5c (service), filesystem_pool: Some(ZpoolName { id: bc7c6e7d-afb2-4573-b1cd-22c23c48ada9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bc7c6e7d-afb2-4573-b1cd-22c23c48ada9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 008b0fa0-1d76-43e3-9519-e9769510dac0 (service), filesystem_pool: Some(ZpoolName { id: 8b236217-c0e1-4577-a9da-0a2d7b6af284 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8b236217-c0e1-4577-a9da-0a2d7b6af284 (zpool), kind: External } } } }, OmicronZoneConfig { id: abcb146b-e795-4408-a210-21319df4b1af (service), filesystem_pool: Some(ZpoolName { id: fd3db670-6bf7-4efd-bc98-fba2dadc0267 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3db670-6bf7-4efd-bc98-fba2dadc0267 (zpool), kind: External } } } }, OmicronZoneConfig { id: 03217bb0-0fbb-409a-bbf8-5e8a11da3eb8 (service), filesystem_pool: Some(ZpoolName { id: e1e3ff7c-24ad-4b58-b036-90d5df3d681f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e1e3ff7c-24ad-4b58-b036-90d5df3d681f (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
9082024-11-01T08:19:20.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49521
9092024-11-01T08:19:20.451ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9102024-11-01T08:19:20.451ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8d7ca3b6-9a19-40f1-b9c4-6bf04dc76c25, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: InternalDns }, responder: ... }
9112024-11-01T08:19:20.475ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9122024-11-01T08:19:20.475ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 726c5ac9-9d5f-4339-8159-0a04793fd959, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: InternalDns }, responder: ... }
9132024-11-01T08:19:20.494ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9142024-11-01T08:19:20.494ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 4bab0cba-a00a-4740-88aa-0040e016028d, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9152024-11-01T08:19:20.513ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9162024-11-01T08:19:20.513ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2d5b3dd9-0b90-4f50-9390-f13ea5e12c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Cockroach }, responder: ... }
9172024-11-01T08:19:20.531ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d588b3ca-163c-4422-b2d3-241b3d44c0ef, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9182024-11-01T08:19:20.531ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d588b3ca-163c-4422-b2d3-241b3d44c0ef, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Cockroach }, responder: ... }
9192024-11-01T08:19:20.549ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9202024-11-01T08:19:20.549ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e7f0d3f-d58b-4ff8-ad06-9ef6a0e12618, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9212024-11-01T08:19:20.566ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69997811-f894-47fe-abc7-e42112788355, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9222024-11-01T08:19:20.566ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 69997811-f894-47fe-abc7-e42112788355, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Cockroach }, responder: ... }
9232024-11-01T08:19:20.585ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
9242024-11-01T08:19:20.585ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d8a6e4a9-9e45-4c06-b98c-77d8196e707b, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9252024-11-01T08:19:20.604ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f5a9d05d-8509-4c10-96d8-97ac84fede0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9262024-11-01T08:19:20.605ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f5a9d05d-8509-4c10-96d8-97ac84fede0f, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9272024-11-01T08:19:20.740ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
9282024-11-01T08:19:20.740ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9292024-11-01T08:19:20.839ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ae5d1094-15ea-4074-8704-b606ab48ccac, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
9302024-11-01T08:19:20.839ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: ae5d1094-15ea-4074-8704-b606ab48ccac, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9312024-11-01T08:19:20.945ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fe67150d-6875-4360-bf6e-e262996f9543, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9322024-11-01T08:19:20.945ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: fe67150d-6875-4360-bf6e-e262996f9543, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c13d012-7fe1-48a4-8f49-bd4b8f1c925d (zpool), kind: External }, kind: Crucible }, responder: ... }
9332024-11-01T08:19:21.023ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e435841f-5e20-4041-aa3b-c234ef351e0a, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9342024-11-01T08:19:21.023ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: e435841f-5e20-4041-aa3b-c234ef351e0a, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b307b27-321f-475e-9d0a-7877e7e97d8e (zpool), kind: External }, kind: Crucible }, responder: ... }
9352024-11-01T08:19:21.097ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 70adb8a4-b4de-470e-a9cd-b7e15e8f2e47, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9362024-11-01T08:19:21.097ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 70adb8a4-b4de-470e-a9cd-b7e15e8f2e47, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ced4573-45f7-474a-9fb1-aea34b9e8e79 (zpool), kind: External }, kind: Crucible }, responder: ... }
9372024-11-01T08:19:21.220ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d6343cf3-f536-4ba8-a489-7150c54b7be8, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9382024-11-01T08:19:21.220ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d6343cf3-f536-4ba8-a489-7150c54b7be8, dataset_name: DatasetName { pool_name: ZpoolName { id: 2594f9a2-060c-4e4e-b29d-e5f6940f72cb (zpool), kind: External }, kind: Crucible }, responder: ... }
9392024-11-01T08:19:21.301ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5ce66874-ebff-468e-b086-ca55340137cd, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9402024-11-01T08:19:21.301ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 5ce66874-ebff-468e-b086-ca55340137cd, dataset_name: DatasetName { pool_name: ZpoolName { id: f2d00bfb-9004-4347-be63-b51172722fd1 (zpool), kind: External }, kind: Crucible }, responder: ... }
9412024-11-01T08:19:21.385ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 966837d7-ea0d-4f7f-a324-1c89432bce5c, dataset_name: DatasetName { pool_name: ZpoolName { id: bc7c6e7d-afb2-4573-b1cd-22c23c48ada9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9422024-11-01T08:19:21.385ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 966837d7-ea0d-4f7f-a324-1c89432bce5c, dataset_name: DatasetName { pool_name: ZpoolName { id: bc7c6e7d-afb2-4573-b1cd-22c23c48ada9 (zpool), kind: External }, kind: Crucible }, responder: ... }
9432024-11-01T08:19:21.466ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 008b0fa0-1d76-43e3-9519-e9769510dac0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8b236217-c0e1-4577-a9da-0a2d7b6af284 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9442024-11-01T08:19:21.466ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 008b0fa0-1d76-43e3-9519-e9769510dac0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8b236217-c0e1-4577-a9da-0a2d7b6af284 (zpool), kind: External }, kind: Crucible }, responder: ... }
9452024-11-01T08:19:21.548ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: abcb146b-e795-4408-a210-21319df4b1af, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3db670-6bf7-4efd-bc98-fba2dadc0267 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9462024-11-01T08:19:21.548ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: abcb146b-e795-4408-a210-21319df4b1af, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3db670-6bf7-4efd-bc98-fba2dadc0267 (zpool), kind: External }, kind: Crucible }, responder: ... }
9472024-11-01T08:19:21.620ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 03217bb0-0fbb-409a-bbf8-5e8a11da3eb8, dataset_name: DatasetName { pool_name: ZpoolName { id: e1e3ff7c-24ad-4b58-b036-90d5df3d681f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
9482024-11-01T08:19:21.620ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 03217bb0-0fbb-409a-bbf8-5e8a11da3eb8, dataset_name: DatasetName { pool_name: ZpoolName { id: e1e3ff7c-24ad-4b58-b036-90d5df3d681f (zpool), kind: External }, kind: Crucible }, responder: ... }
9492024-11-01T08:19:21.696ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9502024-11-01T08:19:21.696ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
9512024-11-01T08:19:21.696ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
9522024-11-01T08:19:21.696ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9532024-11-01T08:19:21.806ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9542024-11-01T08:19:21.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9552024-11-01T08:19:21.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9562024-11-01T08:19:21.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9572024-11-01T08:19:21.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9582024-11-01T08:19:21.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9592024-11-01T08:19:21.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9602024-11-01T08:19:21.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9612024-11-01T08:19:21.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9622024-11-01T08:19:21.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9632024-11-01T08:19:22.076ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9642024-11-01T08:19:22.077ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9652024-11-01T08:19:22.090ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9662024-11-01T08:19:22.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9672024-11-01T08:19:22.106ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
9682024-11-01T08:19:22.106ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9692024-11-01T08:19:22.130ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9702024-11-01T08:19:22.130ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9712024-11-01T08:19:22.130ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
9722024-11-01T08:19:22.131ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c file = illumos-utils/src/zone.rs:325
9732024-11-01T08:19:22.135ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2 file = illumos-utils/src/zone.rs:325
9742024-11-01T08:19:22.140ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47 file = illumos-utils/src/zone.rs:325
9752024-11-01T08:19:22.145ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac file = illumos-utils/src/zone.rs:325
9762024-11-01T08:19:22.150ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638 file = illumos-utils/src/zone.rs:325
9772024-11-01T08:19:22.155ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0 file = illumos-utils/src/zone.rs:325
9782024-11-01T08:19:22.160ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd file = illumos-utils/src/zone.rs:325
9792024-11-01T08:19:22.165ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8 file = illumos-utils/src/zone.rs:325
9802024-11-01T08:19:22.170ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a file = illumos-utils/src/zone.rs:325
9812024-11-01T08:19:22.267ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c file = illumos-utils/src/zone.rs:363
9822024-11-01T08:19:22.273ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2 file = illumos-utils/src/zone.rs:363
9832024-11-01T08:19:22.278ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47 file = illumos-utils/src/zone.rs:363
9842024-11-01T08:19:22.283ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac file = illumos-utils/src/zone.rs:363
9852024-11-01T08:19:22.287ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638 file = illumos-utils/src/zone.rs:363
9862024-11-01T08:19:22.292ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0 file = illumos-utils/src/zone.rs:363
9872024-11-01T08:19:22.297ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd file = illumos-utils/src/zone.rs:363
9882024-11-01T08:19:22.302ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8 file = illumos-utils/src/zone.rs:363
9892024-11-01T08:19:22.307ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a file = illumos-utils/src/zone.rs:363
9902024-11-01T08:19:22.312ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af file = illumos-utils/src/zone.rs:325
9912024-11-01T08:19:22.318ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = illumos-utils/src/zone.rs:325
9922024-11-01T08:19:22.323ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a file = illumos-utils/src/zone.rs:325
9932024-11-01T08:19:22.328ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543 file = illumos-utils/src/zone.rs:325
9942024-11-01T08:19:22.334ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8 file = illumos-utils/src/zone.rs:325
9952024-11-01T08:19:22.374ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
9962024-11-01T08:19:22.374ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af file = illumos-utils/src/zone.rs:363
9972024-11-01T08:19:22.379ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7 file = illumos-utils/src/zone.rs:363
9982024-11-01T08:19:22.384ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a file = illumos-utils/src/zone.rs:363
9992024-11-01T08:19:22.388ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543 file = illumos-utils/src/zone.rs:363
10002024-11-01T08:19:22.393ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8 file = illumos-utils/src/zone.rs:363
10012024-11-01T08:19:22.435ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10022024-11-01T08:19:22.471ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10032024-11-01T08:19:22.526ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10042024-11-01T08:19:22.584ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10052024-11-01T08:19:22.587ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10062024-11-01T08:19:22.587ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10072024-11-01T08:19:22.642ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 184, 197]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10082024-11-01T08:19:22.642ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
10092024-11-01T08:19:22.644ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10102024-11-01T08:19:22.644ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10112024-11-01T08:19:22.698ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 210, 216]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10122024-11-01T08:19:22.698ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
10132024-11-01T08:19:22.698ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
10142024-11-01T08:19:22.698ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
10152024-11-01T08:19:22.700ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10162024-11-01T08:19:22.700ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10172024-11-01T08:19:22.761ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 208, 32]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10182024-11-01T08:19:22.761ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
10192024-11-01T08:19:22.763ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10202024-11-01T08:19:22.763ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10212024-11-01T08:19:22.830ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 155, 7]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10222024-11-01T08:19:22.830ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
10232024-11-01T08:19:22.832ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10242024-11-01T08:19:22.832ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10252024-11-01T08:19:22.893ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 172, 215]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10262024-11-01T08:19:22.893ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
10272024-11-01T08:19:22.894ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
10282024-11-01T08:19:22.896ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10292024-11-01T08:19:22.966ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
10302024-11-01T08:19:22.966ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
10312024-11-01T08:19:22.968ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
10322024-11-01T08:19:22.968ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
10332024-11-01T08:19:22.968ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
10342024-11-01T08:19:22.968ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
10352024-11-01T08:19:22.969ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
10362024-11-01T08:19:22.969ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
10372024-11-01T08:19:22.969ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
10382024-11-01T08:19:22.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10392024-11-01T08:19:22.971ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
10402024-11-01T08:19:22.976ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
10412024-11-01T08:19:22.979ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
10422024-11-01T08:19:22.980ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10432024-11-01T08:19:22.980ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10442024-11-01T08:19:23.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10452024-11-01T08:19:23.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585 file = illumos-utils/src/zone.rs:325
10462024-11-01T08:19:23.168ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b file = illumos-utils/src/zone.rs:325
10472024-11-01T08:19:23.310ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f file = illumos-utils/src/zone.rs:325
10482024-11-01T08:19:23.323ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585 file = illumos-utils/src/zone.rs:363
10492024-11-01T08:19:23.333ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b file = illumos-utils/src/zone.rs:363
10502024-11-01T08:19:23.342ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54 file = illumos-utils/src/zone.rs:325
10512024-11-01T08:19:23.350ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64 file = illumos-utils/src/zone.rs:325
10522024-11-01T08:19:23.357ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f file = illumos-utils/src/zone.rs:363
10532024-11-01T08:19:23.374ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54 file = illumos-utils/src/zone.rs:363
10542024-11-01T08:19:23.393ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64 file = illumos-utils/src/zone.rs:363
10552024-11-01T08:19:24.460ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10562024-11-01T08:19:24.460ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
10572024-11-01T08:19:24.609ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f2d00bfb-9004-4347-be63-b51172722fd1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f419e4da-8f57-4e45-be9b-20d6a854145b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10582024-11-01T08:19:24.609ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
10592024-11-01T08:19:24.631ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bc7c6e7d-afb2-4573-b1cd-22c23c48ada9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='19da7dab-967a-4fbc-85f9-c15491fa9d01'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10602024-11-01T08:19:24.631ZINFOSledAgent (ServiceManager): Booting oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
10612024-11-01T08:19:24.640ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10622024-11-01T08:19:24.640ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10632024-11-01T08:19:24.640ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
10642024-11-01T08:19:24.649ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
10652024-11-01T08:19:24.664ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8b236217-c0e1-4577-a9da-0a2d7b6af284/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='84bc7cad-9abf-43ad-9260-ee2b1b339d6b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10662024-11-01T08:19:24.664ZINFOSledAgent (ServiceManager): Booting oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
10672024-11-01T08:19:24.672ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8ced4573-45f7-474a-9fb1-aea34b9e8e79/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1b024428-1c94-4382-89a1-ba69b2dd88d9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10682024-11-01T08:19:24.672ZINFOSledAgent (ServiceManager): Booting oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
10692024-11-01T08:19:24.761ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e1e3ff7c-24ad-4b58-b036-90d5df3d681f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d89c0586-ce52-4448-9640-4b50af06f64d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10702024-11-01T08:19:24.761ZINFOSledAgent (ServiceManager): Booting oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
10712024-11-01T08:19:24.769ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2594f9a2-060c-4e4e-b29d-e5f6940f72cb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6d043f76-ad1e-4642-b9ba-10af07cb16dd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10722024-11-01T08:19:24.770ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
10732024-11-01T08:19:24.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 31.42613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
10742024-11-01T08:19:24.790ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fd3db670-6bf7-4efd-bc98-fba2dadc0267/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0f35e0de-8107-42d9-98c2-b3d6e9fc563c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10752024-11-01T08:19:24.790ZINFOSledAgent (ServiceManager): Booting oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
10762024-11-01T08:19:24.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 56.669255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
10772024-11-01T08:19:24.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 31.845334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
10782024-11-01T08:19:24.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 116.835532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
10792024-11-01T08:19:24.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 25.133645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
10802024-11-01T08:19:24.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 31.15018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
10812024-11-01T08:19:24.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 40.216974ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
10822024-11-01T08:19:24.874ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6b307b27-321f-475e-9d0a-7877e7e97d8e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3684ad87-e93d-4cfc-b0e8-a685fb980ef9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10832024-11-01T08:19:24.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 64.326799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
10842024-11-01T08:19:24.884ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
10852024-11-01T08:19:24.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 79.220602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
10862024-11-01T08:19:24.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 99.912995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
10872024-11-01T08:19:24.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 99.931342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
10882024-11-01T08:19:25.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 123.623073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
10892024-11-01T08:19:25.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 112.030125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
10902024-11-01T08:19:25.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 75.311796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
10912024-11-01T08:19:25.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 49.071041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
10922024-11-01T08:19:25.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 234.424758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
10932024-11-01T08:19:25.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 161.415096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
10942024-11-01T08:19:25.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 267.499575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
10952024-11-01T08:19:25.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 255.00805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
10962024-11-01T08:19:26.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 189.025815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
10972024-11-01T08:19:26.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 170.804226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
10982024-11-01T08:19:26.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 33.640065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
10992024-11-01T08:19:26.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 64.669468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
11002024-11-01T08:19:26.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 53.31733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
11012024-11-01T08:19:26.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 134.333291ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
11022024-11-01T08:19:26.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 132.550957ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
11032024-11-01T08:19:26.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 562.028768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
11042024-11-01T08:19:26.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 224.476664ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
11052024-11-01T08:19:26.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 440.477771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
11062024-11-01T08:19:26.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 426.101367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
11072024-11-01T08:19:26.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 327.305108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
11082024-11-01T08:19:26.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 472.311133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
11092024-11-01T08:19:26.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 125.395347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
11102024-11-01T08:19:26.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 119.038079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
11112024-11-01T08:19:26.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 55.424215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
11122024-11-01T08:19:26.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 431.948794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
11132024-11-01T08:19:26.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 219.722108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
11142024-11-01T08:19:26.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 410.883958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
11152024-11-01T08:19:26.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 195.981244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
11162024-11-01T08:19:26.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 159.837286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
11172024-11-01T08:19:26.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 270.369735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
11182024-11-01T08:19:26.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 967.369602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
11192024-11-01T08:19:26.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 430.067783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
11202024-11-01T08:19:26.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 581.868103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
11212024-11-01T08:19:26.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 523.775751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
11222024-11-01T08:19:26.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 297.778403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
11232024-11-01T08:19:26.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 473.036099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
11242024-11-01T08:19:26.766ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8c13d012-7fe1-48a4-8f49-bd4b8f1c925d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e7884664-b8ad-44d9-a458-68b3f208a3e1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11252024-11-01T08:19:26.767ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
11262024-11-01T08:19:26.773ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='05b98a5a-6633-46a8-a87e-d44dea0d2ec7'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11272024-11-01T08:19:26.773ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
11282024-11-01T08:19:26.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 835.634275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
11292024-11-01T08:19:26.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 312.754062ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
11302024-11-01T08:19:26.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 1.150666372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
11312024-11-01T08:19:26.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 696.921363ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
11322024-11-01T08:19:26.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 1.123500081s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
11332024-11-01T08:19:27.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 29.212155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
11342024-11-01T08:19:27.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 51.75765ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
11352024-11-01T08:19:27.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 1.016590763s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
11362024-11-01T08:19:27.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 108.488226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
11372024-11-01T08:19:27.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 129.716861ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
11382024-11-01T08:19:27.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 1.014468366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
11392024-11-01T08:19:27.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 758.212315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
11402024-11-01T08:19:27.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 170.72774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
11412024-11-01T08:19:27.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 142.061967ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
11422024-11-01T08:19:27.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 406.438225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
11432024-11-01T08:19:27.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 900.402945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
11442024-11-01T08:19:27.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 879.520651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
11452024-11-01T08:19:27.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 229.863105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
11462024-11-01T08:19:27.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 463.761923ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
11472024-11-01T08:19:27.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 795.529022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
11482024-11-01T08:19:27.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 1.467653514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
11492024-11-01T08:19:27.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 1.080916043s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
11502024-11-01T08:19:27.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 680.111901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
11512024-11-01T08:19:27.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 986.056135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
11522024-11-01T08:19:27.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 495.415548ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
11532024-11-01T08:19:27.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 1.33273001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
11542024-11-01T08:19:28.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 799.558887ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
11552024-11-01T08:19:28.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 805.017259ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
11562024-11-01T08:19:28.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 638.773089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
11572024-11-01T08:19:28.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 1.159180127s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
11582024-11-01T08:19:28.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 1.175016593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
11592024-11-01T08:19:28.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 567.131246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
11602024-11-01T08:19:28.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 625.586837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
11612024-11-01T08:19:28.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 1.357346702s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
11622024-11-01T08:19:28.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 1.465580597s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
11632024-11-01T08:19:28.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 1.251564116s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
11642024-11-01T08:19:28.688ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11652024-11-01T08:19:28.688ZINFOSledAgent (ServiceManager): Booting oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
11662024-11-01T08:19:28.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 1.448927278s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
11672024-11-01T08:19:28.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 506.538278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
11682024-11-01T08:19:28.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 781.278934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
11692024-11-01T08:19:28.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 558.531226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
11702024-11-01T08:19:28.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 1.400705144s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
11712024-11-01T08:19:28.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 71.87858ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
11722024-11-01T08:19:28.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 1.32308565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
11732024-11-01T08:19:29.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 103.125093ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
11742024-11-01T08:19:29.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 1.171388423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
11752024-11-01T08:19:29.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 174.5598ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
11762024-11-01T08:19:29.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 507.257878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
11772024-11-01T08:19:29.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 1.340423266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
11782024-11-01T08:19:29.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 841.601596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
11792024-11-01T08:19:29.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 521.928249ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
11802024-11-01T08:19:29.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 1.175709613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
11812024-11-01T08:19:29.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 740.920629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
11822024-11-01T08:19:29.541ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11832024-11-01T08:19:29.541ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
11842024-11-01T08:19:29.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 621.006744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
11852024-11-01T08:19:29.685ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11862024-11-01T08:19:29.685ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
11872024-11-01T08:19:29.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 1.270743691s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
11882024-11-01T08:19:29.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 34.881335ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
11892024-11-01T08:19:29.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 50.039461ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
11902024-11-01T08:19:29.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 510.901975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
11912024-11-01T08:19:29.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 581.338229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
11922024-11-01T08:19:29.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 213.957917ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
11932024-11-01T08:19:30.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 801.714411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
11942024-11-01T08:19:30.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 1.013365579s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
11952024-11-01T08:19:30.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 42.033579ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
11962024-11-01T08:19:30.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 64.499293ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
11972024-11-01T08:19:30.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 709.022437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
11982024-11-01T08:19:30.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 383.379549ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
11992024-11-01T08:19:30.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 244.946881ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
12002024-11-01T08:19:30.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 1.071086709s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
12012024-11-01T08:19:30.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 585.494155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
12022024-11-01T08:19:30.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 1.271053375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
12032024-11-01T08:19:30.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 626.55186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
12042024-11-01T08:19:30.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 1.048361189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
12052024-11-01T08:19:30.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 598.143027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
12062024-11-01T08:19:30.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 1.439666429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
12072024-11-01T08:19:30.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 332.416853ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
12082024-11-01T08:19:30.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 1.364140816s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
12092024-11-01T08:19:30.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 1.087412328s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
12102024-11-01T08:19:30.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 894.108485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
12112024-11-01T08:19:30.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 1.388642084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
12122024-11-01T08:19:30.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 962.094698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
12132024-11-01T08:19:30.861ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12142024-11-01T08:19:30.861ZINFOSledAgent (ServiceManager): Booting oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
12152024-11-01T08:19:30.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 918.083071ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
12162024-11-01T08:19:30.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 1.464672452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
12172024-11-01T08:19:30.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 1.424796431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
12182024-11-01T08:19:30.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 1.086582365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
12192024-11-01T08:19:31.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 910.062522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
12202024-11-01T08:19:31.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 1.207135942s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
12212024-11-01T08:19:31.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 1.012110991s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
12222024-11-01T08:19:31.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 39.0315ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
12232024-11-01T08:19:31.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 83.434788ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
12242024-11-01T08:19:31.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 170.451626ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
12252024-11-01T08:19:31.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 791.423705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
12262024-11-01T08:19:31.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 809.959599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
12272024-11-01T08:19:31.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 366.619003ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
12282024-11-01T08:19:31.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 865.706373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
12292024-11-01T08:19:31.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 1.123281203s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
12302024-11-01T08:19:31.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 1.371926306s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
12312024-11-01T08:19:31.797ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12322024-11-01T08:19:31.797ZINFOSledAgent (ServiceManager): Booting oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
12332024-11-01T08:19:31.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 1.087748045s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
12342024-11-01T08:19:31.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 919.677963ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
12352024-11-01T08:19:31.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 1.183920598s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
12362024-11-01T08:19:31.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 895.68123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
12372024-11-01T08:19:31.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 693.719768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
12382024-11-01T08:19:31.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 818.379982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
12392024-11-01T08:19:32.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 1.406732684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
12402024-11-01T08:19:32.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 1.012136215s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
12412024-11-01T08:19:32.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 34.234265ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
12422024-11-01T08:19:32.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 844.594316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
12432024-11-01T08:19:32.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 71.308342ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
12442024-11-01T08:19:32.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 1.058279199s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
12452024-11-01T08:19:32.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 215.277326ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
12462024-11-01T08:19:32.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 841.599155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
12472024-11-01T08:19:32.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 1.436077664s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
12482024-11-01T08:19:32.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 937.288413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
12492024-11-01T08:19:32.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 639.929433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
12502024-11-01T08:19:32.415ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12512024-11-01T08:19:32.416ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
12522024-11-01T08:19:32.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 1.311496024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
12532024-11-01T08:19:32.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 314.335884ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
12542024-11-01T08:19:32.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 672.581976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
12552024-11-01T08:19:32.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 58.30591ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
12562024-11-01T08:19:32.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 924.303205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
12572024-11-01T08:19:32.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 553.849118ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
12582024-11-01T08:19:32.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 777.722886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
12592024-11-01T08:19:32.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 59.811768ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
12602024-11-01T08:19:32.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 1.438898098s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
12612024-11-01T08:19:32.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 143.029984ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
12622024-11-01T08:19:33.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 463.488656ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
12632024-11-01T08:19:33.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 1.209488542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
12642024-11-01T08:19:33.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 1.410794641s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
12652024-11-01T08:19:33.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 750.789936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
12662024-11-01T08:19:33.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 1.107257897s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
12672024-11-01T08:19:33.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 1.258452689s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
12682024-11-01T08:19:33.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 257.990922ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
12692024-11-01T08:19:33.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 688.717982ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
12702024-11-01T08:19:33.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 1.140097566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
12712024-11-01T08:19:33.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 751.62376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
12722024-11-01T08:19:33.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 1.183623463s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
12732024-11-01T08:19:33.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 764.088941ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
12742024-11-01T08:19:33.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 1.006495941s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
12752024-11-01T08:19:33.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 761.963524ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
12762024-11-01T08:19:33.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 830.554004ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
12772024-11-01T08:19:33.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 1.087627325s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
12782024-11-01T08:19:33.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 1.205820342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
12792024-11-01T08:19:33.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 1.071651156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
12802024-11-01T08:19:33.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 1.412999852s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
12812024-11-01T08:19:33.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 1.457821062s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
12822024-11-01T08:19:33.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 1.420461737s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
12832024-11-01T08:19:33.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 1.417019987s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
12842024-11-01T08:19:34.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 1.149374109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
12852024-11-01T08:19:34.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 714.218411ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
12862024-11-01T08:19:34.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 1.084825196s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
12872024-11-01T08:19:34.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 796.055627ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
12882024-11-01T08:19:34.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 1.364588503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
12892024-11-01T08:19:34.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 525.740179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
12902024-11-01T08:19:34.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 803.919759ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
12912024-11-01T08:19:34.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 1.310838824s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
12922024-11-01T08:19:34.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 1.114912179s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
12932024-11-01T08:19:34.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 880.796857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
12942024-11-01T08:19:34.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 616.920696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
12952024-11-01T08:19:34.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 950.900381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
12962024-11-01T08:19:34.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 1.192338069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
12972024-11-01T08:19:34.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 564.89892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
12982024-11-01T08:19:34.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 514.625267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
12992024-11-01T08:19:34.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 1.280702662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
13002024-11-01T08:19:34.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 1.157529526s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
13012024-11-01T08:19:35.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 1.080193078s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
13022024-11-01T08:19:35.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 537.01136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
13032024-11-01T08:19:35.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 1.004161924s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
13042024-11-01T08:19:35.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 1.358539588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
13052024-11-01T08:19:35.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 606.21468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
13062024-11-01T08:19:35.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 647.037102ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
13072024-11-01T08:19:35.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 625.485471ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
13082024-11-01T08:19:35.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 1.137872922s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
13092024-11-01T08:19:35.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 885.648051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
13102024-11-01T08:19:35.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0") failed: Property not found. retry in 966.396766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
13112024-11-01T08:19:35.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 1.475246407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
13122024-11-01T08:19:35.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 796.125333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
13132024-11-01T08:19:35.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8") failed: Property not found. retry in 749.065243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
13142024-11-01T08:19:35.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 1.038168993s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
13152024-11-01T08:19:35.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 836.026445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
13162024-11-01T08:19:35.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af") failed: Property not found. retry in 1.337086648s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
13172024-11-01T08:19:35.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 1.223950572s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
13182024-11-01T08:19:35.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 594.355891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
13192024-11-01T08:19:35.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 550.164562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
13202024-11-01T08:19:35.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 1.455253596s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
13212024-11-01T08:19:35.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 886.769013ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
13222024-11-01T08:19:36.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 1.316440186s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
13232024-11-01T08:19:36.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 893.241049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
13242024-11-01T08:19:36.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 866.054872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
13252024-11-01T08:19:36.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 1.038629529s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
13262024-11-01T08:19:36.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 751.155199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
13272024-11-01T08:19:36.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 917.341144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
13282024-11-01T08:19:36.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c") failed: Property not found. retry in 833.066856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
13292024-11-01T08:19:36.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 1.292727927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
13302024-11-01T08:19:36.474ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.939969949s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
13312024-11-01T08:19:36.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 712.044501ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
13322024-11-01T08:19:36.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 631.607387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
13332024-11-01T08:19:36.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 927.778125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
13342024-11-01T08:19:36.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 1.341488455s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
13352024-11-01T08:19:36.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 829.324961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
13362024-11-01T08:19:36.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 778.827602ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
13372024-11-01T08:19:36.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 1.113256139s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
13382024-11-01T08:19:36.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8") failed: Property not found. retry in 777.798413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
13392024-11-01T08:19:37.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 843.625169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
13402024-11-01T08:19:37.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 513.745125ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
13412024-11-01T08:19:37.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 524.632417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
13422024-11-01T08:19:37.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 1.433274548s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
13432024-11-01T08:19:37.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 1.467534959s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
13442024-11-01T08:19:37.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 910.83518ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
13452024-11-01T08:19:37.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 1.114896977s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
13462024-11-01T08:19:37.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 1.442584108s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
13472024-11-01T08:19:37.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47") failed: Property not found. retry in 884.461993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
13482024-11-01T08:19:37.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 721.596404ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
13492024-11-01T08:19:37.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 528.758914ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
13502024-11-01T08:19:37.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd") failed: Property not found. retry in 1.116593925s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
13512024-11-01T08:19:37.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638") failed: Property not found. retry in 1.351109273s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
13522024-11-01T08:19:37.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a") failed: Property not found. retry in 712.428133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
13532024-11-01T08:19:37.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 1.0159846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
13542024-11-01T08:19:37.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 664.268564ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
13552024-11-01T08:19:38.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2") failed: Property not found. retry in 1.155297308s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
13562024-11-01T08:19:38.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 557.232475ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
13572024-11-01T08:19:38.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7") failed: Property not found. retry in 962.24991ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
13582024-11-01T08:19:38.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 1.345116636s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
13592024-11-01T08:19:38.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 691.628455ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
13602024-11-01T08:19:38.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 514.511516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
13612024-11-01T08:19:38.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64") failed: Property not found. retry in 854.786479ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
13622024-11-01T08:19:38.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 1.354784376s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
13632024-11-01T08:19:38.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 1.207873436s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
13642024-11-01T08:19:38.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 1.139765821s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
13652024-11-01T08:19:38.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a") failed: Property not found. retry in 1.326904471s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
13662024-11-01T08:19:39.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543") failed: Property not found. retry in 1.210110425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
13672024-11-01T08:19:39.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f") failed: Property not found. retry in 1.181997882s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
13682024-11-01T08:19:39.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 1.010249224s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
13692024-11-01T08:19:39.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 1.290275888s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
13702024-11-01T08:19:40.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 1.3158587s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
13712024-11-01T08:19:40.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 778.77653ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
13722024-11-01T08:19:40.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54") failed: Property not found. retry in 922.547647ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
13732024-11-01T08:19:40.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b") failed: Property not found. retry in 681.041352ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
13742024-11-01T08:19:41.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585") failed: Property not found. retry in 1.201100429s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
13752024-11-01T08:19:41.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac") failed: Property not found. retry in 512.597893ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
13762024-11-01T08:19:41.403ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.377171765s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
13772024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_b67ad34e-9649-4b18-90ef-aca56d949585
13782024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_966837d7-ea0d-4f7f-a324-1c89432bce5c
13792024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_8459ec8b-9fb4-4a5f-8f6e-c67b2ae496a2
13802024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_70adb8a4-b4de-470e-a9cd-b7e15e8f2e47
13812024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_clickhouse_ae5d1094-15ea-4074-8704-b606ab48ccac
13822024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_79a3b8c3-61e7-47ce-b115-28a92b208638
13832024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_008b0fa0-1d76-43e3-9519-e9769510dac0
13842024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_5ce66874-ebff-468e-b086-ca55340137cd
13852024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_d6343cf3-f536-4ba8-a489-7150c54b7be8
13862024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_e435841f-5e20-4041-aa3b-c234ef351e0a
13872024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_e7a6aafb-271b-4c58-a4ee-a120d4fe517b
13882024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_6faaa15b-0dc5-4caa-9f63-b47fef16cf54
13892024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_abcb146b-e795-4408-a210-21319df4b1af
13902024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_eaf02a35-9d01-40bc-9134-1dfb345cdb64
13912024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_oximeter_05b98a5a-6633-46a8-a87e-d44dea0d2ec7
13922024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_f5a9d05d-8509-4c10-96d8-97ac84fede0f
13932024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_3d9e6fd8-adcb-46a4-a34d-929b7235144a
13942024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_fe67150d-6875-4360-bf6e-e262996f9543
13952024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_03217bb0-0fbb-409a-bbf8-5e8a11da3eb8
13962024-11-01T08:19:42.533ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
13972024-11-01T08:19:42.537ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
13982024-11-01T08:19:42.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 22090885 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49521 req_id = 1180923c-4de1-41d4-b2bb-4e2098f148e2 response_code = 204 uri = /omicron-zones
13992024-11-01T08:19:42.545ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1322
14002024-11-01T08:19:42.545ZINFOSledAgent (RSS): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14012024-11-01T08:19:42.545ZINFOSledAgent (RSS): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14022024-11-01T08:19:42.547ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:708
14032024-11-01T08:19:42.547ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:720
14042024-11-01T08:19:42.579ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:887
14052024-11-01T08:19:42.580ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14062024-11-01T08:19:42.656ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14072024-11-01T08:19:42.754ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14082024-11-01T08:19:42.874ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14092024-11-01T08:19:43.096ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14102024-11-01T08:19:43.218ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14112024-11-01T08:19:43.513ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14122024-11-01T08:19:43.858ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14132024-11-01T08:19:44.278ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14142024-11-01T08:19:44.513ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14152024-11-01T08:19:45.022ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14162024-11-01T08:19:45.650ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14172024-11-01T08:19:46.445ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14182024-11-01T08:19:46.812ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.650026294s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
14192024-11-01T08:19:47.742ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14202024-11-01T08:19:48.573ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14212024-11-01T08:19:50.054ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/8166ec96-9c84-4ebd-9efb-796280106790/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
14222024-11-01T08:19:50.455ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38022
14232024-11-01T08:19:50.455ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38022 req_id = e26239f6-5350-4ea2-8849-9839789d13d7 response_code = 200 uri = /baseboard
14242024-11-01T08:19:51.748ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a143d406-c501-4b7e-ab9c-9ab1575ef553", "content-length": "173", "date": "Fri, 01 Nov 2024 08:19:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8166ec96-9c84-4ebd-9efb-796280106790\"", request_id: "a143d406-c501-4b7e-ab9c-9ab1575ef553" } file = sled-agent/src/rack_setup/service.rs:949
14252024-11-01T08:19:53.976ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d673cc91-4237-4b52-9f4e-090037ba8804", "content-length": "173", "date": "Fri, 01 Nov 2024 08:19:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8166ec96-9c84-4ebd-9efb-796280106790\"", request_id: "d673cc91-4237-4b52-9f4e-090037ba8804" } file = sled-agent/src/rack_setup/service.rs:949
14262024-11-01T08:19:54.529ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 18.924132688s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"ee8b59c8-1e6a-49c5-b8ec-ad1d7407643e\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Fri, 01 Nov 2024 08:19:54 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"ee8b59c8-1e6a-49c5-b8ec-ad1d7407643e\\" }" file = oximeter/producer/src/lib.rs:424 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
14272024-11-01T08:19:57.007ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c7d6c662-6395-40ce-be9a-40b3aa9fa656", "content-length": "173", "date": "Fri, 01 Nov 2024 08:19:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f7fe3bf0-db6a-428d-8129-f334aa61483d\"", request_id: "c7d6c662-6395-40ce-be9a-40b3aa9fa656" } file = sled-agent/src/rack_setup/service.rs:949
14282024-11-01T08:20:00.446ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ba808dc0-3940-48cc-9274-1c6ae71780b5", "content-length": "173", "date": "Fri, 01 Nov 2024 08:20:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f7fe3bf0-db6a-428d-8129-f334aa61483d\"", request_id: "ba808dc0-3940-48cc-9274-1c6ae71780b5" } file = sled-agent/src/rack_setup/service.rs:949
14292024-11-01T08:20:05.562ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cc3dea89-7349-4757-ae8c-d888de57efdb", "content-length": "173", "date": "Fri, 01 Nov 2024 08:20:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f7fe3bf0-db6a-428d-8129-f334aa61483d\"", request_id: "cc3dea89-7349-4757-ae8c-d888de57efdb" } file = sled-agent/src/rack_setup/service.rs:949
14302024-11-01T08:20:10.884ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b3b89c43-70da-4001-9518-5301893f28ee", "content-length": "173", "date": "Fri, 01 Nov 2024 08:20:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f7fe3bf0-db6a-428d-8129-f334aa61483d\"", request_id: "b3b89c43-70da-4001-9518-5301893f28ee" } file = sled-agent/src/rack_setup/service.rs:949
14312024-11-01T08:20:14.723ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "33dd9ad4-d32b-49a2-b65a-afd53cc599ed", "content-length": "173", "date": "Fri, 01 Nov 2024 08:20:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f7fe3bf0-db6a-428d-8129-f334aa61483d\"", request_id: "33dd9ad4-d32b-49a2-b65a-afd53cc599ed" } file = sled-agent/src/rack_setup/service.rs:949
14322024-11-01T08:20:20.493ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40030
14332024-11-01T08:20:20.493ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 25 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40030 req_id = f36fe6a3-06d8-4f35-9502-8b3806d1dcf5 response_code = 200 uri = /baseboard
14342024-11-01T08:20:21.281ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "84b697e0-abf9-4627-8647-1fce8031d592", "content-length": "173", "date": "Fri, 01 Nov 2024 08:20:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f7fe3bf0-db6a-428d-8129-f334aa61483d\"", request_id: "84b697e0-abf9-4627-8647-1fce8031d592" } file = sled-agent/src/rack_setup/service.rs:949
14352024-11-01T08:20:25.281ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:63635 remote_addr = [fd00:1122:3344:101::d]:43954 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
14362024-11-01T08:20:25.295ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13255 local_addr = [fd00:1122:3344:101::1]:63635 method = GET remote_addr = [fd00:1122:3344:101::d]:43954 req_id = 2f4291fb-1864-4031-a22e-813e06710fca response_code = 200 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d uri = /f7fe3bf0-db6a-428d-8129-f334aa61483d
14372024-11-01T08:20:28.463ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7bb0bb56-3df9-4002-b7d2-1454a5c12985", "content-length": "173", "date": "Fri, 01 Nov 2024 08:20:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f7fe3bf0-db6a-428d-8129-f334aa61483d\"", request_id: "7bb0bb56-3df9-4002-b7d2-1454a5c12985" } file = sled-agent/src/rack_setup/service.rs:949
14382024-11-01T08:20:36.557ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
14392024-11-01T08:20:36.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55087
14402024-11-01T08:20:36.650ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
14412024-11-01T08:20:36.650ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
14422024-11-01T08:20:36.650ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
14432024-11-01T08:20:36.651ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
14442024-11-01T08:20:36.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193655 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55087 req_id = 3803a0e9-b09c-471b-a0ef-4e77e1274704 response_code = 200 uri = /inventory
14452024-11-01T08:20:38.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63685
14462024-11-01T08:20:38.457ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14472024-11-01T08:20:38.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14482024-11-01T08:20:38.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14492024-11-01T08:20:38.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14502024-11-01T08:20:38.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
14512024-11-01T08:20:38.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14522024-11-01T08:20:38.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14532024-11-01T08:20:38.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63685 req_id = f5f8fca5-df45-41a8-b1af-2b48b62f98f4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14542024-11-01T08:20:38.458ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:959
14552024-11-01T08:20:38.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52306
14562024-11-01T08:20:38.627ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
14572024-11-01T08:20:38.627ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
14582024-11-01T08:20:38.627ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
14592024-11-01T08:20:38.627ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
14602024-11-01T08:20:38.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47415
14612024-11-01T08:20:38.709ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14622024-11-01T08:20:38.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14632024-11-01T08:20:38.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14642024-11-01T08:20:38.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14652024-11-01T08:20:38.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
14662024-11-01T08:20:38.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14672024-11-01T08:20:38.709ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14682024-11-01T08:20:38.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 636 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47415 req_id = fa7f4b79-014b-4812-b471-a3be77151118 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14692024-11-01T08:20:38.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50840
14702024-11-01T08:20:38.713ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14712024-11-01T08:20:38.713ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14722024-11-01T08:20:38.713ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14732024-11-01T08:20:38.713ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14742024-11-01T08:20:38.713ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
14752024-11-01T08:20:38.713ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14762024-11-01T08:20:38.714ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14772024-11-01T08:20:38.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50840 req_id = 60a30b18-80a4-4e10-9af2-8bc5742062a9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14782024-11-01T08:20:38.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52306 req_id = ebc6c467-66b8-4cbb-9c3d-b77089f75194 response_code = 200 uri = /inventory
14792024-11-01T08:20:39.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57943
14802024-11-01T08:20:39.325ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14812024-11-01T08:20:39.325ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14822024-11-01T08:20:39.325ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14832024-11-01T08:20:39.325ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14842024-11-01T08:20:39.325ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
14852024-11-01T08:20:39.325ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14862024-11-01T08:20:39.325ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14872024-11-01T08:20:39.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57943 req_id = 52de25ec-765a-4519-97ba-c6f548b05bd0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14882024-11-01T08:20:47.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53745
14892024-11-01T08:20:47.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53745 req_id = ff0626f7-e644-4fac-99b7-9f54d18d0a20 response_code = 200 uri = /vpc-routes
14902024-11-01T08:20:47.913ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
14912024-11-01T08:20:47.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53745 req_id = 45633faf-8912-4e0f-86ed-8108f5725685 response_code = 204 uri = /eip-gateways
14922024-11-01T08:20:48.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53745 req_id = 25bf4e32-ef27-4f78-b8f9-d99e03d82242 response_code = 204 uri = /vpc-routes
14932024-11-01T08:20:50.531ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60148
14942024-11-01T08:20:50.531ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60148 req_id = a07a8820-9a3b-40d1-92dc-251b1321e5d6 response_code = 200 uri = /baseboard
14952024-11-01T08:20:55.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37279
14962024-11-01T08:20:55.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37279 req_id = e95a9b64-05dd-4110-a056-6e43d85fecc0 response_code = 200 uri = /vpc-routes
14972024-11-01T08:20:55.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56888
14982024-11-01T08:20:55.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56888 req_id = 08b771f3-4824-4461-9cec-13460f15d5de response_code = 200 uri = /v2p
14992024-11-01T08:20:55.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51887
15002024-11-01T08:20:55.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51887 req_id = 74254325-72ba-44d8-a8b3-ed9d817e9ac3 response_code = 200 uri = /vpc-routes
15012024-11-01T08:20:55.267ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
15022024-11-01T08:20:55.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37279 req_id = dcfd9fc6-71b9-4d89-b696-e3599b665f10 response_code = 204 uri = /eip-gateways
15032024-11-01T08:20:55.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47517
15042024-11-01T08:20:55.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47517 req_id = 7efc2ac4-e208-4216-b03f-ab24ea939e9e response_code = 200 uri = /v2p
15052024-11-01T08:20:55.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37279 req_id = fcb5ce9a-bbcb-4615-a000-0a3d26adb9c7 response_code = 204 uri = /vpc-routes
15062024-11-01T08:20:55.294ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
15072024-11-01T08:20:55.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51887 req_id = 91ea0138-16a6-4423-a8ba-9953792c575c response_code = 204 uri = /eip-gateways
15082024-11-01T08:20:55.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51887 req_id = 67e9a146-8e96-49e9-98e8-3c03b774a10a response_code = 204 uri = /vpc-routes
15092024-11-01T08:20:55.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61098
15102024-11-01T08:20:55.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61098 req_id = c797b4c1-14ef-4d4c-aaa2-c66bf966ce5c response_code = 200 uri = /v2p
15112024-11-01T08:20:55.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33457
15122024-11-01T08:20:55.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 18 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33457 req_id = 7ea71e75-eb48-40e1-a086-3fb1dd4ca96c response_code = 200 uri = /vpc-routes
15132024-11-01T08:20:55.390ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
15142024-11-01T08:20:55.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33457 req_id = 9075780b-4d08-4e4d-bf5b-be0859ada339 response_code = 204 uri = /eip-gateways
15152024-11-01T08:20:55.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33457 req_id = 9ed12cc3-6b03-4bae-bc46-6d9ecbc25245 response_code = 204 uri = /vpc-routes
15162024-11-01T08:20:55.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56832
15172024-11-01T08:20:55.423ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
15182024-11-01T08:20:55.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
15192024-11-01T08:20:55.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109067 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56832 req_id = 8e2eb97e-efdb-4013-a5b7-a2ca10eb48da response_code = 204 uri = /switch-ports
15202024-11-01T08:20:55.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33376
15212024-11-01T08:20:55.532ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
15222024-11-01T08:20:55.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 654 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56832 req_id = 3eaf759c-2455-49f6-8ced-f9a442a4232a response_code = 200 uri = /network-bootstore-config
15232024-11-01T08:20:55.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36112
15242024-11-01T08:20:55.564ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
15252024-11-01T08:20:55.565ZINFOSledAgent (bootstore): Writing ledger to /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15262024-11-01T08:20:55.566ZINFOSledAgent (bootstore): Writing ledger to /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15272024-11-01T08:20:55.567ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
15282024-11-01T08:20:55.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2673 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56832 req_id = 8f1e12f5-71d7-4885-9cbb-65f0eabaa7b2 response_code = 204 uri = /network-bootstore-config
15292024-11-01T08:20:55.572ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
15302024-11-01T08:20:55.629ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
15312024-11-01T08:20:55.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33376 req_id = 2dcda5a4-e88f-484f-a940-84c9e961dd44 response_code = 204 uri = /switch-ports
15322024-11-01T08:20:55.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 650 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33376 req_id = c6807809-174d-438c-a1ae-57a268d5057e response_code = 200 uri = /network-bootstore-config
15332024-11-01T08:20:55.663ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
15342024-11-01T08:20:55.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164978 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36112 req_id = c1a5d183-ce93-495b-8dde-a19ffb0e1ab5 response_code = 204 uri = /switch-ports
15352024-11-01T08:20:55.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36112 req_id = 0f10f693-3faf-4679-9ff7-9031a2e5112a response_code = 200 uri = /network-bootstore-config
15362024-11-01T08:21:20.566ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61422
15372024-11-01T08:21:20.566ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61422 req_id = b8e743cf-d3d0-4056-adab-49bad848e5df response_code = 200 uri = /baseboard
15382024-11-01T08:21:24.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58982
15392024-11-01T08:21:24.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58982 req_id = c4a3f410-5079-4d29-91e5-247936f8664d response_code = 200 uri = /vpc-routes
15402024-11-01T08:21:24.965ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
15412024-11-01T08:21:24.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58982 req_id = f21f9ba0-b6d2-4500-80de-ee132d6a5673 response_code = 204 uri = /eip-gateways
15422024-11-01T08:21:24.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58982 req_id = b0d89149-b2b3-4ac8-9740-0bed3c2c038e response_code = 204 uri = /vpc-routes
15432024-11-01T08:21:25.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51258
15442024-11-01T08:21:25.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51258 req_id = 017769db-2d3f-4a21-9ecc-f7705ef65dc9 response_code = 200 uri = /vpc-routes
15452024-11-01T08:21:25.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54616
15462024-11-01T08:21:25.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54616 req_id = b2806c27-3099-4424-812f-ee10cfdb2526 response_code = 200 uri = /v2p
15472024-11-01T08:21:25.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48439
15482024-11-01T08:21:25.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48439 req_id = 88de1130-c790-40b4-ac0d-75a48e7a24c3 response_code = 200 uri = /vpc-routes
15492024-11-01T08:21:25.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
15502024-11-01T08:21:25.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51258 req_id = cba6de66-4614-4145-86fb-f29225fc22a6 response_code = 204 uri = /eip-gateways
15512024-11-01T08:21:25.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51258 req_id = d91f4467-f6a2-4212-8ba8-6210ed4e1c70 response_code = 204 uri = /vpc-routes
15522024-11-01T08:21:25.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
15532024-11-01T08:21:25.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48439 req_id = 6c7b24da-2691-40d7-bb5e-1349f4dcbd5b response_code = 204 uri = /eip-gateways
15542024-11-01T08:21:25.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54777
15552024-11-01T08:21:25.120ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
15562024-11-01T08:21:25.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
15572024-11-01T08:21:25.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103253 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54777 req_id = 5562c4cf-c377-4fb4-b1a6-b01e4a794caf response_code = 204 uri = /switch-ports
15582024-11-01T08:21:25.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58249
15592024-11-01T08:21:25.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39709
15602024-11-01T08:21:25.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48439 req_id = 5b7aad9b-bee5-406a-acdf-97f0048a038c response_code = 204 uri = /vpc-routes
15612024-11-01T08:21:25.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54777 req_id = 8f599ea9-73d8-4176-83cf-25735b0e4f93 response_code = 200 uri = /network-bootstore-config
15622024-11-01T08:21:25.224ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
15632024-11-01T08:21:25.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58249 req_id = f1be968d-a1b4-4c61-8b5d-6253ab01016e response_code = 200 uri = /v2p
15642024-11-01T08:21:25.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62936
15652024-11-01T08:21:25.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62936 req_id = d620c228-3f1e-497f-8407-a7c37bf922b1 response_code = 200 uri = /v2p
15662024-11-01T08:21:25.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64746
15672024-11-01T08:21:25.262ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
15682024-11-01T08:21:25.322ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
15692024-11-01T08:21:25.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98121 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39709 req_id = 65edc169-a830-4f9b-8770-774a00147e86 response_code = 204 uri = /switch-ports
15702024-11-01T08:21:25.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 728 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39709 req_id = 509b1dab-316f-4809-b474-dce384f800d9 response_code = 200 uri = /network-bootstore-config
15712024-11-01T08:21:25.359ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
15722024-11-01T08:21:25.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155966 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64746 req_id = 36a5fb32-48f7-4e6d-95fd-aa72719ad704 response_code = 204 uri = /switch-ports
15732024-11-01T08:21:25.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64746 req_id = c15dd368-f354-4c83-9a32-756d9ef9c219 response_code = 200 uri = /network-bootstore-config
15742024-11-01T08:21:50.604ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51297
15752024-11-01T08:21:50.605ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51297 req_id = 711e79ce-9068-42c3-92bf-09b3a1211e15 response_code = 200 uri = /baseboard
15762024-11-01T08:21:55.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51443
15772024-11-01T08:21:55.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51443 req_id = 4dbb6e40-6494-46d3-9539-13bfcd64c2a2 response_code = 200 uri = /vpc-routes
15782024-11-01T08:21:55.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42170
15792024-11-01T08:21:55.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42170 req_id = ff6810ab-b6e5-4c77-963f-10c79c8f744a response_code = 200 uri = /vpc-routes
15802024-11-01T08:21:55.122ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
15812024-11-01T08:21:55.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51443 req_id = aaafed9b-c916-4af5-af89-d2411c25a8ba response_code = 204 uri = /eip-gateways
15822024-11-01T08:21:55.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51443 req_id = 43d38ddb-860a-4334-ab58-59f8b5253f46 response_code = 204 uri = /vpc-routes
15832024-11-01T08:21:55.154ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
15842024-11-01T08:21:55.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42170 req_id = 554c9a60-5da5-4351-9d70-139d06cb4399 response_code = 204 uri = /eip-gateways
15852024-11-01T08:21:55.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46225
15862024-11-01T08:21:55.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46225 req_id = 6c24cf32-b74c-42b6-aabf-87f8fbd467d0 response_code = 200 uri = /v2p
15872024-11-01T08:21:55.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42170 req_id = c7909cb9-10fc-4f9a-8ee1-71807201c011 response_code = 204 uri = /vpc-routes
15882024-11-01T08:21:55.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57850
15892024-11-01T08:21:55.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57850 req_id = 043a94de-05c7-4b0b-8f70-a1868cd3f898 response_code = 200 uri = /v2p
15902024-11-01T08:21:55.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35649
15912024-11-01T08:21:55.275ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
15922024-11-01T08:21:55.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
15932024-11-01T08:21:55.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35649 req_id = 23358ffa-1efa-410b-81b9-10ab7247cb57 response_code = 204 uri = /switch-ports
15942024-11-01T08:21:55.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57240
15952024-11-01T08:21:55.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47833
15962024-11-01T08:21:55.387ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
15972024-11-01T08:21:55.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35649 req_id = 6aba3278-a7db-4027-b062-9358fdc2142c response_code = 200 uri = /network-bootstore-config
15982024-11-01T08:21:55.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47833 req_id = 3298e287-ab04-4943-a982-359a4ecfe76c response_code = 200 uri = /vpc-routes
15992024-11-01T08:21:55.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42327
16002024-11-01T08:21:55.427ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16012024-11-01T08:21:55.443ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
16022024-11-01T08:21:55.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 561 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47833 req_id = 8fdd6ad7-27da-4cc6-a828-991b0de734c8 response_code = 204 uri = /eip-gateways
16032024-11-01T08:21:55.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 789 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47833 req_id = 110d0c4d-6e1e-4c51-bbba-60c2ab01b7c2 response_code = 204 uri = /vpc-routes
16042024-11-01T08:21:55.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46305
16052024-11-01T08:21:55.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46305 req_id = be78bde7-b695-4dd5-a854-83e647e8448f response_code = 200 uri = /v2p
16062024-11-01T08:21:55.484ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16072024-11-01T08:21:55.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96654 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57240 req_id = 4ecaa996-6bdd-4b91-a7d4-650b238d9d07 response_code = 204 uri = /switch-ports
16082024-11-01T08:21:55.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 664 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57240 req_id = fa4a0611-c2f6-4e8d-a60b-68970dd62cfa response_code = 200 uri = /network-bootstore-config
16092024-11-01T08:21:55.517ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16102024-11-01T08:21:55.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174061 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42327 req_id = 54a6f705-2108-4103-bfea-913167dcd094 response_code = 204 uri = /switch-ports
16112024-11-01T08:21:55.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42327 req_id = 58b6ee84-9cfa-4c9b-96f0-1bd6905266e7 response_code = 200 uri = /network-bootstore-config
16122024-11-01T08:22:20.636ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45366
16132024-11-01T08:22:20.637ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45366 req_id = 084c0369-9f27-4ab8-9615-3e087185795d response_code = 200 uri = /baseboard
16142024-11-01T08:22:24.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63518
16152024-11-01T08:22:24.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63518 req_id = 4d63f176-a4cb-4c4c-850b-53319cbf6cb0 response_code = 200 uri = /vpc-routes
16162024-11-01T08:22:24.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51034
16172024-11-01T08:22:24.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51034 req_id = 7e965977-b734-4564-b4d3-4c5cab6eb614 response_code = 200 uri = /vpc-routes
16182024-11-01T08:22:25.016ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
16192024-11-01T08:22:25.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51034 req_id = 1612bfa5-47f1-461e-a8a3-63111e9c705e response_code = 204 uri = /eip-gateways
16202024-11-01T08:22:25.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
16212024-11-01T08:22:25.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63518 req_id = a1d94585-93f0-4aec-941c-9441b8fe1550 response_code = 204 uri = /eip-gateways
16222024-11-01T08:22:25.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63518 req_id = 5c5d6dc0-236c-4048-b461-ad3ad14fb54a response_code = 204 uri = /vpc-routes
16232024-11-01T08:22:25.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38396
16242024-11-01T08:22:25.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38396 req_id = c8f104ce-e109-4e26-ae27-27703c17a7fe response_code = 200 uri = /v2p
16252024-11-01T08:22:25.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56995
16262024-11-01T08:22:25.065ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16272024-11-01T08:22:25.107ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16282024-11-01T08:22:25.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104180 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56995 req_id = 61cf26ef-95a4-4fe9-99d7-47031a14ce9a response_code = 204 uri = /switch-ports
16292024-11-01T08:22:25.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42484
16302024-11-01T08:22:25.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65193
16312024-11-01T08:22:25.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44414
16322024-11-01T08:22:25.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44414 req_id = b856a7ab-d8d2-4552-b620-59f31a1243af response_code = 200 uri = /vpc-routes
16332024-11-01T08:22:25.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56995 req_id = 133467c2-4968-48cb-9389-2dfd83187e76 response_code = 200 uri = /network-bootstore-config
16342024-11-01T08:22:25.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65193 req_id = 22bbeca2-fcfa-481f-b810-82fc2871f300 response_code = 200 uri = /v2p
16352024-11-01T08:22:25.170ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16362024-11-01T08:22:25.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5459 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51034 req_id = 0c9c1599-91df-42b1-ae77-b012866615dd response_code = 204 uri = /vpc-routes
16372024-11-01T08:22:25.213ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16382024-11-01T08:22:25.223ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
16392024-11-01T08:22:25.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44414 req_id = d8ca9670-343b-4bef-abf2-316d84cd992e response_code = 204 uri = /eip-gateways
16402024-11-01T08:22:25.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44414 req_id = 7fa29c80-67c6-4528-9573-a8453924c6e7 response_code = 204 uri = /vpc-routes
16412024-11-01T08:22:25.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101134 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42484 req_id = 771d0bf8-b8df-4d88-a918-381e1521cbd9 response_code = 204 uri = /switch-ports
16422024-11-01T08:22:25.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42484 req_id = f2961d0b-0aaa-4e63-9f79-b48caa336d61 response_code = 200 uri = /network-bootstore-config
16432024-11-01T08:22:25.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54050
16442024-11-01T08:22:25.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54050 req_id = bd129c71-7556-49d2-8318-75c3718252c0 response_code = 200 uri = /v2p
16452024-11-01T08:22:25.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33299
16462024-11-01T08:22:25.348ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16472024-11-01T08:22:25.382ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16482024-11-01T08:22:25.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33299 req_id = 5f999829-e383-41a1-a2cc-fed28540c7e2 response_code = 204 uri = /switch-ports
16492024-11-01T08:22:25.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33299 req_id = 550d4625-edac-456b-bd6d-4a277c97a42e response_code = 200 uri = /network-bootstore-config
16502024-11-01T08:22:50.670ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41068
16512024-11-01T08:22:50.670ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41068 req_id = 8acd7c9a-54eb-4d01-93ee-bdfd6afa66f5 response_code = 200 uri = /baseboard
16522024-11-01T08:22:55.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47797
16532024-11-01T08:22:55.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47797 req_id = 04cb7a22-86f9-4c6c-be0f-f29dab774bb7 response_code = 200 uri = /vpc-routes
16542024-11-01T08:22:55.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57821
16552024-11-01T08:22:55.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57821 req_id = 71f66b3c-769b-4969-a194-ee902e565c4f response_code = 200 uri = /vpc-routes
16562024-11-01T08:22:55.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
16572024-11-01T08:22:55.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47797 req_id = b0caead6-a87e-43f7-8095-685461472015 response_code = 204 uri = /eip-gateways
16582024-11-01T08:22:55.151ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
16592024-11-01T08:22:55.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57821 req_id = 26633ffe-e06e-465d-ac70-4bb58cd57120 response_code = 204 uri = /eip-gateways
16602024-11-01T08:22:55.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47797 req_id = cbc7afa3-0bef-4c7c-82cc-9060b4f4c704 response_code = 204 uri = /vpc-routes
16612024-11-01T08:22:55.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57821 req_id = d00cf448-d570-472a-a1c8-8769012fed58 response_code = 204 uri = /vpc-routes
16622024-11-01T08:22:55.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45421
16632024-11-01T08:22:55.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45421 req_id = 7b3f1397-1516-468b-a7f9-b44009900f3c response_code = 200 uri = /v2p
16642024-11-01T08:22:55.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40008
16652024-11-01T08:22:55.239ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16662024-11-01T08:22:55.274ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16672024-11-01T08:22:55.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87279 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40008 req_id = e275fe74-34e7-45da-ba3f-9ed10e83cdd0 response_code = 204 uri = /switch-ports
16682024-11-01T08:22:55.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57277
16692024-11-01T08:22:55.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36536
16702024-11-01T08:22:55.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44804
16712024-11-01T08:22:55.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43308
16722024-11-01T08:22:55.327ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16732024-11-01T08:22:55.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40008 req_id = fc561daf-ace0-41fd-8081-abd58afa7e80 response_code = 200 uri = /network-bootstore-config
16742024-11-01T08:22:55.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44804 req_id = e706a630-9442-4135-b3ef-a69e4533a0db response_code = 200 uri = /vpc-routes
16752024-11-01T08:22:55.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3546 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57277 req_id = 2f355dfe-c5cc-4fb6-a14a-c80f02d14f48 response_code = 200 uri = /v2p
16762024-11-01T08:22:55.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3701 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36536 req_id = 673758d2-7167-4018-be94-49d4af9f7008 response_code = 200 uri = /v2p
16772024-11-01T08:22:55.363ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16782024-11-01T08:22:55.373ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
16792024-11-01T08:22:55.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44804 req_id = cd86b16a-8c28-48b1-9fc1-e71f1bf97fa9 response_code = 204 uri = /eip-gateways
16802024-11-01T08:22:55.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44804 req_id = 71e61c95-eb7f-402d-a77e-5aa3804c0e4c response_code = 204 uri = /vpc-routes
16812024-11-01T08:22:55.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92414 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43308 req_id = dacc3d63-d29b-4b52-9ac4-e38beec3db1f response_code = 204 uri = /switch-ports
16822024-11-01T08:22:55.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43308 req_id = 8fb879ba-f91d-401a-9dd2-3ca306b1d625 response_code = 200 uri = /network-bootstore-config
16832024-11-01T08:22:55.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42656
16842024-11-01T08:22:55.503ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16852024-11-01T08:22:55.540ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16862024-11-01T08:22:55.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94246 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42656 req_id = 8057ca07-6b4c-4643-a74e-436707ce81a0 response_code = 204 uri = /switch-ports
16872024-11-01T08:22:55.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42656 req_id = d2ea89b0-2923-49af-870f-bea2104fccbf response_code = 200 uri = /network-bootstore-config
16882024-11-01T08:23:09.756ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
16892024-11-01T08:23:20.708ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40005
16902024-11-01T08:23:20.708ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40005 req_id = 30a84baa-456b-40aa-9fd7-64b3a0f034fa response_code = 200 uri = /baseboard
16912024-11-01T08:23:24.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34195
16922024-11-01T08:23:24.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34195 req_id = c7cb733a-f985-48f4-b387-af07e306b49a response_code = 200 uri = /vpc-routes
16932024-11-01T08:23:24.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64325
16942024-11-01T08:23:24.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64325 req_id = 8f718082-9c2b-4d84-bb90-a632d17dbc4c response_code = 200 uri = /vpc-routes
16952024-11-01T08:23:25.005ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
16962024-11-01T08:23:25.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34195 req_id = c9d66396-74b3-4acf-a383-237c7d8e7286 response_code = 204 uri = /eip-gateways
16972024-11-01T08:23:25.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56580
16982024-11-01T08:23:25.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56580 req_id = 94801e18-7170-4c5d-a263-ecfed533e888 response_code = 200 uri = /v2p
16992024-11-01T08:23:25.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34195 req_id = fc1fa23a-ce5b-467b-b086-e31137782575 response_code = 204 uri = /vpc-routes
17002024-11-01T08:23:25.038ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
17012024-11-01T08:23:25.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64325 req_id = c5efa849-c6a9-44d6-a17e-62a6e3b3bb04 response_code = 204 uri = /eip-gateways
17022024-11-01T08:23:25.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58189
17032024-11-01T08:23:25.042ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17042024-11-01T08:23:25.091ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17052024-11-01T08:23:25.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58189 req_id = af9279ed-34cc-4bcd-a7d6-a678ee83db78 response_code = 204 uri = /switch-ports
17062024-11-01T08:23:25.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36263
17072024-11-01T08:23:25.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64325 req_id = 394cfed5-8b6b-43e2-9251-541ca403cad6 response_code = 204 uri = /vpc-routes
17082024-11-01T08:23:25.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36263 req_id = 03ce114d-8598-41b4-84ab-99d6ea812698 response_code = 200 uri = /vpc-routes
17092024-11-01T08:23:25.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58189 req_id = 8124dfb8-f48b-48ca-b0da-07512bebd0c8 response_code = 200 uri = /network-bootstore-config
17102024-11-01T08:23:25.176ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
17112024-11-01T08:23:25.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36263 req_id = d029f34b-8e61-4701-89d0-27e6ca253ff7 response_code = 204 uri = /eip-gateways
17122024-11-01T08:23:25.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36263 req_id = e82e459d-3f1a-493a-b0f7-044e5a1acbb3 response_code = 204 uri = /vpc-routes
17132024-11-01T08:23:25.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63265
17142024-11-01T08:23:25.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63265 req_id = 16ed64df-9600-46a8-8040-c020aca58f8d response_code = 200 uri = /v2p
17152024-11-01T08:23:25.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57222
17162024-11-01T08:23:25.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57222 req_id = 40c14470-ffea-4e7e-8def-2d5c9afddf9d response_code = 200 uri = /v2p
17172024-11-01T08:23:25.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52142
17182024-11-01T08:23:25.231ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17192024-11-01T08:23:25.272ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17202024-11-01T08:23:25.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97321 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52142 req_id = e3d0ee7c-2d94-4258-a6d8-e0160081e6da response_code = 204 uri = /switch-ports
17212024-11-01T08:23:25.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43132
17222024-11-01T08:23:25.329ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17232024-11-01T08:23:25.362ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17242024-11-01T08:23:25.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90862 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43132 req_id = a693165a-a290-4b12-887e-d42307fab880 response_code = 204 uri = /switch-ports
17252024-11-01T08:23:25.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52142 req_id = 2f40b97a-ec69-43a7-b338-165e64ba6d6b response_code = 200 uri = /network-bootstore-config
17262024-11-01T08:23:25.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43132 req_id = b86ffe81-4e0b-4258-86b2-92f8027a4e16 response_code = 200 uri = /network-bootstore-config
17272024-11-01T08:23:50.742ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48142
17282024-11-01T08:23:50.742ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48142 req_id = 39500eaa-e37d-44a1-8277-7afce50aa970 response_code = 200 uri = /baseboard
17292024-11-01T08:23:55.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64832
17302024-11-01T08:23:55.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64832 req_id = 56fe7e79-8578-47dc-8731-b4fc81e293e2 response_code = 200 uri = /vpc-routes
17312024-11-01T08:23:55.149ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
17322024-11-01T08:23:55.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64832 req_id = 30ab5fa6-17b8-4836-a11f-4807280fefca response_code = 204 uri = /eip-gateways
17332024-11-01T08:23:55.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64832 req_id = 60b8fcea-3129-403d-8315-1d7ac90ada2f response_code = 204 uri = /vpc-routes
17342024-11-01T08:23:55.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46853
17352024-11-01T08:23:55.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46853 req_id = aeb13fd1-222c-4f89-9080-dd7f419148d7 response_code = 200 uri = /vpc-routes
17362024-11-01T08:23:55.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
17372024-11-01T08:23:55.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46853 req_id = da3dcfea-dd2f-4f6c-adb1-872cd26a3347 response_code = 204 uri = /eip-gateways
17382024-11-01T08:23:55.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47615
17392024-11-01T08:23:55.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47615 req_id = 4a4b5ea1-8692-405b-8b4e-9f0f9a31bfa3 response_code = 200 uri = /v2p
17402024-11-01T08:23:55.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42564
17412024-11-01T08:23:55.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42564 req_id = 66284384-7684-4b79-90de-f924e20f5114 response_code = 200 uri = /v2p
17422024-11-01T08:23:55.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46853 req_id = 1f95548c-a698-4072-bdd8-64ea2bdbde3a response_code = 204 uri = /vpc-routes
17432024-11-01T08:23:55.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32913
17442024-11-01T08:23:55.324ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17452024-11-01T08:23:55.362ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17462024-11-01T08:23:55.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32913 req_id = 470e0e55-c2ab-45ef-8407-72b08772d377 response_code = 204 uri = /switch-ports
17472024-11-01T08:23:55.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52591
17482024-11-01T08:23:55.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44090
17492024-11-01T08:23:55.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48122
17502024-11-01T08:23:55.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52591 req_id = a286dc78-dbc4-4f2c-b63d-38e1b1f17778 response_code = 200 uri = /v2p
17512024-11-01T08:23:55.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32913 req_id = 3004c93f-8bf6-4c46-84e3-aa3eff2e8907 response_code = 200 uri = /network-bootstore-config
17522024-11-01T08:23:55.418ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17532024-11-01T08:23:55.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44090 req_id = c8ea1ba3-45c6-43cf-a4b3-1c86ddb8e42f response_code = 200 uri = /vpc-routes
17542024-11-01T08:23:55.444ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
17552024-11-01T08:23:55.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44090 req_id = 2d0452a8-666c-4d57-9e81-b3868d6ddbd2 response_code = 204 uri = /eip-gateways
17562024-11-01T08:23:55.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47121
17572024-11-01T08:23:55.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44090 req_id = 4fa84d39-fcab-4bc8-b199-71134f9efe34 response_code = 204 uri = /vpc-routes
17582024-11-01T08:23:55.457ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17592024-11-01T08:23:55.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97101 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48122 req_id = aaff270b-8407-4a1a-a646-45a5e6461693 response_code = 204 uri = /switch-ports
17602024-11-01T08:23:55.515ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17612024-11-01T08:23:55.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 740 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48122 req_id = 37288183-9318-4775-b0b2-90a9d1889f31 response_code = 200 uri = /network-bootstore-config
17622024-11-01T08:23:55.552ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17632024-11-01T08:23:55.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156323 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47121 req_id = d678902f-2d23-41be-b79c-625eafd36d40 response_code = 204 uri = /switch-ports
17642024-11-01T08:23:55.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47121 req_id = 91c3c043-831d-41d7-8588-cce2635439ab response_code = 200 uri = /network-bootstore-config
17652024-11-01T08:24:20.774ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62915
17662024-11-01T08:24:20.775ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62915 req_id = f6175a0b-d8f4-473f-bde5-1915b480e036 response_code = 200 uri = /baseboard
17672024-11-01T08:24:24.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62407
17682024-11-01T08:24:24.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62407 req_id = c12fc935-05a1-4d93-afa4-59d875f46bb3 response_code = 200 uri = /vpc-routes
17692024-11-01T08:24:24.958ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
17702024-11-01T08:24:24.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62407 req_id = 8a947935-5f39-4f80-9228-380e6a9b4d1b response_code = 204 uri = /eip-gateways
17712024-11-01T08:24:24.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34256
17722024-11-01T08:24:24.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34256 req_id = 3c90980c-d04d-437f-aedb-0ecc8f10b7d2 response_code = 200 uri = /vpc-routes
17732024-11-01T08:24:24.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62407 req_id = a05bdb57-5467-4554-86a7-5e746f7a1c9f response_code = 204 uri = /vpc-routes
17742024-11-01T08:24:24.992ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
17752024-11-01T08:24:24.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34256 req_id = f60e7201-3bae-4d7d-b3c2-7c5c57de6cc3 response_code = 204 uri = /eip-gateways
17762024-11-01T08:24:25.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34256 req_id = a979b236-4bdd-494a-bfd5-5d20a6fe3ea6 response_code = 204 uri = /vpc-routes
17772024-11-01T08:24:25.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62476
17782024-11-01T08:24:25.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62476 req_id = 60c4d17d-82cd-4a57-9dd6-bfad32c78058 response_code = 200 uri = /v2p
17792024-11-01T08:24:25.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61676
17802024-11-01T08:24:25.018ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17812024-11-01T08:24:25.063ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17822024-11-01T08:24:25.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114714 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61676 req_id = ca87c1b5-9296-418f-9156-6df4336190e7 response_code = 204 uri = /switch-ports
17832024-11-01T08:24:25.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41234
17842024-11-01T08:24:25.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38407
17852024-11-01T08:24:25.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38407 req_id = cbfa5e01-80e3-442d-8dee-2a7faf6b1e4c response_code = 200 uri = /vpc-routes
17862024-11-01T08:24:25.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61676 req_id = f90a5478-9edf-4454-936d-6dfc3e5aee64 response_code = 200 uri = /network-bootstore-config
17872024-11-01T08:24:25.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41234 req_id = ba89402e-ccbc-4a7f-b91b-3cd5baa1b98b response_code = 200 uri = /v2p
17882024-11-01T08:24:25.176ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
17892024-11-01T08:24:25.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38407 req_id = 578fb3f4-e6d5-40a1-8580-330c85d1be01 response_code = 204 uri = /eip-gateways
17902024-11-01T08:24:25.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42382
17912024-11-01T08:24:25.180ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17922024-11-01T08:24:25.219ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17932024-11-01T08:24:25.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94956 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42382 req_id = d90b39ab-adf9-493a-b9fc-27d2c914061d response_code = 204 uri = /switch-ports
17942024-11-01T08:24:25.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47129
17952024-11-01T08:24:25.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48541
17962024-11-01T08:24:25.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42382 req_id = de9a0190-0a8c-4870-9f5d-e6c3229873f6 response_code = 200 uri = /network-bootstore-config
17972024-11-01T08:24:25.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47129 req_id = 68594a1b-d551-47ae-9717-4cf0a69f1689 response_code = 200 uri = /v2p
17982024-11-01T08:24:25.276ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17992024-11-01T08:24:25.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 458 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38407 req_id = 0b6e7e1a-f568-48fb-91e5-441215a3b90c response_code = 204 uri = /vpc-routes
18002024-11-01T08:24:25.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18012024-11-01T08:24:25.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92368 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48541 req_id = a5770ce3-ece8-49e2-8d53-aaa76ab70e56 response_code = 204 uri = /switch-ports
18022024-11-01T08:24:25.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48541 req_id = b19ebb83-c40e-49c5-910b-438ecfa360f7 response_code = 200 uri = /network-bootstore-config
18032024-11-01T08:24:50.810ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41266
18042024-11-01T08:24:50.810ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41266 req_id = ad9efe4f-94c1-4d6e-808f-c913169c49aa response_code = 200 uri = /baseboard
18052024-11-01T08:24:54.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61879
18062024-11-01T08:24:54.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61879 req_id = 303d2675-16b5-4029-bed1-64bada8879d7 response_code = 200 uri = /vpc-routes
18072024-11-01T08:24:54.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42161
18082024-11-01T08:24:54.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42161 req_id = 9d624edf-041f-4f45-bcc4-81479844a016 response_code = 200 uri = /vpc-routes
18092024-11-01T08:24:55.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
18102024-11-01T08:24:55.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61879 req_id = 429b5f12-5bc1-4c94-9fb0-5b462f1a3c28 response_code = 204 uri = /eip-gateways
18112024-11-01T08:24:55.057ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
18122024-11-01T08:24:55.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42161 req_id = b8421801-c703-4977-ae47-13c0b9fad673 response_code = 204 uri = /eip-gateways
18132024-11-01T08:24:55.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61879 req_id = c2ff9f91-2bc7-4379-b48e-ef912b0cf037 response_code = 204 uri = /vpc-routes
18142024-11-01T08:24:55.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42161 req_id = a7653e02-f7a2-451b-9a60-be38fd58e8ce response_code = 204 uri = /vpc-routes
18152024-11-01T08:24:55.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60702
18162024-11-01T08:24:55.144ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18172024-11-01T08:24:55.144ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18182024-11-01T08:24:55.144ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18192024-11-01T08:24:55.144ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18202024-11-01T08:24:55.144ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18212024-11-01T08:24:55.144ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18222024-11-01T08:24:55.144ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18232024-11-01T08:24:55.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60702 req_id = d8444b15-7e41-4fa8-ad96-ce0d2d81d27e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18242024-11-01T08:24:55.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51975
18252024-11-01T08:24:55.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51975 req_id = ea9469e0-d6cb-4bff-899f-b1e70666d466 response_code = 200 uri = /v2p
18262024-11-01T08:24:55.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34662
18272024-11-01T08:24:55.204ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18282024-11-01T08:24:55.245ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18292024-11-01T08:24:55.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100799 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34662 req_id = d171871d-c11d-46b8-95b6-a4638d2dcfd8 response_code = 204 uri = /switch-ports
18302024-11-01T08:24:55.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42019
18312024-11-01T08:24:55.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64746
18322024-11-01T08:24:55.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34662 req_id = d3120530-3595-4a4b-82c9-74003387b115 response_code = 200 uri = /network-bootstore-config
18332024-11-01T08:24:55.305ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18342024-11-01T08:24:55.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42019 req_id = a727556d-6724-4d9e-bd80-bc4302f3a0f6 response_code = 200 uri = /v2p
18352024-11-01T08:24:55.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43861
18362024-11-01T08:24:55.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43861 req_id = 2394c2f1-c454-4d6a-af70-c07ee9ca1c9d response_code = 200 uri = /vpc-routes
18372024-11-01T08:24:55.350ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18382024-11-01T08:24:55.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
18392024-11-01T08:24:55.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 568 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43861 req_id = 7db25da2-a76e-4c4d-8c49-addc112fff44 response_code = 204 uri = /eip-gateways
18402024-11-01T08:24:55.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43861 req_id = 9703e152-88ff-4332-b921-01b5e57fab36 response_code = 204 uri = /vpc-routes
18412024-11-01T08:24:55.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55507
18422024-11-01T08:24:55.372ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18432024-11-01T08:24:55.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18442024-11-01T08:24:55.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18452024-11-01T08:24:55.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18462024-11-01T08:24:55.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18472024-11-01T08:24:55.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18482024-11-01T08:24:55.372ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18492024-11-01T08:24:55.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55507 req_id = a925bd76-06e8-4db8-9ead-601dada4ebc1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18502024-11-01T08:24:55.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114448 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64746 req_id = 3050c4f7-ee23-4ef8-95fe-304eba4b3afe response_code = 204 uri = /switch-ports
18512024-11-01T08:24:55.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64746 req_id = a62a0ebd-0e0b-4998-934f-83cc50cc0eb3 response_code = 200 uri = /network-bootstore-config
18522024-11-01T08:24:55.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33413
18532024-11-01T08:24:55.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33413 req_id = 0d136d40-2597-4946-be88-a8cf4f55e542 response_code = 200 uri = /v2p
18542024-11-01T08:24:55.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41390
18552024-11-01T08:24:55.453ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18562024-11-01T08:24:55.494ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18572024-11-01T08:24:55.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99987 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41390 req_id = 72d854f0-fc71-4deb-bea1-a0bfd25b5852 response_code = 204 uri = /switch-ports
18582024-11-01T08:24:55.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41390 req_id = 88535edd-aa36-44fe-955f-3211fbecf3cf response_code = 200 uri = /network-bootstore-config
18592024-11-01T08:24:55.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59822
18602024-11-01T08:24:55.557ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18612024-11-01T08:24:55.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18622024-11-01T08:24:55.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18632024-11-01T08:24:55.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18642024-11-01T08:24:55.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18652024-11-01T08:24:55.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18662024-11-01T08:24:55.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18672024-11-01T08:24:55.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59822 req_id = 81a3de5e-c0bf-42d9-ad5d-f9fc78e6c710 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18682024-11-01T08:25:20.841ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46277
18692024-11-01T08:25:20.841ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46277 req_id = 2ce63169-78fa-4e4d-803d-8a578e7f15c3 response_code = 200 uri = /baseboard
18702024-11-01T08:25:24.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38443
18712024-11-01T08:25:24.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38443 req_id = 23e4e043-67ff-43df-a274-ca96cd9ad747 response_code = 200 uri = /vpc-routes
18722024-11-01T08:25:24.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32892
18732024-11-01T08:25:24.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32892 req_id = 9edfadf2-7d4c-4978-9b73-f7407793f1f4 response_code = 200 uri = /vpc-routes
18742024-11-01T08:25:24.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
18752024-11-01T08:25:24.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38443 req_id = 197bca74-64ef-41e8-8e3c-18129596f1a3 response_code = 204 uri = /eip-gateways
18762024-11-01T08:25:24.964ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
18772024-11-01T08:25:24.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32892 req_id = eb76e5b9-aa9c-4da3-9d36-63dceec25ee0 response_code = 204 uri = /eip-gateways
18782024-11-01T08:25:24.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38443 req_id = 4403b9c2-19e0-47af-a842-35c82010c054 response_code = 204 uri = /vpc-routes
18792024-11-01T08:25:24.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45836
18802024-11-01T08:25:24.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45836 req_id = 4c140200-dd41-485e-a52b-c9ad293b5070 response_code = 200 uri = /v2p
18812024-11-01T08:25:25.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32892 req_id = be44df17-c313-4ec3-83a5-5bc8e2135a60 response_code = 204 uri = /vpc-routes
18822024-11-01T08:25:25.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32810
18832024-11-01T08:25:25.087ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18842024-11-01T08:25:25.131ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18852024-11-01T08:25:25.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103960 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32810 req_id = 98dea1a9-9355-4163-9bcf-89ca442973c9 response_code = 204 uri = /switch-ports
18862024-11-01T08:25:25.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33471
18872024-11-01T08:25:25.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62965
18882024-11-01T08:25:25.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42410
18892024-11-01T08:25:25.192ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18902024-11-01T08:25:25.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36072
18912024-11-01T08:25:25.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3655 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32810 req_id = 5eb04315-17de-4aad-b5c5-f313b90f2620 response_code = 200 uri = /network-bootstore-config
18922024-11-01T08:25:25.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3703 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62965 req_id = 4f263e8c-039e-4061-9477-ecfdf17853c5 response_code = 200 uri = /vpc-routes
18932024-11-01T08:25:25.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3966 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33471 req_id = f735f244-53f4-424e-906f-fbbe394810c1 response_code = 200 uri = /v2p
18942024-11-01T08:25:25.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36072 req_id = f84da87f-d841-4952-8b7a-3e90625e09d4 response_code = 200 uri = /v2p
18952024-11-01T08:25:25.211ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
18962024-11-01T08:25:25.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62965 req_id = c9e3cab9-19af-4a52-8308-cebb77a38a22 response_code = 204 uri = /eip-gateways
18972024-11-01T08:25:25.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61700
18982024-11-01T08:25:25.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 970 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62965 req_id = 31eae3b4-4793-4e92-a4bf-a54360bdf95c response_code = 204 uri = /vpc-routes
18992024-11-01T08:25:25.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19002024-11-01T08:25:25.291ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19012024-11-01T08:25:25.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99920 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42410 req_id = 62777f84-e1c7-48aa-ae19-4edc4b48724c response_code = 204 uri = /switch-ports
19022024-11-01T08:25:25.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 404 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42410 req_id = 8bacc858-8845-44e4-a90a-5476e019c85f response_code = 200 uri = /network-bootstore-config
19032024-11-01T08:25:25.328ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19042024-11-01T08:25:25.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61700 req_id = 4db0abd2-5621-4cb5-962e-a3294278cbc0 response_code = 204 uri = /switch-ports
19052024-11-01T08:25:25.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61700 req_id = 3902dd0b-4680-4db5-a502-c28460fbba4c response_code = 200 uri = /network-bootstore-config
19062024-11-01T08:25:50.879ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56270
19072024-11-01T08:25:50.879ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56270 req_id = 5c854373-4a21-403f-aeda-9791084bda7e response_code = 200 uri = /baseboard
19082024-11-01T08:25:54.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52882
19092024-11-01T08:25:54.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52882 req_id = a10f52b2-e3b3-4856-a0da-c671cb375d7f response_code = 200 uri = /vpc-routes
19102024-11-01T08:25:55.041ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
19112024-11-01T08:25:55.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52882 req_id = 718d13b9-b5b1-4472-91b9-b5108b74d76c response_code = 204 uri = /eip-gateways
19122024-11-01T08:25:55.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42676
19132024-11-01T08:25:55.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42676 req_id = 7b8cdbd6-fc71-4378-a160-b6d4bd6b8161 response_code = 200 uri = /vpc-routes
19142024-11-01T08:25:55.091ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
19152024-11-01T08:25:55.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42676 req_id = 9e485fb4-1d7e-4635-8779-933ea6b8fc50 response_code = 204 uri = /eip-gateways
19162024-11-01T08:25:55.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42676 req_id = e2f21ed0-d6c9-4c1c-b17d-8ee78443d88e response_code = 204 uri = /vpc-routes
19172024-11-01T08:25:55.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52422
19182024-11-01T08:25:55.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52422 req_id = f8a64b45-9ac9-43ff-b413-4079923da88d response_code = 200 uri = /v2p
19192024-11-01T08:25:55.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44884
19202024-11-01T08:25:55.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44884 req_id = 01572bdb-bbf4-4228-ae85-0a1d61502a21 response_code = 200 uri = /v2p
19212024-11-01T08:25:55.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52882 req_id = 50e665af-621b-4a6b-afc1-77dc7e30ebb0 response_code = 204 uri = /vpc-routes
19222024-11-01T08:25:55.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34298
19232024-11-01T08:25:55.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34298 req_id = 65c4c837-b7c1-407f-9096-939ee86a3c3f response_code = 200 uri = /v2p
19242024-11-01T08:25:55.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37159
19252024-11-01T08:25:55.226ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19262024-11-01T08:25:55.268ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19272024-11-01T08:25:55.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102253 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37159 req_id = a4422b54-0315-4385-a08e-adce29d604c7 response_code = 204 uri = /switch-ports
19282024-11-01T08:25:55.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62827
19292024-11-01T08:25:55.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40342
19302024-11-01T08:25:55.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40342 req_id = 96db5bde-07aa-4226-aaa4-41d735e15f72 response_code = 200 uri = /vpc-routes
19312024-11-01T08:25:55.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37159 req_id = 8f1ff819-d748-4637-8799-4f9f2f01cff5 response_code = 200 uri = /network-bootstore-config
19322024-11-01T08:25:55.329ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19332024-11-01T08:25:55.369ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19342024-11-01T08:25:55.373ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
19352024-11-01T08:25:55.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 661 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40342 req_id = 3feb760c-b8a6-4917-bf3d-d5b5fd14abc2 response_code = 204 uri = /eip-gateways
19362024-11-01T08:25:55.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 829 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40342 req_id = 473ff6f9-976a-4e96-888e-9d3b37c0bb6d response_code = 204 uri = /vpc-routes
19372024-11-01T08:25:55.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59167
19382024-11-01T08:25:55.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100105 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62827 req_id = 14a4a343-7733-4839-aec7-26cb3529ac4d response_code = 204 uri = /switch-ports
19392024-11-01T08:25:55.429ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19402024-11-01T08:25:55.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 612 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62827 req_id = ec6d6b17-4a72-4b97-b12b-3dfb86a9115f response_code = 200 uri = /network-bootstore-config
19412024-11-01T08:25:55.465ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19422024-11-01T08:25:55.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119764 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59167 req_id = e67227c9-3fa2-4bf6-b73d-599b44dc2d85 response_code = 204 uri = /switch-ports
19432024-11-01T08:25:55.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59167 req_id = bd70b692-22af-460d-8799-2262869b1bcc response_code = 200 uri = /network-bootstore-config
19442024-11-01T08:26:20.913ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59431
19452024-11-01T08:26:20.913ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59431 req_id = e3c90b94-6477-43fa-92b3-7eb57264463b response_code = 200 uri = /baseboard
19462024-11-01T08:26:24.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58434
19472024-11-01T08:26:24.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58434 req_id = 021a52bc-8d07-40b1-88ff-4fa4269668dc response_code = 200 uri = /vpc-routes
19482024-11-01T08:26:24.912ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
19492024-11-01T08:26:24.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58434 req_id = dcd13f70-7b4d-4d69-a44e-e392e90c1b7f response_code = 204 uri = /eip-gateways
19502024-11-01T08:26:24.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43891
19512024-11-01T08:26:24.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43891 req_id = 2f0a67e8-c499-4fa1-af88-d2945d8e4df6 response_code = 200 uri = /vpc-routes
19522024-11-01T08:26:24.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
19532024-11-01T08:26:24.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43891 req_id = 0604c26e-b051-455c-9332-5e1fd7ee6897 response_code = 204 uri = /eip-gateways
19542024-11-01T08:26:24.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43891 req_id = d9421763-cc4d-4371-9f7c-60f3e336c00a response_code = 204 uri = /vpc-routes
19552024-11-01T08:26:24.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56824
19562024-11-01T08:26:24.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56824 req_id = 271953c3-5619-4189-80cf-f6a5520af111 response_code = 200 uri = /v2p
19572024-11-01T08:26:25.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58434 req_id = ac07f0ff-4c89-4667-983e-d016b599feee response_code = 204 uri = /vpc-routes
19582024-11-01T08:26:25.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61434
19592024-11-01T08:26:25.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61434 req_id = af04ed4e-663e-4355-94a1-f3e09ac4236c response_code = 200 uri = /v2p
19602024-11-01T08:26:25.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60090
19612024-11-01T08:26:25.049ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19622024-11-01T08:26:25.091ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19632024-11-01T08:26:25.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107715 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60090 req_id = dad9629b-8503-4c03-bdf8-3c7e047cc954 response_code = 204 uri = /switch-ports
19642024-11-01T08:26:25.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40279
19652024-11-01T08:26:25.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60525
19662024-11-01T08:26:25.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60090 req_id = c1f8a6eb-c204-4d98-a092-e2a0648b62bc response_code = 200 uri = /network-bootstore-config
19672024-11-01T08:26:25.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60525 req_id = 35200742-6b1b-4c3e-8916-aed83997a94d response_code = 200 uri = /vpc-routes
19682024-11-01T08:26:25.157ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19692024-11-01T08:26:25.181ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
19702024-11-01T08:26:25.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 680 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60525 req_id = ddb1f521-bc68-43ee-bef1-d18daa3c7b92 response_code = 204 uri = /eip-gateways
19712024-11-01T08:26:25.203ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19722024-11-01T08:26:25.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59178
19732024-11-01T08:26:25.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59178 req_id = 2c646c7a-bc76-4475-8dbf-6172867bc8ac response_code = 200 uri = /v2p
19742024-11-01T08:26:25.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60525 req_id = d9e3530d-288c-49b7-a1b0-037351ee5d38 response_code = 204 uri = /vpc-routes
19752024-11-01T08:26:25.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45067
19762024-11-01T08:26:25.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104848 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40279 req_id = de8dc970-9c92-4111-8341-ca5c0e39caab response_code = 204 uri = /switch-ports
19772024-11-01T08:26:25.262ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19782024-11-01T08:26:25.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 729 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40279 req_id = 00efb23c-2986-4d7e-8a7c-c24876f6e14c response_code = 200 uri = /network-bootstore-config
19792024-11-01T08:26:25.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19802024-11-01T08:26:25.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102534 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45067 req_id = 871ed5f2-e3c5-4fc3-b464-df592748cc39 response_code = 204 uri = /switch-ports
19812024-11-01T08:26:25.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45067 req_id = cb990f62-6c40-4750-8952-c6d23c27f4ae response_code = 200 uri = /network-bootstore-config
19822024-11-01T08:26:50.947ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62431
19832024-11-01T08:26:50.947ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62431 req_id = 507cce08-701d-4142-82ab-dee7e8b9c98b response_code = 200 uri = /baseboard
19842024-11-01T08:26:55.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34595
19852024-11-01T08:26:55.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34595 req_id = 19fafb89-93f6-4fb8-92be-f775043ab652 response_code = 200 uri = /vpc-routes
19862024-11-01T08:26:55.062ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
19872024-11-01T08:26:55.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34595 req_id = fac349ed-a7d1-4fbf-a10d-3c267de5e1a3 response_code = 204 uri = /eip-gateways
19882024-11-01T08:26:55.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34595 req_id = 419c13e4-363a-4228-bf82-6e5b816451bc response_code = 204 uri = /vpc-routes
19892024-11-01T08:26:55.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45284
19902024-11-01T08:26:55.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45284 req_id = 919d87f5-3610-4ce8-bb9b-54f4a42bdc0c response_code = 200 uri = /vpc-routes
19912024-11-01T08:26:55.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44993
19922024-11-01T08:26:55.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44993 req_id = f887b6b0-f045-437b-a363-8a6d05ccdc19 response_code = 200 uri = /vpc-routes
19932024-11-01T08:26:55.144ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
19942024-11-01T08:26:55.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45284 req_id = 0d13e76e-b58f-44d6-9748-db3fcd34eaff response_code = 204 uri = /eip-gateways
19952024-11-01T08:26:55.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62219
19962024-11-01T08:26:55.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62219 req_id = 0a37d260-3b52-43a3-88e6-45b82b1f3bfb response_code = 200 uri = /v2p
19972024-11-01T08:26:55.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45284 req_id = 08797327-da97-4cef-8f9e-08852e19d274 response_code = 204 uri = /vpc-routes
19982024-11-01T08:26:55.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45244
19992024-11-01T08:26:55.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45244 req_id = ae1270fb-6641-473d-86cf-976aa3ea795b response_code = 200 uri = /v2p
20002024-11-01T08:26:55.202ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
20012024-11-01T08:26:55.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44993 req_id = 23c1d69e-e960-4558-8094-e8072dce7b28 response_code = 204 uri = /eip-gateways
20022024-11-01T08:26:55.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44993 req_id = f9d028bd-1beb-42a2-9a27-f868797080d7 response_code = 204 uri = /vpc-routes
20032024-11-01T08:26:55.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53639
20042024-11-01T08:26:55.290ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20052024-11-01T08:26:55.330ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20062024-11-01T08:26:55.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53639 req_id = f61144bf-5c80-457a-8f4f-ed2806b0c88d response_code = 204 uri = /switch-ports
20072024-11-01T08:26:55.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55529
20082024-11-01T08:26:55.388ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20092024-11-01T08:26:55.423ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20102024-11-01T08:26:55.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84469 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55529 req_id = 652fbad1-07d7-472e-8dbe-6cb79196c60d response_code = 204 uri = /switch-ports
20112024-11-01T08:26:55.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58308
20122024-11-01T08:26:55.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53639 req_id = 1ac25a8e-bd6b-4cb4-a8e0-84b0081b17f3 response_code = 200 uri = /network-bootstore-config
20132024-11-01T08:26:55.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55529 req_id = 5ea07513-2dc4-4a8a-9c11-e27195968983 response_code = 200 uri = /network-bootstore-config
20142024-11-01T08:26:55.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58308 req_id = f9531c42-1217-41a5-b310-a785a2919774 response_code = 200 uri = /v2p
20152024-11-01T08:26:55.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53802
20162024-11-01T08:26:55.507ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20172024-11-01T08:26:55.545ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20182024-11-01T08:26:55.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91444 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53802 req_id = 481bf77e-bef3-4c96-a5ff-ece9f7650dbc response_code = 204 uri = /switch-ports
20192024-11-01T08:26:55.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53802 req_id = b66b0b3c-8b97-43ea-a3d3-a55e58a77dd6 response_code = 200 uri = /network-bootstore-config
20202024-11-01T08:27:20.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20212024-11-01T08:27:20.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20222024-11-01T08:27:20.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20232024-11-01T08:27:20.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20242024-11-01T08:27:20.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20252024-11-01T08:27:20.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20262024-11-01T08:27:20.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20272024-11-01T08:27:20.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20282024-11-01T08:27:20.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20292024-11-01T08:27:20.980ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53441
20302024-11-01T08:27:20.980ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53441 req_id = dc7ef003-6000-4dcb-a71b-9fb6ea140e3d response_code = 200 uri = /baseboard
20312024-11-01T08:27:24.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51708
20322024-11-01T08:27:24.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51708 req_id = 0c869525-0704-4b32-99ff-32d1d90b4684 response_code = 200 uri = /vpc-routes
20332024-11-01T08:27:24.912ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
20342024-11-01T08:27:24.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51708 req_id = 37cf4b75-c2fe-42cf-9351-d89d3c3af1e4 response_code = 204 uri = /eip-gateways
20352024-11-01T08:27:24.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51708 req_id = 7bee7e26-bd99-4f40-b724-95f979aecd84 response_code = 204 uri = /vpc-routes
20362024-11-01T08:27:24.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38161
20372024-11-01T08:27:24.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38161 req_id = aa1b3c16-a425-40a8-9272-3f03a4c4df89 response_code = 200 uri = /vpc-routes
20382024-11-01T08:27:25.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44768
20392024-11-01T08:27:25.017ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20402024-11-01T08:27:25.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20412024-11-01T08:27:25.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44768 req_id = 6fbc6e0c-3873-4deb-8154-2abf696f5113 response_code = 204 uri = /switch-ports
20422024-11-01T08:27:25.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65088
20432024-11-01T08:27:25.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
20442024-11-01T08:27:25.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38161 req_id = 9ef620d0-d3d4-4ff5-a803-a71bbaf136ee response_code = 204 uri = /eip-gateways
20452024-11-01T08:27:25.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40728
20462024-11-01T08:27:25.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55601
20472024-11-01T08:27:25.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61044
20482024-11-01T08:27:25.131ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20492024-11-01T08:27:25.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44768 req_id = 77a31c37-a650-4093-9ee7-66e04e4b1276 response_code = 200 uri = /network-bootstore-config
20502024-11-01T08:27:25.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 869 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61044 req_id = 970eca80-c466-4198-ba10-6feb55413790 response_code = 200 uri = /vpc-routes
20512024-11-01T08:27:25.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4397 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55601 req_id = c595af19-da29-4462-9a4f-8bb517cc903a response_code = 200 uri = /v2p
20522024-11-01T08:27:25.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4421 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40728 req_id = cfe6d725-8dc7-463d-b1af-970bd3b4eb9a response_code = 200 uri = /v2p
20532024-11-01T08:27:25.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38161 req_id = 0d712c7d-7293-447a-82b0-2782b141ac47 response_code = 204 uri = /vpc-routes
20542024-11-01T08:27:25.175ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20552024-11-01T08:27:25.185ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
20562024-11-01T08:27:25.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61044 req_id = 99020efa-8a09-499e-b13f-681b747d2807 response_code = 204 uri = /eip-gateways
20572024-11-01T08:27:25.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50210
20582024-11-01T08:27:25.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61044 req_id = 0df303fa-1f9f-4857-b1b6-2fda9de1998e response_code = 204 uri = /vpc-routes
20592024-11-01T08:27:25.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43064
20602024-11-01T08:27:25.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43064 req_id = fb9dd7f5-3467-4812-8120-a9cc155bd533 response_code = 200 uri = /v2p
20612024-11-01T08:27:25.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111224 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65088 req_id = 88058d47-b22a-4a27-8218-84f8e3660d8c response_code = 204 uri = /switch-ports
20622024-11-01T08:27:25.242ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20632024-11-01T08:27:25.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 675 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65088 req_id = cffb34a8-63cd-4d3e-9158-f82aa039d87c response_code = 200 uri = /network-bootstore-config
20642024-11-01T08:27:25.279ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20652024-11-01T08:27:25.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145055 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50210 req_id = edd0ca69-41cd-4729-b712-ab80d7a1cf4f response_code = 204 uri = /switch-ports
20662024-11-01T08:27:25.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50210 req_id = b940608f-db00-4159-818a-cba6407a4841 response_code = 200 uri = /network-bootstore-config
20672024-11-01T08:27:30.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20682024-11-01T08:27:30.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20692024-11-01T08:27:30.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20702024-11-01T08:27:30.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20712024-11-01T08:27:30.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20722024-11-01T08:27:30.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20732024-11-01T08:27:30.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20742024-11-01T08:27:30.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20752024-11-01T08:27:30.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20762024-11-01T08:27:30.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20772024-11-01T08:27:30.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20782024-11-01T08:27:30.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20792024-11-01T08:27:30.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20802024-11-01T08:27:30.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20812024-11-01T08:27:30.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20822024-11-01T08:27:30.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20832024-11-01T08:27:30.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20842024-11-01T08:27:30.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20852024-11-01T08:27:40.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20862024-11-01T08:27:40.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20872024-11-01T08:27:40.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20882024-11-01T08:27:40.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20892024-11-01T08:27:40.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20902024-11-01T08:27:40.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20912024-11-01T08:27:40.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20922024-11-01T08:27:40.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20932024-11-01T08:27:40.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20942024-11-01T08:27:40.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20952024-11-01T08:27:40.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20962024-11-01T08:27:40.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20972024-11-01T08:27:40.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20982024-11-01T08:27:40.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
20992024-11-01T08:27:40.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21002024-11-01T08:27:40.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21012024-11-01T08:27:40.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21022024-11-01T08:27:40.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21032024-11-01T08:27:50.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21042024-11-01T08:27:50.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21052024-11-01T08:27:50.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21062024-11-01T08:27:50.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21072024-11-01T08:27:50.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21082024-11-01T08:27:50.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21092024-11-01T08:27:50.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21102024-11-01T08:27:50.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21112024-11-01T08:27:50.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21122024-11-01T08:27:50.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21132024-11-01T08:27:50.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21142024-11-01T08:27:50.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21152024-11-01T08:27:50.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21162024-11-01T08:27:50.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21172024-11-01T08:27:50.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21182024-11-01T08:27:50.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21192024-11-01T08:27:50.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21202024-11-01T08:27:50.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21212024-11-01T08:27:51.013ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49455
21222024-11-01T08:27:51.013ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49455 req_id = 0d107f78-d8c9-41d6-a275-cb059828ec1e response_code = 200 uri = /baseboard
21232024-11-01T08:27:55.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44545
21242024-11-01T08:27:55.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44545 req_id = 070cc91e-c482-4d3d-8d98-40b468e8453a response_code = 200 uri = /vpc-routes
21252024-11-01T08:27:55.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46903
21262024-11-01T08:27:55.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46903 req_id = 8484d896-56ad-4e5f-97b9-0b2f0e01297f response_code = 200 uri = /v2p
21272024-11-01T08:27:55.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57166
21282024-11-01T08:27:55.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57166 req_id = 410e70c4-051c-4412-9dff-51440e7e2abc response_code = 200 uri = /v2p
21292024-11-01T08:27:55.156ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
21302024-11-01T08:27:55.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44545 req_id = 639c9321-10fb-4105-aa61-dc91f93926e9 response_code = 204 uri = /eip-gateways
21312024-11-01T08:27:55.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37685
21322024-11-01T08:27:55.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37685 req_id = 3b885ec8-48d3-47a2-ad2f-f238918209f5 response_code = 200 uri = /vpc-routes
21332024-11-01T08:27:55.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44545 req_id = 3c5c63d9-55a1-4e82-8094-5059f4c8af65 response_code = 204 uri = /vpc-routes
21342024-11-01T08:27:55.209ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
21352024-11-01T08:27:55.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37685 req_id = 6b2662aa-aa24-4454-ad3d-8b8f96f4f4c5 response_code = 204 uri = /eip-gateways
21362024-11-01T08:27:55.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37685 req_id = e374c0d2-9365-4d19-98ed-7c645de4a531 response_code = 204 uri = /vpc-routes
21372024-11-01T08:27:55.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48016
21382024-11-01T08:27:55.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48016 req_id = b55071fe-b0cb-4b34-bb4a-5fec4dbaed18 response_code = 200 uri = /vpc-routes
21392024-11-01T08:27:55.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57201
21402024-11-01T08:27:55.266ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21412024-11-01T08:27:55.310ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21422024-11-01T08:27:55.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100916 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57201 req_id = 4436821b-06e4-43a3-8443-2162b98fb29c response_code = 204 uri = /switch-ports
21432024-11-01T08:27:55.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39391
21442024-11-01T08:27:55.368ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
21452024-11-01T08:27:55.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48016 req_id = 36112466-4f37-45cd-9eca-31263f787f11 response_code = 204 uri = /eip-gateways
21462024-11-01T08:27:55.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35350
21472024-11-01T08:27:55.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57201 req_id = 52c0dbc2-5b02-4c0d-91a5-c0b1a96e473f response_code = 200 uri = /network-bootstore-config
21482024-11-01T08:27:55.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21492024-11-01T08:27:55.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4548 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35350 req_id = 7c7bf2db-8fdd-4b8d-b755-7f2e52eb760a response_code = 200 uri = /v2p
21502024-11-01T08:27:55.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48016 req_id = 561ad643-3b49-449f-b395-2b51f04a399c response_code = 204 uri = /vpc-routes
21512024-11-01T08:27:55.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21522024-11-01T08:27:55.409ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
21532024-11-01T08:27:55.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
21542024-11-01T08:27:55.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36311
21552024-11-01T08:27:55.438ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 5240, tv_nsec: 281008756 } time_to_next_cleanup = 599.99999955s
21562024-11-01T08:27:55.467ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21572024-11-01T08:27:55.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39391 req_id = ed52df81-7006-40ae-933d-f47713e65323 response_code = 204 uri = /switch-ports
21582024-11-01T08:27:55.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 718 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39391 req_id = cdf7dacb-78d9-4cfe-9e99-6cbbc4e747ba response_code = 200 uri = /network-bootstore-config
21592024-11-01T08:27:55.507ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21602024-11-01T08:27:55.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131542 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36311 req_id = 3502f705-10dd-4b60-899d-efc0eb689967 response_code = 204 uri = /switch-ports
21612024-11-01T08:27:55.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36311 req_id = 313cabee-61d4-494a-85d0-8f1b499d9e51 response_code = 200 uri = /network-bootstore-config
21622024-11-01T08:28:00.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21632024-11-01T08:28:00.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21642024-11-01T08:28:00.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21652024-11-01T08:28:00.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21662024-11-01T08:28:00.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21672024-11-01T08:28:00.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21682024-11-01T08:28:00.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21692024-11-01T08:28:00.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21702024-11-01T08:28:00.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21712024-11-01T08:28:00.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21722024-11-01T08:28:00.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21732024-11-01T08:28:00.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21742024-11-01T08:28:00.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21752024-11-01T08:28:00.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21762024-11-01T08:28:00.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21772024-11-01T08:28:00.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21782024-11-01T08:28:00.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21792024-11-01T08:28:00.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21802024-11-01T08:28:09.755ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
21812024-11-01T08:28:10.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21822024-11-01T08:28:10.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21832024-11-01T08:28:10.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21842024-11-01T08:28:10.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21852024-11-01T08:28:10.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21862024-11-01T08:28:10.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21872024-11-01T08:28:10.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21882024-11-01T08:28:10.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21892024-11-01T08:28:10.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21902024-11-01T08:28:10.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21912024-11-01T08:28:10.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21922024-11-01T08:28:10.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21932024-11-01T08:28:10.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21942024-11-01T08:28:10.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21952024-11-01T08:28:10.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21962024-11-01T08:28:10.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21972024-11-01T08:28:10.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21982024-11-01T08:28:10.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
21992024-11-01T08:28:20.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22002024-11-01T08:28:20.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22012024-11-01T08:28:20.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22022024-11-01T08:28:20.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22032024-11-01T08:28:20.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22042024-11-01T08:28:20.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22052024-11-01T08:28:20.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22062024-11-01T08:28:20.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22072024-11-01T08:28:20.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22082024-11-01T08:28:20.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22092024-11-01T08:28:20.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22102024-11-01T08:28:20.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22112024-11-01T08:28:20.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22122024-11-01T08:28:20.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22132024-11-01T08:28:20.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22142024-11-01T08:28:20.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22152024-11-01T08:28:20.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22162024-11-01T08:28:20.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22172024-11-01T08:28:21.044ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53810
22182024-11-01T08:28:21.044ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53810 req_id = d25788a4-429f-48e2-996e-fc3ac7e861c8 response_code = 200 uri = /baseboard
22192024-11-01T08:28:24.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45420
22202024-11-01T08:28:24.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45420 req_id = e5e601e9-98e9-414d-b66f-ba7298e4cf88 response_code = 200 uri = /vpc-routes
22212024-11-01T08:28:24.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
22222024-11-01T08:28:24.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45420 req_id = 73384731-505b-41b0-9156-288ed8a743c5 response_code = 204 uri = /eip-gateways
22232024-11-01T08:28:25.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47006
22242024-11-01T08:28:25.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47006 req_id = 0ada886b-2f5a-4e2f-bd0b-62353ec0f9b4 response_code = 200 uri = /v2p
22252024-11-01T08:28:25.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45420 req_id = 5c1829eb-2d96-44aa-9014-0cbe5fbdf462 response_code = 204 uri = /vpc-routes
22262024-11-01T08:28:25.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59167
22272024-11-01T08:28:25.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59167 req_id = be7f119e-d3d8-46a2-a46d-b474b6481087 response_code = 200 uri = /vpc-routes
22282024-11-01T08:28:25.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33415
22292024-11-01T08:28:25.053ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22302024-11-01T08:28:25.101ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22312024-11-01T08:28:25.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112707 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33415 req_id = c7ca04f9-29c8-40d6-8052-adf4068b1a9b response_code = 204 uri = /switch-ports
22322024-11-01T08:28:25.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35742
22332024-11-01T08:28:25.166ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
22342024-11-01T08:28:25.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59167 req_id = 1c5c55c9-b472-4abc-8788-a1098d40fcb4 response_code = 204 uri = /eip-gateways
22352024-11-01T08:28:25.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55639
22362024-11-01T08:28:25.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53221
22372024-11-01T08:28:25.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53221 req_id = 85700fa4-f1b2-4537-a85c-22b21ee11c27 response_code = 200 uri = /vpc-routes
22382024-11-01T08:28:25.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33415 req_id = afde4a21-c310-43fc-93e7-c0da7c5ecc43 response_code = 200 uri = /network-bootstore-config
22392024-11-01T08:28:25.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35742 req_id = c9d72b46-e526-4bca-885e-dcb596b9e37d response_code = 200 uri = /v2p
22402024-11-01T08:28:25.166ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22412024-11-01T08:28:25.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59167 req_id = 9c0d16ba-abce-4f7f-a204-c2783f723459 response_code = 204 uri = /vpc-routes
22422024-11-01T08:28:25.213ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22432024-11-01T08:28:25.217ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
22442024-11-01T08:28:25.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 667 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53221 req_id = 0ac519d8-71d7-4642-8456-82e22ef7d1be response_code = 204 uri = /eip-gateways
22452024-11-01T08:28:25.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 851 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53221 req_id = 154b9f7e-912f-4b01-beb2-6c0ccc317c93 response_code = 204 uri = /vpc-routes
22462024-11-01T08:28:25.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64744
22472024-11-01T08:28:25.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44769
22482024-11-01T08:28:25.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44769 req_id = 99e3543b-5465-48d1-8680-2bd357e6cade response_code = 200 uri = /v2p
22492024-11-01T08:28:25.276ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22502024-11-01T08:28:25.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110083 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55639 req_id = 5b67340b-efe0-4fcb-b822-8dee286ad034 response_code = 204 uri = /switch-ports
22512024-11-01T08:28:25.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 639 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55639 req_id = 22de7532-79e4-4cda-8321-014b9d7ec0be response_code = 200 uri = /network-bootstore-config
22522024-11-01T08:28:25.313ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22532024-11-01T08:28:25.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118158 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64744 req_id = 20878596-9eb2-460c-a484-fdb8209c7506 response_code = 204 uri = /switch-ports
22542024-11-01T08:28:25.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64744 req_id = 9f9b7a1f-6221-41e7-b19d-f3bbf2bff1cc response_code = 200 uri = /network-bootstore-config
22552024-11-01T08:28:30.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22562024-11-01T08:28:30.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22572024-11-01T08:28:30.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22582024-11-01T08:28:30.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22592024-11-01T08:28:30.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22602024-11-01T08:28:30.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22612024-11-01T08:28:30.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22622024-11-01T08:28:30.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22632024-11-01T08:28:30.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22642024-11-01T08:28:30.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22652024-11-01T08:28:30.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22662024-11-01T08:28:30.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22672024-11-01T08:28:30.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22682024-11-01T08:28:30.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22692024-11-01T08:28:30.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22702024-11-01T08:28:30.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22712024-11-01T08:28:30.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22722024-11-01T08:28:30.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22732024-11-01T08:28:40.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22742024-11-01T08:28:40.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22752024-11-01T08:28:40.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22762024-11-01T08:28:40.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22772024-11-01T08:28:40.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22782024-11-01T08:28:40.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22792024-11-01T08:28:40.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22802024-11-01T08:28:40.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22812024-11-01T08:28:40.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22822024-11-01T08:28:40.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22832024-11-01T08:28:40.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22842024-11-01T08:28:40.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22852024-11-01T08:28:40.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22862024-11-01T08:28:40.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22872024-11-01T08:28:40.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22882024-11-01T08:28:40.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22892024-11-01T08:28:40.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22902024-11-01T08:28:40.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22912024-11-01T08:28:50.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22922024-11-01T08:28:50.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22932024-11-01T08:28:50.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22942024-11-01T08:28:50.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22952024-11-01T08:28:50.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22962024-11-01T08:28:50.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22972024-11-01T08:28:50.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22982024-11-01T08:28:50.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
22992024-11-01T08:28:50.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23002024-11-01T08:28:50.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23012024-11-01T08:28:50.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23022024-11-01T08:28:50.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23032024-11-01T08:28:50.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23042024-11-01T08:28:50.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23052024-11-01T08:28:50.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23062024-11-01T08:28:50.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23072024-11-01T08:28:50.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23082024-11-01T08:28:50.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23092024-11-01T08:28:51.078ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53291
23102024-11-01T08:28:51.078ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53291 req_id = e9ab5fc6-02d3-4207-8f01-b656dc4e8d74 response_code = 200 uri = /baseboard
23112024-11-01T08:28:55.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38492
23122024-11-01T08:28:55.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38492 req_id = 53c79343-5d0e-448d-95ac-787044dd3587 response_code = 200 uri = /vpc-routes
23132024-11-01T08:28:55.059ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
23142024-11-01T08:28:55.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38492 req_id = 6bd02ce7-ca48-4929-b968-f48fd0f20892 response_code = 204 uri = /eip-gateways
23152024-11-01T08:28:55.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38492 req_id = 25982f61-b127-4457-b151-464d9a2a1a9d response_code = 204 uri = /vpc-routes
23162024-11-01T08:28:55.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63360
23172024-11-01T08:28:55.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63360 req_id = b169a0bd-038b-465e-8068-14e91f7c6069 response_code = 200 uri = /vpc-routes
23182024-11-01T08:28:55.135ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
23192024-11-01T08:28:55.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63360 req_id = d3e6afc8-053c-4275-affc-0666cde9f39a response_code = 204 uri = /eip-gateways
23202024-11-01T08:28:55.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63360 req_id = aac806dd-caad-4630-b687-7f93352542af response_code = 204 uri = /vpc-routes
23212024-11-01T08:28:55.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42701
23222024-11-01T08:28:55.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42701 req_id = dc04d1c6-b057-4c4b-aab0-15e65912e816 response_code = 200 uri = /vpc-routes
23232024-11-01T08:28:55.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52320
23242024-11-01T08:28:55.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52320 req_id = 586ef5a6-2c2f-4755-abc2-1ec4792e0545 response_code = 200 uri = /v2p
23252024-11-01T08:28:55.206ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
23262024-11-01T08:28:55.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42701 req_id = d4ed2ee8-07b9-40f7-baa4-f5226482f2ca response_code = 204 uri = /eip-gateways
23272024-11-01T08:28:55.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42701 req_id = 74bf5442-7b6d-4149-a91b-124701b56094 response_code = 204 uri = /vpc-routes
23282024-11-01T08:28:55.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38839
23292024-11-01T08:28:55.290ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23302024-11-01T08:28:55.333ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23312024-11-01T08:28:55.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104546 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38839 req_id = 0a397915-ff92-4c67-a58b-1a2b07c152cb response_code = 204 uri = /switch-ports
23322024-11-01T08:28:55.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39945
23332024-11-01T08:28:55.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52202
23342024-11-01T08:28:55.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45477
23352024-11-01T08:28:55.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39945 req_id = efd6f847-5409-457e-8a26-9adda973bf34 response_code = 200 uri = /v2p
23362024-11-01T08:28:55.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38839 req_id = ea112708-d4a7-4cff-a62f-659e7634ddd1 response_code = 200 uri = /network-bootstore-config
23372024-11-01T08:28:55.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23382024-11-01T08:28:55.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6777 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52202 req_id = 1e5e8524-8eb2-46be-a2d4-990cfdb8e653 response_code = 200 uri = /v2p
23392024-11-01T08:28:55.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63469
23402024-11-01T08:28:55.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23412024-11-01T08:28:55.503ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23422024-11-01T08:28:55.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107366 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45477 req_id = 98f8a63a-2354-4535-adae-f3a8fa0b0d16 response_code = 204 uri = /switch-ports
23432024-11-01T08:28:55.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 711 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45477 req_id = 7b777692-69df-457e-9967-eb3df488ac41 response_code = 200 uri = /network-bootstore-config
23442024-11-01T08:28:55.541ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23452024-11-01T08:28:55.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181140 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63469 req_id = ed8654ef-81c4-42ca-9b5e-b430bb872ac1 response_code = 204 uri = /switch-ports
23462024-11-01T08:28:55.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63469 req_id = 881aba7b-b870-4d22-8c77-1b3018364132 response_code = 200 uri = /network-bootstore-config
23472024-11-01T08:29:00.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23482024-11-01T08:29:00.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23492024-11-01T08:29:00.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23502024-11-01T08:29:00.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23512024-11-01T08:29:00.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23522024-11-01T08:29:00.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23532024-11-01T08:29:00.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23542024-11-01T08:29:00.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23552024-11-01T08:29:00.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23562024-11-01T08:29:00.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23572024-11-01T08:29:00.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23582024-11-01T08:29:00.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23592024-11-01T08:29:00.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23602024-11-01T08:29:00.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23612024-11-01T08:29:00.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23622024-11-01T08:29:00.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23632024-11-01T08:29:00.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23642024-11-01T08:29:00.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23652024-11-01T08:29:10.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23662024-11-01T08:29:10.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23672024-11-01T08:29:10.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23682024-11-01T08:29:10.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23692024-11-01T08:29:10.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23702024-11-01T08:29:10.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23712024-11-01T08:29:10.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23722024-11-01T08:29:10.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23732024-11-01T08:29:10.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23742024-11-01T08:29:10.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23752024-11-01T08:29:10.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23762024-11-01T08:29:10.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23772024-11-01T08:29:10.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23782024-11-01T08:29:10.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23792024-11-01T08:29:10.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23802024-11-01T08:29:10.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23812024-11-01T08:29:10.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23822024-11-01T08:29:10.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23832024-11-01T08:29:20.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23842024-11-01T08:29:20.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23852024-11-01T08:29:20.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23862024-11-01T08:29:20.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23872024-11-01T08:29:20.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23882024-11-01T08:29:20.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23892024-11-01T08:29:20.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23902024-11-01T08:29:20.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23912024-11-01T08:29:20.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23922024-11-01T08:29:20.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23932024-11-01T08:29:20.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23942024-11-01T08:29:20.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23952024-11-01T08:29:20.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23962024-11-01T08:29:20.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23972024-11-01T08:29:20.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23982024-11-01T08:29:20.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
23992024-11-01T08:29:20.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24002024-11-01T08:29:20.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24012024-11-01T08:29:21.112ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52185
24022024-11-01T08:29:21.112ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52185 req_id = c0f1e553-a8d1-4a1a-9d99-f69f104e62de response_code = 200 uri = /baseboard
24032024-11-01T08:29:24.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37213
24042024-11-01T08:29:24.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37213 req_id = ad13e279-4d22-4036-9f73-c49bf2882d79 response_code = 200 uri = /vpc-routes
24052024-11-01T08:29:24.948ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
24062024-11-01T08:29:24.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37213 req_id = 541d112e-cd89-4203-869a-e318bda718a1 response_code = 204 uri = /eip-gateways
24072024-11-01T08:29:24.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37213 req_id = 301e762c-74ab-41a1-bdb9-ed836ca985ca response_code = 204 uri = /vpc-routes
24082024-11-01T08:29:25.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50414
24092024-11-01T08:29:25.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50414 req_id = 97f7239c-349f-4eda-b3ce-8c2833dfe060 response_code = 200 uri = /vpc-routes
24102024-11-01T08:29:25.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
24112024-11-01T08:29:25.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50414 req_id = 51c13c7c-f929-459f-8949-2e79b8eba6ad response_code = 204 uri = /eip-gateways
24122024-11-01T08:29:25.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57710
24132024-11-01T08:29:25.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57710 req_id = 8c078795-a323-4596-b836-e7ade20d534c response_code = 200 uri = /v2p
24142024-11-01T08:29:25.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41696
24152024-11-01T08:29:25.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41696 req_id = 0239b0d5-6289-48ad-960c-68469cbfc621 response_code = 200 uri = /v2p
24162024-11-01T08:29:25.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50414 req_id = 5bf6a513-0201-4a5e-bf22-379a45aa1dbb response_code = 204 uri = /vpc-routes
24172024-11-01T08:29:25.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42918
24182024-11-01T08:29:25.101ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24192024-11-01T08:29:25.144ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24202024-11-01T08:29:25.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42918 req_id = 7bb6c102-25f2-42d6-bbfc-fac071a28ec3 response_code = 204 uri = /switch-ports
24212024-11-01T08:29:25.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60566
24222024-11-01T08:29:25.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46446
24232024-11-01T08:29:25.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43090
24242024-11-01T08:29:25.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43090 req_id = 70d19964-0f45-41bb-bec9-28b4fcf99999 response_code = 200 uri = /vpc-routes
24252024-11-01T08:29:25.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46446 req_id = 6caaa4b2-6aea-4321-8368-28537e1fc177 response_code = 200 uri = /v2p
24262024-11-01T08:29:25.210ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24272024-11-01T08:29:25.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42918 req_id = c41f3661-ce9b-40a7-913c-be3547faa316 response_code = 200 uri = /network-bootstore-config
24282024-11-01T08:29:25.225ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
24292024-11-01T08:29:25.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43090 req_id = 67cbc021-c934-44a7-a99c-314cbb165bc4 response_code = 204 uri = /eip-gateways
24302024-11-01T08:29:25.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64396
24312024-11-01T08:29:25.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43090 req_id = 9063e9bf-be21-41ab-98fc-db2bea1850b4 response_code = 204 uri = /vpc-routes
24322024-11-01T08:29:25.254ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24332024-11-01T08:29:25.313ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24342024-11-01T08:29:25.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103008 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60566 req_id = 8a3ce6d9-3af7-4129-89ca-94754f6814bd response_code = 204 uri = /switch-ports
24352024-11-01T08:29:25.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60566 req_id = 079be38d-27bd-407f-861f-3434bc82c349 response_code = 200 uri = /network-bootstore-config
24362024-11-01T08:29:25.353ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24372024-11-01T08:29:25.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178381 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64396 req_id = 4d9c4c98-5ac2-414e-929d-7b3f394547c2 response_code = 204 uri = /switch-ports
24382024-11-01T08:29:25.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64396 req_id = 65c72880-4fa0-4470-b3d6-a2df0ae28fd0 response_code = 200 uri = /network-bootstore-config
24392024-11-01T08:29:30.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24402024-11-01T08:29:30.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24412024-11-01T08:29:30.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24422024-11-01T08:29:30.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24432024-11-01T08:29:30.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24442024-11-01T08:29:30.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24452024-11-01T08:29:30.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24462024-11-01T08:29:30.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24472024-11-01T08:29:30.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24482024-11-01T08:29:30.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24492024-11-01T08:29:30.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24502024-11-01T08:29:30.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24512024-11-01T08:29:30.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24522024-11-01T08:29:30.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24532024-11-01T08:29:30.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24542024-11-01T08:29:30.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24552024-11-01T08:29:30.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24562024-11-01T08:29:30.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24572024-11-01T08:29:40.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24582024-11-01T08:29:40.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24592024-11-01T08:29:40.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24602024-11-01T08:29:40.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24612024-11-01T08:29:40.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24622024-11-01T08:29:40.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24632024-11-01T08:29:40.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24642024-11-01T08:29:40.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24652024-11-01T08:29:40.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24662024-11-01T08:29:40.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24672024-11-01T08:29:40.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24682024-11-01T08:29:40.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24692024-11-01T08:29:40.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24702024-11-01T08:29:40.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24712024-11-01T08:29:40.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24722024-11-01T08:29:40.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24732024-11-01T08:29:40.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24742024-11-01T08:29:40.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24752024-11-01T08:29:50.552ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24762024-11-01T08:29:50.553ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24772024-11-01T08:29:50.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24782024-11-01T08:29:50.556ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24792024-11-01T08:29:50.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24802024-11-01T08:29:50.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24812024-11-01T08:29:50.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24822024-11-01T08:29:50.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24832024-11-01T08:29:50.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24842024-11-01T08:29:50.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24852024-11-01T08:29:50.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24862024-11-01T08:29:50.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24872024-11-01T08:29:50.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24882024-11-01T08:29:50.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24892024-11-01T08:29:50.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24902024-11-01T08:29:50.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24912024-11-01T08:29:50.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24922024-11-01T08:29:50.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
24932024-11-01T08:29:51.146ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54314
24942024-11-01T08:29:51.146ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54314 req_id = 46f14206-d3d3-4aff-b0ce-fefaacc74137 response_code = 200 uri = /baseboard
24952024-11-01T08:29:55.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50223
24962024-11-01T08:29:55.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50223 req_id = 2216b8cf-8258-4f52-a5e7-ea3c4c3cb2df response_code = 200 uri = /vpc-routes
24972024-11-01T08:29:55.047ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
24982024-11-01T08:29:55.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50223 req_id = c5d235ed-87bd-4955-a814-e4c9e0a5bb84 response_code = 204 uri = /eip-gateways
24992024-11-01T08:29:55.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41741
25002024-11-01T08:29:55.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41741 req_id = c8a520bd-6f34-42ad-a85b-f0b98b8b4086 response_code = 200 uri = /v2p
25012024-11-01T08:29:55.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49705
25022024-11-01T08:29:55.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49705 req_id = e264e912-28b4-42f5-9f31-105fd780ebd0 response_code = 200 uri = /vpc-routes
25032024-11-01T08:29:55.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58690
25042024-11-01T08:29:55.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58690 req_id = 5a8f98b5-34b2-47f0-8cb3-281d0dfc7b24 response_code = 200 uri = /vpc-routes
25052024-11-01T08:29:55.182ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
25062024-11-01T08:29:55.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49705 req_id = 4a14093c-852d-4ea4-b48c-37b98d937e2a response_code = 204 uri = /eip-gateways
25072024-11-01T08:29:55.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49705 req_id = 4c46d7b4-1a3f-45fb-9682-0ca4d530dbc8 response_code = 204 uri = /vpc-routes
25082024-11-01T08:29:55.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52473
25092024-11-01T08:29:55.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52473 req_id = ed2813a3-171a-433c-8abd-0e6f3d03886e response_code = 200 uri = /v2p
25102024-11-01T08:29:55.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50223 req_id = 5dff6746-6c28-4eb7-83ae-17d78ff67625 response_code = 204 uri = /vpc-routes
25112024-11-01T08:29:55.232ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
25122024-11-01T08:29:55.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58690 req_id = 42fcaff4-4dc9-4766-bdba-407c2df7fc52 response_code = 204 uri = /eip-gateways
25132024-11-01T08:29:55.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58690 req_id = ebd3c9e6-f501-4e2b-a1c9-1f1eec69449d response_code = 204 uri = /vpc-routes
25142024-11-01T08:29:55.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57828
25152024-11-01T08:29:55.292ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25162024-11-01T08:29:55.292ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25172024-11-01T08:29:55.293ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
25182024-11-01T08:29:55.293ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
25192024-11-01T08:29:55.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36695
25202024-11-01T08:29:55.320ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25212024-11-01T08:29:55.371ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25222024-11-01T08:29:55.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36695 req_id = 2b7caad9-8888-4fc2-987e-5714b7b4d774 response_code = 204 uri = /switch-ports
25232024-11-01T08:29:55.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35370
25242024-11-01T08:29:55.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33297
25252024-11-01T08:29:55.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49288
25262024-11-01T08:29:55.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60553
25272024-11-01T08:29:55.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 425 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60553 req_id = 4b1cfe85-498d-44ec-b74e-dc5814c4b03b response_code = 200 uri = /v2p
25282024-11-01T08:29:55.448ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25292024-11-01T08:29:55.448ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25302024-11-01T08:29:55.448ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25312024-11-01T08:29:55.448ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
25322024-11-01T08:29:55.448ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25332024-11-01T08:29:55.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 474 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36695 req_id = 80bfcd86-36e0-42ac-a8b8-2f6933ddd41a response_code = 200 uri = /network-bootstore-config
25342024-11-01T08:29:55.454ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
25352024-11-01T08:29:55.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39524
25362024-11-01T08:29:55.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42093
25372024-11-01T08:29:55.488ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25382024-11-01T08:29:55.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25392024-11-01T08:29:55.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25402024-11-01T08:29:55.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25412024-11-01T08:29:55.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
25422024-11-01T08:29:55.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25432024-11-01T08:29:55.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25442024-11-01T08:29:55.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 17128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42093 req_id = 7ac3bef3-6964-4f88-97fc-9f5830b5f6da response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25452024-11-01T08:29:55.503ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25462024-11-01T08:29:55.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61591
25472024-11-01T08:29:55.548ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25482024-11-01T08:29:55.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25492024-11-01T08:29:55.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25502024-11-01T08:29:55.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25512024-11-01T08:29:55.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
25522024-11-01T08:29:55.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25532024-11-01T08:29:55.548ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25542024-11-01T08:29:55.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 549 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61591 req_id = 03d90bcb-2b22-4421-802e-f8a8ba3c0843 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25552024-11-01T08:29:55.577ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25562024-11-01T08:29:55.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129848 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49288 req_id = 6d52aae8-816b-4d57-8cb7-f3fc2fca63af response_code = 204 uri = /switch-ports
25572024-11-01T08:29:55.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49288 req_id = 25d6b51c-3f7a-4ae7-9c51-8648ceba4090 response_code = 200 uri = /network-bootstore-config
25582024-11-01T08:29:55.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 295811 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57828 req_id = f8e50527-ee13-4477-be3c-24b08b72e26d response_code = 200 uri = /inventory
25592024-11-01T08:29:55.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42819
25602024-11-01T08:29:55.615ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4a60046a-0c59-475f-a452-3399752e7dd9, kind: Service { id: f5a9d05d-8509-4c10-96d8-97ac84fede0f }, name: Name("external-dns-f5a9d05d-8509-4c10-96d8-97ac84fede0f"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab98983a-4aab-4d1e-8d13-98942f9b174e, kind: Service { id: e7a6aafb-271b-4c58-a4ee-a120d4fe517b }, name: Name("external-dns-e7a6aafb-271b-4c58-a4ee-a120d4fe517b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 81ecf997-57d4-4b16-94b1-bcb08785201d, kind: Service { id: b67ad34e-9649-4b18-90ef-aca56d949585 }, name: Name("nexus-b67ad34e-9649-4b18-90ef-aca56d949585"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 197])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cadac89c-8cb5-4edf-b0c6-aadc6fb0b35e, kind: Service { id: 6faaa15b-0dc5-4caa-9f63-b47fef16cf54 }, name: Name("nexus-6faaa15b-0dc5-4caa-9f63-b47fef16cf54"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 7])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fcde1394-8ac7-436a-b81c-1258d67cfee5, kind: Service { id: eaf02a35-9d01-40bc-9134-1dfb345cdb64 }, name: Name("nexus-eaf02a35-9d01-40bc-9134-1dfb345cdb64"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25612024-11-01T08:29:55.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25622024-11-01T08:29:55.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25632024-11-01T08:29:55.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25642024-11-01T08:29:55.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
25652024-11-01T08:29:55.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25662024-11-01T08:29:55.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25672024-11-01T08:29:55.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42819 req_id = 6cae078b-67d1-4bbb-9475-41552f51accd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25682024-11-01T08:29:55.618ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25692024-11-01T08:29:55.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 233202 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39524 req_id = 34ffbd24-9c28-4dcf-a327-46b4865f976a response_code = 204 uri = /switch-ports
25702024-11-01T08:29:55.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39524 req_id = 5bb9730f-a3fa-4279-90ac-b95b42dca1d2 response_code = 200 uri = /network-bootstore-config
25712024-11-01T08:29:55.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 274100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35370 req_id = d953aa63-f342-416c-839e-c4facbb162cf response_code = 200 uri = /inventory
25722024-11-01T08:29:55.722ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25732024-11-01T08:29:55.722ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/config/omicron-zones.json file = common/src/ledger.rs:177
25742024-11-01T08:29:55.722ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/config/omicron-zones.json file = common/src/ledger.rs:177
25752024-11-01T08:29:55.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 505610 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33297 req_id = 9d3a0e9f-dff6-4a78-8b97-58e91b52747f response_code = 200 uri = /inventory
25762024-11-01T08:30:00.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25772024-11-01T08:30:00.555ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25782024-11-01T08:30:00.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25792024-11-01T08:30:00.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25802024-11-01T08:30:00.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25812024-11-01T08:30:00.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25822024-11-01T08:30:00.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25832024-11-01T08:30:00.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25842024-11-01T08:30:00.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25852024-11-01T08:30:00.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25862024-11-01T08:30:00.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25872024-11-01T08:30:00.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25882024-11-01T08:30:00.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25892024-11-01T08:30:00.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25902024-11-01T08:30:00.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25912024-11-01T08:30:00.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25922024-11-01T08:30:00.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25932024-11-01T08:30:00.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25942024-11-01T08:30:10.557ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25952024-11-01T08:30:10.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25962024-11-01T08:30:10.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25972024-11-01T08:30:10.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25982024-11-01T08:30:10.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
25992024-11-01T08:30:10.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26002024-11-01T08:30:10.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26012024-11-01T08:30:10.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26022024-11-01T08:30:10.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26032024-11-01T08:30:10.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26042024-11-01T08:30:10.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26052024-11-01T08:30:10.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26062024-11-01T08:30:10.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26072024-11-01T08:30:10.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26082024-11-01T08:30:10.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26092024-11-01T08:30:10.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26102024-11-01T08:30:10.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26112024-11-01T08:30:10.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26122024-11-01T08:30:20.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26132024-11-01T08:30:20.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26142024-11-01T08:30:20.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26152024-11-01T08:30:20.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26162024-11-01T08:30:20.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26172024-11-01T08:30:20.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26182024-11-01T08:30:20.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26192024-11-01T08:30:20.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26202024-11-01T08:30:20.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26212024-11-01T08:30:20.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26222024-11-01T08:30:20.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26232024-11-01T08:30:20.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26242024-11-01T08:30:20.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26252024-11-01T08:30:20.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26262024-11-01T08:30:20.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26272024-11-01T08:30:20.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26282024-11-01T08:30:20.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26292024-11-01T08:30:20.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26302024-11-01T08:30:21.179ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34434
26312024-11-01T08:30:21.179ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34434 req_id = 41eb5523-de77-4d91-a069-028aa312adcd response_code = 200 uri = /baseboard
26322024-11-01T08:30:24.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51763
26332024-11-01T08:30:24.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51763 req_id = 30dd8ded-9f70-44ee-a557-df991ce1cba5 response_code = 200 uri = /vpc-routes
26342024-11-01T08:30:24.957ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
26352024-11-01T08:30:24.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51763 req_id = dd312a53-b878-44ea-854f-1f2c55140edd response_code = 204 uri = /eip-gateways
26362024-11-01T08:30:24.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40670
26372024-11-01T08:30:24.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40670 req_id = 2d4b9dae-b09c-48af-a113-a811a97fcabe response_code = 200 uri = /v2p
26382024-11-01T08:30:24.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51763 req_id = 197d2962-a48a-4fb6-9c9a-9c2fefb2bf25 response_code = 204 uri = /vpc-routes
26392024-11-01T08:30:25.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54134
26402024-11-01T08:30:25.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54134 req_id = f42d573d-343b-45d3-9158-5b97d98c4983 response_code = 200 uri = /vpc-routes
26412024-11-01T08:30:25.017ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
26422024-11-01T08:30:25.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54134 req_id = f89e1bc3-2db2-49dc-a1e2-0a5ae10c4a15 response_code = 204 uri = /eip-gateways
26432024-11-01T08:30:25.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42481
26442024-11-01T08:30:25.028ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26452024-11-01T08:30:25.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26462024-11-01T08:30:25.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42481 req_id = 9d154ea5-c4b8-4428-ab5e-217b79e8883b response_code = 204 uri = /switch-ports
26472024-11-01T08:30:25.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55251
26482024-11-01T08:30:25.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46658
26492024-11-01T08:30:25.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40372
26502024-11-01T08:30:25.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42481 req_id = aacc71eb-4b63-4a36-b142-52e274bec674 response_code = 200 uri = /network-bootstore-config
26512024-11-01T08:30:25.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 514 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54134 req_id = 7bc8397a-9edc-438f-88da-1ce229bd16e6 response_code = 204 uri = /vpc-routes
26522024-11-01T08:30:25.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26532024-11-01T08:30:25.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40372 req_id = 8c90c113-1440-41b8-8852-ec55348ec06b response_code = 200 uri = /vpc-routes
26542024-11-01T08:30:25.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6667 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46658 req_id = 50827d19-b9fd-4ab5-b09b-8116f6d830f0 response_code = 200 uri = /v2p
26552024-11-01T08:30:25.192ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
26562024-11-01T08:30:25.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40372 req_id = ef4eadfd-faf0-41a4-bd9d-88729e8fa690 response_code = 204 uri = /eip-gateways
26572024-11-01T08:30:25.197ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26582024-11-01T08:30:25.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45445
26592024-11-01T08:30:25.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45445 req_id = bdef536e-a381-4151-b17e-4d09e3c398fc response_code = 200 uri = /v2p
26602024-11-01T08:30:25.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 522 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40372 req_id = 92348a6e-4bb9-46c6-b47a-aeaf88abb0ad response_code = 204 uri = /vpc-routes
26612024-11-01T08:30:25.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64449
26622024-11-01T08:30:25.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109901 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55251 req_id = b32bbd8b-4797-46ab-a80f-e39b283649d4 response_code = 204 uri = /switch-ports
26632024-11-01T08:30:25.262ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26642024-11-01T08:30:25.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 651 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55251 req_id = f26482bf-656f-451a-bb55-bf5c9b4e2b3e response_code = 200 uri = /network-bootstore-config
26652024-11-01T08:30:25.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26662024-11-01T08:30:25.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103366 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64449 req_id = bac1cb56-2217-4fee-b7be-e15601069d06 response_code = 204 uri = /switch-ports
26672024-11-01T08:30:25.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64449 req_id = 4977b39d-e36f-46df-9c5c-de5b7ae14802 response_code = 200 uri = /network-bootstore-config
26682024-11-01T08:30:30.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26692024-11-01T08:30:30.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26702024-11-01T08:30:30.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26712024-11-01T08:30:30.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26722024-11-01T08:30:30.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26732024-11-01T08:30:30.565ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26742024-11-01T08:30:30.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26752024-11-01T08:30:30.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26762024-11-01T08:30:30.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26772024-11-01T08:30:30.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26782024-11-01T08:30:30.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26792024-11-01T08:30:30.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26802024-11-01T08:30:30.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26812024-11-01T08:30:30.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26822024-11-01T08:30:30.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26832024-11-01T08:30:30.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26842024-11-01T08:30:30.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26852024-11-01T08:30:30.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26862024-11-01T08:30:40.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26872024-11-01T08:30:40.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26882024-11-01T08:30:40.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26892024-11-01T08:30:40.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26902024-11-01T08:30:40.567ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26912024-11-01T08:30:40.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26922024-11-01T08:30:40.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26932024-11-01T08:30:40.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26942024-11-01T08:30:40.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26952024-11-01T08:30:40.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26962024-11-01T08:30:40.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26972024-11-01T08:30:40.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26982024-11-01T08:30:40.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
26992024-11-01T08:30:40.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27002024-11-01T08:30:40.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27012024-11-01T08:30:40.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27022024-11-01T08:30:40.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27032024-11-01T08:30:40.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27042024-11-01T08:30:50.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27052024-11-01T08:30:50.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27062024-11-01T08:30:50.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27072024-11-01T08:30:50.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27082024-11-01T08:30:50.569ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27092024-11-01T08:30:50.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27102024-11-01T08:30:50.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27112024-11-01T08:30:50.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27122024-11-01T08:30:50.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27132024-11-01T08:30:50.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27142024-11-01T08:30:50.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27152024-11-01T08:30:50.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27162024-11-01T08:30:50.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27172024-11-01T08:30:50.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27182024-11-01T08:30:50.576ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27192024-11-01T08:30:50.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27202024-11-01T08:30:50.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27212024-11-01T08:30:50.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27222024-11-01T08:30:51.211ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41805
27232024-11-01T08:30:51.211ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41805 req_id = 519ebc3e-3c09-4012-9748-61964d79dec4 response_code = 200 uri = /baseboard
27242024-11-01T08:30:55.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37293
27252024-11-01T08:30:55.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37293 req_id = ea7a6e6c-8867-4e2d-baca-e47fa1099a5c response_code = 200 uri = /vpc-routes
27262024-11-01T08:30:55.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49618
27272024-11-01T08:30:55.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49618 req_id = ace0decb-a239-4adc-bb65-3c021f0c522a response_code = 200 uri = /vpc-routes
27282024-11-01T08:30:55.114ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
27292024-11-01T08:30:55.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37293 req_id = 61793d36-199c-40cc-bf01-0a7845e364cb response_code = 204 uri = /eip-gateways
27302024-11-01T08:30:55.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
27312024-11-01T08:30:55.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49618 req_id = d924afaa-62df-4c56-9778-8bbd4ee765dd response_code = 204 uri = /eip-gateways
27322024-11-01T08:30:55.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37293 req_id = e3374516-4975-4de1-a761-cfd9e5ac98fd response_code = 204 uri = /vpc-routes
27332024-11-01T08:30:55.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49618 req_id = 9ce37b69-3f1a-4ae5-8a09-fcf3c29f0f45 response_code = 204 uri = /vpc-routes
27342024-11-01T08:30:55.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33251
27352024-11-01T08:30:55.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33251 req_id = 676c9943-6598-4e2b-a8e2-76a33e3e87fe response_code = 200 uri = /v2p
27362024-11-01T08:30:55.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47613
27372024-11-01T08:30:55.191ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27382024-11-01T08:30:55.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27392024-11-01T08:30:55.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105432 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47613 req_id = 27d934c5-1ec4-44a1-b7eb-212b2316f4fb response_code = 204 uri = /switch-ports
27402024-11-01T08:30:55.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47809
27412024-11-01T08:30:55.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52413
27422024-11-01T08:30:55.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47613 req_id = c6a37ad9-a21a-4ffb-ab7d-3ccd7baf701d response_code = 200 uri = /network-bootstore-config
27432024-11-01T08:30:55.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52413 req_id = fcda4f9f-4458-411d-ae63-b6f9d5ea67bd response_code = 200 uri = /v2p
27442024-11-01T08:30:55.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47809 req_id = 211994fb-5dd4-4637-b331-3b84e9d3ce06 response_code = 200 uri = /v2p
27452024-11-01T08:30:55.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61067
27462024-11-01T08:30:55.308ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27472024-11-01T08:30:55.346ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27482024-11-01T08:30:55.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61067 req_id = e748c764-12c3-4886-93a3-b442c9d6f8ec response_code = 204 uri = /switch-ports
27492024-11-01T08:30:55.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32824
27502024-11-01T08:30:55.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32824 req_id = c4e54514-dfdf-4f08-a4cd-b8f1e40c065a response_code = 200 uri = /vpc-routes
27512024-11-01T08:30:55.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61067 req_id = a7db352b-3c38-47b9-b15b-410270d6b894 response_code = 200 uri = /network-bootstore-config
27522024-11-01T08:30:55.457ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
27532024-11-01T08:30:55.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32824 req_id = 31586d35-e565-400f-a7b4-b6043e0c9d67 response_code = 204 uri = /eip-gateways
27542024-11-01T08:30:55.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45651
27552024-11-01T08:30:55.464ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27562024-11-01T08:30:55.506ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27572024-11-01T08:30:55.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103235 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45651 req_id = 723eea6d-3599-4284-8a90-c7758255b283 response_code = 204 uri = /switch-ports
27582024-11-01T08:30:55.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32824 req_id = c940d3a3-96cb-4d89-ab6c-a4c1328c00e9 response_code = 204 uri = /vpc-routes
27592024-11-01T08:30:55.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45651 req_id = f5f453ea-3359-4266-8641-f6990abc361e response_code = 200 uri = /network-bootstore-config
27602024-11-01T08:31:00.566ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27612024-11-01T08:31:00.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27622024-11-01T08:31:00.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27632024-11-01T08:31:00.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27642024-11-01T08:31:00.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27652024-11-01T08:31:00.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27662024-11-01T08:31:00.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27672024-11-01T08:31:00.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27682024-11-01T08:31:00.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27692024-11-01T08:31:00.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27702024-11-01T08:31:00.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27712024-11-01T08:31:00.576ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27722024-11-01T08:31:00.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27732024-11-01T08:31:00.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27742024-11-01T08:31:00.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27752024-11-01T08:31:00.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27762024-11-01T08:31:00.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27772024-11-01T08:31:00.587ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27782024-11-01T08:31:10.568ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27792024-11-01T08:31:10.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27802024-11-01T08:31:10.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27812024-11-01T08:31:10.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27822024-11-01T08:31:10.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27832024-11-01T08:31:10.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27842024-11-01T08:31:10.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27852024-11-01T08:31:10.576ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27862024-11-01T08:31:10.576ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27872024-11-01T08:31:10.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27882024-11-01T08:31:10.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27892024-11-01T08:31:10.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27902024-11-01T08:31:10.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27912024-11-01T08:31:10.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27922024-11-01T08:31:10.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27932024-11-01T08:31:10.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27942024-11-01T08:31:10.588ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27952024-11-01T08:31:10.589ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27962024-11-01T08:31:20.570ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27972024-11-01T08:31:20.571ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27982024-11-01T08:31:20.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
27992024-11-01T08:31:20.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28002024-11-01T08:31:20.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28012024-11-01T08:31:20.576ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28022024-11-01T08:31:20.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28032024-11-01T08:31:20.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28042024-11-01T08:31:20.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28052024-11-01T08:31:20.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28062024-11-01T08:31:20.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28072024-11-01T08:31:20.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28082024-11-01T08:31:20.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28092024-11-01T08:31:20.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28102024-11-01T08:31:20.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28112024-11-01T08:31:20.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28122024-11-01T08:31:20.589ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28132024-11-01T08:31:20.591ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28142024-11-01T08:31:21.244ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50925
28152024-11-01T08:31:21.245ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50925 req_id = eea7293c-6401-4a9a-8343-cb79d1ce151d response_code = 200 uri = /baseboard
28162024-11-01T08:31:24.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52858
28172024-11-01T08:31:24.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52858 req_id = 1956e787-d363-42a9-99cc-544b28f53b6e response_code = 200 uri = /vpc-routes
28182024-11-01T08:31:24.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34720
28192024-11-01T08:31:24.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34720 req_id = ab626b21-7d39-4b49-b6f4-7c7a72c177c6 response_code = 200 uri = /vpc-routes
28202024-11-01T08:31:24.991ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
28212024-11-01T08:31:24.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34720 req_id = 387488c4-97b8-4a60-914c-9f2346b9726c response_code = 204 uri = /eip-gateways
28222024-11-01T08:31:25.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
28232024-11-01T08:31:25.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52858 req_id = eaf4fe10-7ed4-4d86-8adc-f3310eef9372 response_code = 204 uri = /eip-gateways
28242024-11-01T08:31:25.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52858 req_id = 1c97ebd6-f5a8-4e38-bcbe-439b361a7431 response_code = 204 uri = /vpc-routes
28252024-11-01T08:31:25.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60962
28262024-11-01T08:31:25.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60962 req_id = d67bcd6c-a4c6-435e-8483-36ecb62a0aa1 response_code = 200 uri = /v2p
28272024-11-01T08:31:25.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34720 req_id = d82c9076-885e-4a1c-953c-aa7c31376e68 response_code = 204 uri = /vpc-routes
28282024-11-01T08:31:25.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61344
28292024-11-01T08:31:25.051ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28302024-11-01T08:31:25.097ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28312024-11-01T08:31:25.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61344 req_id = ec80e4b9-20d7-400d-9fe8-a40d1dfe0ac4 response_code = 204 uri = /switch-ports
28322024-11-01T08:31:25.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36060
28332024-11-01T08:31:25.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50879
28342024-11-01T08:31:25.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50597
28352024-11-01T08:31:25.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51756
28362024-11-01T08:31:25.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50597 req_id = cbc092b8-c9b4-4e5c-8066-a5caac3fdc87 response_code = 200 uri = /vpc-routes
28372024-11-01T08:31:25.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36060 req_id = 4a7fdace-c7eb-4459-ad20-68a4e8c37d1f response_code = 200 uri = /v2p
28382024-11-01T08:31:25.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61344 req_id = 5a3434f3-35b8-4d20-b434-ff3ababcfc24 response_code = 200 uri = /network-bootstore-config
28392024-11-01T08:31:25.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50879 req_id = c7dd50b3-fc23-4989-a6e3-ceffc349656d response_code = 200 uri = /v2p
28402024-11-01T08:31:25.163ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28412024-11-01T08:31:25.183ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
28422024-11-01T08:31:25.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 559 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50597 req_id = b9f66b69-c67c-462f-b94f-5a07ba338853 response_code = 204 uri = /eip-gateways
28432024-11-01T08:31:25.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 884 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50597 req_id = 2ce4a90c-e5b3-4aac-85a4-c859b6dc3daf response_code = 204 uri = /vpc-routes
28442024-11-01T08:31:25.206ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28452024-11-01T08:31:25.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46320
28462024-11-01T08:31:25.264ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28472024-11-01T08:31:25.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100804 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51756 req_id = 67487fb4-e8f2-4c70-a050-1127681fe70a response_code = 204 uri = /switch-ports
28482024-11-01T08:31:25.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 609 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51756 req_id = 5c75b3c5-950a-40b1-b047-8f30a712bfc2 response_code = 200 uri = /network-bootstore-config
28492024-11-01T08:31:25.303ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28502024-11-01T08:31:25.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46320 req_id = 3fac4ca4-526a-4038-9b8c-d8573c10cd29 response_code = 204 uri = /switch-ports
28512024-11-01T08:31:25.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46320 req_id = fdd1ef5c-0fbb-40b6-9eee-28dc888da846 response_code = 200 uri = /network-bootstore-config
28522024-11-01T08:31:30.572ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28532024-11-01T08:31:30.573ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28542024-11-01T08:31:30.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28552024-11-01T08:31:30.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28562024-11-01T08:31:30.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28572024-11-01T08:31:30.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28582024-11-01T08:31:30.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28592024-11-01T08:31:30.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28602024-11-01T08:31:30.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28612024-11-01T08:31:30.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28622024-11-01T08:31:30.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28632024-11-01T08:31:30.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28642024-11-01T08:31:30.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28652024-11-01T08:31:30.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28662024-11-01T08:31:30.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28672024-11-01T08:31:30.588ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28682024-11-01T08:31:30.591ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28692024-11-01T08:31:30.592ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28702024-11-01T08:31:39.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44113
28712024-11-01T08:31:39.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44113 req_id = 5fa32447-5b34-4e80-888a-b22884ca9f9d response_code = 200 uri = /v2p
28722024-11-01T08:31:39.519ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(12028161) }
28732024-11-01T08:31:39.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44113 req_id = 5996635d-38c0-4b06-ad9e-97b3ffd94c58 response_code = 204 uri = /v2p
28742024-11-01T08:31:39.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56555
28752024-11-01T08:31:39.661ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e7eb2722-6b59-4e1a-8c72-5482f793ac6f, kind: Instance { id: 11684db6-af09-4413-bb93-4c4d7433d660 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12028161), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e7eb2722-6b59-4e1a-8c72-5482f793ac6f, kind: Instance { id: 11684db6-af09-4413-bb93-4c4d7433d660 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12028161), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e7eb2722-6b59-4e1a-8c72-5482f793ac6f, kind: Instance { id: 11684db6-af09-4413-bb93-4c4d7433d660 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12028161), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(12028161))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e7eb2722-6b59-4e1a-8c72-5482f793ac6f, kind: Instance { id: 11684db6-af09-4413-bb93-4c4d7433d660 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12028161), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-4f69d963b78", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 10e76976-4b37-4fef-aa6f-8643e71d22e6, read_only_parent: Some(Volume { block_size: 512, id: b2d86011-6f55-4292-a30d-178e6757247e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1cbf9aed-b13c-434b-896a-70de96a9c942, key: Some("fpgOjyb4lsnxCRViW2BO/Q9UVrwE989MrZmCbxsdj4M="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 10e76976-4b37-4fef-aa6f-8643e71d22e6, key: Some("OTazdEfezC93XoI9ZF93nVhO5r6hZG011UJsY20UVKg="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19000", "[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-4f69d963b78" }] }), cloud_init_bytes: Some(..) } instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 metadata = InstanceMetadata { silo_id: f8c93fa7-6555-4906-9ff7-39adb002e287, project_id: 7e2cae8b-b8fe-447c-87dc-1808aa00f5f8 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-01T08:31:39.658092511Z }
28762024-11-01T08:31:39.661ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 migration_id = None propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
28772024-11-01T08:31:39.661ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 migration_id = None propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e7eb2722-6b59-4e1a-8c72-5482f793ac6f, kind: Instance { id: 11684db6-af09-4413-bb93-4c4d7433d660 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12028161), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e7eb2722-6b59-4e1a-8c72-5482f793ac6f, kind: Instance { id: 11684db6-af09-4413-bb93-4c4d7433d660 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12028161), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e7eb2722-6b59-4e1a-8c72-5482f793ac6f, kind: Instance { id: 11684db6-af09-4413-bb93-4c4d7433d660 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12028161), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(12028161))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e7eb2722-6b59-4e1a-8c72-5482f793ac6f, kind: Instance { id: 11684db6-af09-4413-bb93-4c4d7433d660 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12028161), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-4f69d963b78", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 10e76976-4b37-4fef-aa6f-8643e71d22e6, read_only_parent: Some(Volume { block_size: 512, id: b2d86011-6f55-4292-a30d-178e6757247e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1cbf9aed-b13c-434b-896a-70de96a9c942, key: Some("fpgOjyb4lsnxCRViW2BO/Q9UVrwE989MrZmCbxsdj4M="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 10e76976-4b37-4fef-aa6f-8643e71d22e6, key: Some("OTazdEfezC93XoI9ZF93nVhO5r6hZG011UJsY20UVKg="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19000", "[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-4f69d963b78" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-01T08:31:39.658092511Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28782024-11-01T08:31:39.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 758 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56555 req_id = ff59405d-4ee5-44ab-b0b3-2154fda103f7 response_code = 200 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5
28792024-11-01T08:31:39.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59285
28802024-11-01T08:31:39.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59285 req_id = b159c6ab-aaa7-42c1-88fc-56261c0db0d5 response_code = 200 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5/state
28812024-11-01T08:31:39.741ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 12028161 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28822024-11-01T08:31:39.741ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28832024-11-01T08:31:39.782ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5 file = illumos-utils/src/zone.rs:325 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
28842024-11-01T08:31:39.804ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5 file = illumos-utils/src/zone.rs:363 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
28852024-11-01T08:31:39.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39622
28862024-11-01T08:31:39.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39622 req_id = 7ee162d6-4909-4aa4-9b95-6e080d923bd5 response_code = 200 uri = /vpc-routes
28872024-11-01T08:31:39.861ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {e7eb2722-6b59-4e1a-8c72-5482f793ac6f: {10.151.2.176: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}, 10.151.2.175: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}}} }
28882024-11-01T08:31:40.574ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28892024-11-01T08:31:40.576ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28902024-11-01T08:31:40.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28912024-11-01T08:31:40.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28922024-11-01T08:31:40.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28932024-11-01T08:31:40.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28942024-11-01T08:31:40.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28952024-11-01T08:31:40.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28962024-11-01T08:31:40.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28972024-11-01T08:31:40.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28982024-11-01T08:31:40.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
28992024-11-01T08:31:40.585ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29002024-11-01T08:31:40.585ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29012024-11-01T08:31:40.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29022024-11-01T08:31:40.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29032024-11-01T08:31:40.590ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29042024-11-01T08:31:40.592ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29052024-11-01T08:31:40.594ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29062024-11-01T08:31:40.882ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29072024-11-01T08:31:40.882ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
29082024-11-01T08:31:41.081ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 56.614575ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
29092024-11-01T08:31:41.168ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 114.792685ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
29102024-11-01T08:31:41.311ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 172.422854ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
29112024-11-01T08:31:41.503ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 274.546893ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
29122024-11-01T08:31:41.791ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 810.371927ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
29132024-11-01T08:31:42.617ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 971.553234ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
29142024-11-01T08:31:43.602ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 945.191062ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
29152024-11-01T08:31:44.560ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 906.956892ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
29162024-11-01T08:31:45.481ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 901.795689ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 zone = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
29172024-11-01T08:31:46.419ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5 file = sled-agent/src/instance.rs:1787 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29182024-11-01T08:31:46.431ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 57.261623ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29192024-11-01T08:31:46.500ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5") failed: Property not found. retry in 71.066343ms file = illumos-utils/src/svc.rs:36 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29202024-11-01T08:31:46.586ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29212024-11-01T08:31:46.624ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29222024-11-01T08:31:46.763ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29232024-11-01T08:31:46.764ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29242024-11-01T08:31:46.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6902988 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39622 req_id = 68df24ed-1fd0-4207-a88a-b74694dd2f3b response_code = 204 uri = /eip-gateways
29252024-11-01T08:31:46.764ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-01T08:31:46.764459154Z } file = sled-agent/src/instance.rs:780 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29262024-11-01T08:31:46.764ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-01T08:31:46.764459154Z } propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29272024-11-01T08:31:46.764ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-01T08:31:46.764459154Z }, migration_in: None, migration_out: None }
29282024-11-01T08:31:46.796ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-01T08:31:46.796672056Z } file = sled-agent/src/instance.rs:780 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29292024-11-01T08:31:46.796ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T08:31:46.796672056Z } propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29302024-11-01T08:31:46.796ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-01T08:31:46.796672056Z }, migration_in: None, migration_out: None }
29312024-11-01T08:31:46.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39622 req_id = f01e0dcd-242d-4134-9d42-2642fd723d1b response_code = 204 uri = /vpc-routes
29322024-11-01T08:31:50.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29332024-11-01T08:31:50.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29342024-11-01T08:31:50.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29352024-11-01T08:31:50.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29362024-11-01T08:31:50.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29372024-11-01T08:31:50.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29382024-11-01T08:31:50.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29392024-11-01T08:31:50.584ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29402024-11-01T08:31:50.585ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29412024-11-01T08:31:50.585ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29422024-11-01T08:31:50.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29432024-11-01T08:31:50.587ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29442024-11-01T08:31:50.587ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29452024-11-01T08:31:50.588ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29462024-11-01T08:31:50.588ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29472024-11-01T08:31:50.592ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29482024-11-01T08:31:50.593ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29492024-11-01T08:31:50.596ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
29502024-11-01T08:31:51.277ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58475
29512024-11-01T08:31:51.277ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58475 req_id = 00d39401-54d2-4903-81a6-a1f3a666533b response_code = 200 uri = /baseboard
29522024-11-01T08:31:55.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55127
29532024-11-01T08:31:55.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55127 req_id = 04b9e5a8-1c5e-4f64-9ef1-4d1b2957b688 response_code = 200 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5/state
29542024-11-01T08:31:55.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56088
29552024-11-01T08:31:55.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56088 req_id = bcd94b9b-a415-4708-a3b5-c461a6b43eec response_code = 200 uri = /vpc-routes
29562024-11-01T08:31:55.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {e7eb2722-6b59-4e1a-8c72-5482f793ac6f: {10.151.2.176: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}, 10.151.2.175: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}}} }
29572024-11-01T08:31:55.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56088 req_id = 4ecf983c-3c7f-457f-aecb-36bbc582a00d response_code = 204 uri = /eip-gateways
29582024-11-01T08:31:55.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65242
29592024-11-01T08:31:55.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65242 req_id = c01134df-881a-4fb8-a145-0730b5f45f57 response_code = 200 uri = /vpc-routes
29602024-11-01T08:31:55.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56088 req_id = 851a5cad-a6a5-494c-8b03-625dcf41dc68 response_code = 204 uri = /vpc-routes
29612024-11-01T08:31:55.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43600
29622024-11-01T08:31:55.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43600 req_id = f88aa2af-7177-4341-9443-9890cf391fcc response_code = 200 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5/state
29632024-11-01T08:31:55.213ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {e7eb2722-6b59-4e1a-8c72-5482f793ac6f: {10.151.2.176: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}, 10.151.2.175: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}}} }
29642024-11-01T08:31:55.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65242 req_id = 98105b27-f75c-48c8-8855-d11e258fdff9 response_code = 204 uri = /eip-gateways
29652024-11-01T08:31:55.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60365
29662024-11-01T08:31:55.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60365 req_id = f10e5341-bb2f-4c6a-ab00-6493ce1e52f2 response_code = 200 uri = /vpc-routes
29672024-11-01T08:31:55.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65242 req_id = 19efbe22-f6c5-4397-a469-72a6fe6e4377 response_code = 204 uri = /vpc-routes
29682024-11-01T08:31:55.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44052
29692024-11-01T08:31:55.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44052 req_id = 51756b3c-b1f4-4488-a272-8451131bc15c response_code = 200 uri = /v2p
29702024-11-01T08:31:55.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39170
29712024-11-01T08:31:55.281ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
29722024-11-01T08:31:55.326ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
29732024-11-01T08:31:55.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39170 req_id = 886cd676-254b-4497-b030-0ed8bdc041f8 response_code = 204 uri = /switch-ports
29742024-11-01T08:31:55.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61117
29752024-11-01T08:31:55.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38718
29762024-11-01T08:31:55.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47068
29772024-11-01T08:31:55.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47068 req_id = b22e440f-50e9-4a77-874b-c2e0e5f35c3d response_code = 200 uri = /v2p
29782024-11-01T08:31:55.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39170 req_id = ffa1f8cc-4323-46fb-9e2b-e429aad0a1a7 response_code = 200 uri = /network-bootstore-config
29792024-11-01T08:31:55.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38718 req_id = 6a4e6b06-0abf-4de8-8e47-66ba5f5648c5 response_code = 200 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5/state
29802024-11-01T08:31:55.399ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
29812024-11-01T08:31:55.406ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {e7eb2722-6b59-4e1a-8c72-5482f793ac6f: {10.151.2.176: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}, 10.151.2.175: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}}} }
29822024-11-01T08:31:55.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 715 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60365 req_id = aa23f3ab-507d-48c7-b1c8-a4c6a59580c8 response_code = 204 uri = /eip-gateways
29832024-11-01T08:31:55.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 391 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60365 req_id = 94665a22-249d-4773-b171-2c3372f7ada6 response_code = 204 uri = /vpc-routes
29842024-11-01T08:31:55.447ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
29852024-11-01T08:31:55.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113909 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61117 req_id = 9376f4bf-8e5d-4696-9d92-6f37ec2f77ce response_code = 204 uri = /switch-ports
29862024-11-01T08:31:55.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61117 req_id = 15d8ab52-0e26-40e5-8725-458c7284588e response_code = 200 uri = /network-bootstore-config
29872024-11-01T08:31:55.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38448
29882024-11-01T08:31:55.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38448 req_id = a8a758f5-3281-4587-9651-4615be68b7ed response_code = 200 uri = /v2p
29892024-11-01T08:31:55.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59271
29902024-11-01T08:31:55.578ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
29912024-11-01T08:31:55.619ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
29922024-11-01T08:31:55.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59271 req_id = aa0daf3a-5116-461a-a85b-22225ae59ae1 response_code = 204 uri = /switch-ports
29932024-11-01T08:31:55.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59271 req_id = caf9b4d3-6c46-4ea9-857e-23e1440f5a11 response_code = 200 uri = /network-bootstore-config
29942024-11-01T08:31:57.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42975
29952024-11-01T08:31:57.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 567 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42975 req_id = c1c1f686-c313-4364-9287-7ff5d72eff36 response_code = 200 uri = /vmms/6fe550a6-35c1-4ea3-b3b5-4934906222d5/state
29962024-11-01T08:31:57.326ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-01T08:31:57.326837240Z } file = sled-agent/src/instance.rs:780 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29972024-11-01T08:31:57.326ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-01T08:31:57.326837240Z } propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
29982024-11-01T08:31:57.326ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-01T08:31:57.326837240Z }, migration_in: None, migration_out: None }
29992024-11-01T08:31:57.340ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-01T08:31:57.340230769Z } file = sled-agent/src/instance.rs:780 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
30002024-11-01T08:31:57.340ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-01T08:31:57.340230769Z } propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
30012024-11-01T08:31:57.340ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
30022024-11-01T08:31:57.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
30032024-11-01T08:31:57.340ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 10807032226635440270 n_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30042024-11-01T08:31:57.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
30052024-11-01T08:31:57.340ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 7468542518917171295 n_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30062024-11-01T08:31:57.340ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/26aa577c-6bd9-4461-bfa2-1f0c7ce2e973/debug/bundle/zone", "/pool/int/437cc0f8-cee4-4fe4-a027-42fa12428505/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/8c13d012-7fe1-48a4-8f49-bd4b8f1c925d/crypt/debug", "/pool/ext/6b307b27-321f-475e-9d0a-7877e7e97d8e/crypt/debug", "/pool/ext/8ced4573-45f7-474a-9fb1-aea34b9e8e79/crypt/debug", "/pool/ext/2594f9a2-060c-4e4e-b29d-e5f6940f72cb/crypt/debug", "/pool/ext/f2d00bfb-9004-4347-be63-b51172722fd1/crypt/debug", "/pool/ext/bc7c6e7d-afb2-4573-b1cd-22c23c48ada9/crypt/debug", "/pool/ext/8b236217-c0e1-4577-a9da-0a2d7b6af284/crypt/debug", "/pool/ext/fd3db670-6bf7-4efd-bc98-fba2dadc0267/crypt/debug", "/pool/ext/e1e3ff7c-24ad-4b58-b036-90d5df3d681f/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5
30072024-11-01T08:31:57.998ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5", bundle_id: 9dfc7bd2-15d0-416a-b1ac-df7718e23a95 }, time_created: 2024-11-01T08:31:57.341495690Z, version: 0, cause: TerminatedInstance }
30082024-11-01T08:31:57.998ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_6fe550a6-35c1-4ea3-b3b5-4934906222d5 file = sled-agent/src/instance.rs:1032 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
30092024-11-01T08:31:59.733ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
30102024-11-01T08:31:59.751ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(12028161), kind: System }
30112024-11-01T08:31:59.751ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(12028161), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30122024-11-01T08:31:59.752ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T08:31:59.752183892Z }, migration_in: None, migration_out: None }
30132024-11-01T08:31:59.783ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-01T08:31:59.752183892Z }, migration_in: None, migration_out: None }
30142024-11-01T08:31:59.786ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 11684db6-af09-4413-bb93-4c4d7433d660 propolis_id = 6fe550a6-35c1-4ea3-b3b5-4934906222d5
30152024-11-01T08:32:00.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58830
30162024-11-01T08:32:00.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58830 req_id = e740086c-0976-4a67-9bac-5d1bf17af515 response_code = 200 uri = /vpc-routes
30172024-11-01T08:32:00.361ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {e7eb2722-6b59-4e1a-8c72-5482f793ac6f: {10.151.2.176: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}, 10.151.2.175: {9b250ab7-c754-4b2c-b55a-ec0d8fe350d8}}} }
30182024-11-01T08:32:00.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58830 req_id = 8a580084-31a4-4564-992a-f34cea114d6e response_code = 204 uri = /eip-gateways
30192024-11-01T08:32:00.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40285
30202024-11-01T08:32:00.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40285 req_id = 37b954e6-907b-4437-bedc-f5e4a8a1cfa0 response_code = 200 uri = /v2p
30212024-11-01T08:32:00.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58830 req_id = 6a313a3e-70cf-42c2-bd63-b883e1fc1746 response_code = 204 uri = /vpc-routes
30222024-11-01T08:32:00.577ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30232024-11-01T08:32:00.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30242024-11-01T08:32:00.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30252024-11-01T08:32:00.582ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30262024-11-01T08:32:00.583ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30272024-11-01T08:32:00.585ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30282024-11-01T08:32:00.585ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30292024-11-01T08:32:00.586ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30302024-11-01T08:32:00.587ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30312024-11-01T08:32:00.587ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30322024-11-01T08:32:00.588ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30332024-11-01T08:32:00.589ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30342024-11-01T08:32:00.589ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30352024-11-01T08:32:00.590ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30362024-11-01T08:32:00.590ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30372024-11-01T08:32:00.594ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30382024-11-01T08:32:00.594ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30392024-11-01T08:32:00.598ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30402024-11-01T08:32:01.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34892
30412024-11-01T08:32:01.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34892 req_id = c8d27189-f21b-4df3-9687-f0dda4d3a6f4 response_code = 200 uri = /v2p
30422024-11-01T08:32:01.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35859
30432024-11-01T08:32:01.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35859 req_id = 757fc694-4b0c-4539-b0d8-3c9824983589 response_code = 200 uri = /vpc-routes
30442024-11-01T08:32:01.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
30452024-11-01T08:32:01.935ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d
30462024-11-01T08:32:01.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35859 req_id = adb4e954-ecba-44de-9478-858b65adf889 response_code = 204 uri = /eip-gateways
30472024-11-01T08:32:01.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35859 req_id = eb1eeb04-668c-4e62-87fe-f5cfcb07ec18 response_code = 204 uri = /vpc-routes
30482024-11-01T08:32:02.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45686
30492024-11-01T08:32:02.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45686 req_id = cf8bb47b-ee7d-405c-9c83-45ffc5b56550 response_code = 200 uri = /vpc-routes
30502024-11-01T08:32:02.506ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = f7fe3bf0-db6a-428d-8129-f334aa61483d values = ExternalIpGatewayMap { mappings: {} }
30512024-11-01T08:32:02.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45686 req_id = b3733c88-9cb3-44c9-b0a3-f07391819ac2 response_code = 204 uri = /eip-gateways
30522024-11-01T08:32:02.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45686 req_id = c29a7120-4b41-4f0c-873e-e1eabff0a158 response_code = 204 uri = /vpc-routes