Max level shown:
1 [ Nov 20 02:15:23 Enabled. ]
2 [ Nov 20 02:15:23 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 20 02:15:23 Method "start" exited with status 0. ]
4 [ Nov 20 02:15:23 Rereading configuration. ]
5 [ Nov 20 02:15:23 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-20T02:15:23.420ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-20T02:15:23.420ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-20T02:15:23.472ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-20T02:15:23.472ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-20T02:15:23.584ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-20T02:15:23.593ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-20T02:15:23.601ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-20T02:15:24.203ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-20T02:15:24.341ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-20T02:15:24.341ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-20T02:15:24.341ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-20T02:15:24.341ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-20T02:15:24.341ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-20T02:15:24.341ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-20T02:15:24.344ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-20T02:15:24.344ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-20T02:15:24.344ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-20T02:15:24.344ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-20T02:15:24.344ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-20T02:15:24.344ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-20T02:15:24.344ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-20T02:15:24.344ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-20T02:15:24.344ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-20T02:15:24.355ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-20T02:15:24.355ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool)
322024-11-20T02:15:24.453ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal }
332024-11-20T02:15:24.921ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-20T02:15:24.921ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-20T02:15:24.921ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-20T02:15:24.921ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-20T02:15:24.921ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-20T02:15:24.921ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-20T02:15:24.921ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-20T02:15:24.930ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-20T02:15:24.930ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool)
422024-11-20T02:15:25.017ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal }
432024-11-20T02:15:25.487ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-20T02:15:25.487ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-20T02:15:25.487ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
462024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
472024-11-20T02:15:25.487ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492024-11-20T02:15:25.487ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-20T02:15:25.487ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
512024-11-20T02:15:25.487ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
522024-11-20T02:15:25.487ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-11-20T02:15:25.487ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-20T02:15:25.487ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-20T02:15:25.487ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-11-20T02:15:25.487ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-20T02:15:25.487ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-20T02:15:25.487ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-11-20T02:15:25.487ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-11-20T02:15:25.487ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-11-20T02:15:25.487ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-20T02:15:25.487ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-20T02:15:25.487ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-20T02:15:25.487ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-20T02:15:25.487ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-20T02:15:25.487ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
752024-11-20T02:15:25.487ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-11-20T02:15:25.487ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772024-11-20T02:15:25.487ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
782024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
792024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
802024-11-20T02:15:25.487ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-20T02:15:25.487ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-11-20T02:15:25.487ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
832024-11-20T02:15:25.487ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-11-20T02:15:25.487ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
852024-11-20T02:15:25.487ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
862024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
872024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
882024-11-20T02:15:25.487ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-11-20T02:15:25.487ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
902024-11-20T02:15:25.487ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
912024-11-20T02:15:25.487ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
922024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-11-20T02:15:25.487ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-11-20T02:15:25.487ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
962024-11-20T02:15:25.487ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972024-11-20T02:15:25.487ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
982024-11-20T02:15:25.488ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
992024-11-20T02:15:25.488ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1002024-11-20T02:15:25.488ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1012024-11-20T02:15:25.488ZINFOSledAgent (bootstore): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1022024-11-20T02:15:25.488ZINFOSledAgent (bootstore): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1032024-11-20T02:15:25.488ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1042024-11-20T02:15:25.488ZINFOSledAgent (bootstore): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1052024-11-20T02:15:25.488ZINFOSledAgent (bootstore): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1062024-11-20T02:15:25.488ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1072024-11-20T02:15:25.488ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1082024-11-20T02:15:25.488ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1092024-11-20T02:15:25.499ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:743
1102024-11-20T02:15:25.499ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1416, tv_nsec: 847517740 } time_to_next_cleanup = 599.999939569s
1112024-11-20T02:15:25.499ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
1122024-11-20T02:15:25.499ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1132024-11-20T02:15:25.499ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/sled-agent-request.json file = common/src/ledger.rs:189
1142024-11-20T02:15:25.499ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/sled-agent-request.json file = common/src/ledger.rs:189
1152024-11-20T02:15:25.502ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1162024-11-20T02:15:25.504ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1172024-11-20T02:15:25.505ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1182024-11-20T02:15:25.505ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1192024-11-20T02:15:25.505ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1202024-11-20T02:15:25.505ZINFOSledAgent (RSS): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1212024-11-20T02:15:25.505ZINFOSledAgent (RSS): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1222024-11-20T02:15:25.505ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1232024-11-20T02:15:25.505ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1242024-11-20T02:15:25.505ZINFOSledAgent (RSS): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/rss-sled-plan.json file = common/src/ledger.rs:189
1252024-11-20T02:15:25.505ZINFOSledAgent (RSS): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/rss-sled-plan.json file = common/src/ledger.rs:189
1262024-11-20T02:15:25.505ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1272024-11-20T02:15:25.505ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1282024-11-20T02:15:25.505ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1292024-11-20T02:15:25.505ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1302024-11-20T02:15:25.505ZINFOSledAgent (RSS): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1312024-11-20T02:15:25.505ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/rss-sled-plan.json"
1322024-11-20T02:15:25.505ZINFOSledAgent (RSS): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1332024-11-20T02:15:25.505ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/rss-sled-plan.json"
1342024-11-20T02:15:25.505ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 3e1f377b-e332-48a3-82de-d4509c330a4f, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 52b4024d-59d8-46f0-844c-2d14ce62d55b (sled), rack_id: 3e1f377b-e332-48a3-82de-d4509c330a4f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1352024-11-20T02:15:25.505ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1362024-11-20T02:15:25.505ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1372024-11-20T02:15:25.505ZINFOSledAgent (bootstore): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1382024-11-20T02:15:25.506ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1392024-11-20T02:15:25.506ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1402024-11-20T02:15:25.506ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1412024-11-20T02:15:25.506ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1422024-11-20T02:15:25.506ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 52b4024d-59d8-46f0-844c-2d14ce62d55b (sled), rack_id: 3e1f377b-e332-48a3-82de-d4509c330a4f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1432024-11-20T02:15:25.506ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4302
1442024-11-20T02:15:25.506ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4702
1452024-11-20T02:15:25.511ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1462024-11-20T02:15:25.517ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1472024-11-20T02:15:25.517ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1482024-11-20T02:15:25.522ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1492024-11-20T02:15:25.522ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1502024-11-20T02:15:25.522ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:54053
1512024-11-20T02:15:25.522ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 52b4024d-59d8-46f0-844c-2d14ce62d55b (sled), rack_id: 3e1f377b-e332-48a3-82de-d4509c330a4f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1522024-11-20T02:15:25.522ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1532024-11-20T02:15:25.522ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1542024-11-20T02:15:25.522ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1552024-11-20T02:15:25.522ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1562024-11-20T02:15:25.522ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1572024-11-20T02:15:25.522ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1582024-11-20T02:15:25.522ZINFOSledAgent (StorageManager): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1592024-11-20T02:15:25.522ZINFOSledAgent (StorageManager): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1602024-11-20T02:15:25.522ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1612024-11-20T02:15:25.522ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1622024-11-20T02:15:25.522ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1632024-11-20T02:15:25.522ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1642024-11-20T02:15:25.522ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1652024-11-20T02:15:25.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1662024-11-20T02:15:25.560ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1672024-11-20T02:15:25.572ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:407 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
1682024-11-20T02:15:25.572ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-20T02:15:25.572ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:419 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
1702024-11-20T02:15:25.572ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-20T02:15:25.575ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 100.396373ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "226bdcd3-0ec1-4f51-99c0-4282571263f9", "content-length": "124", "date": "Wed, 20 Nov 2024 02:15:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "226bdcd3-0ec1-4f51-99c0-4282571263f9" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-20T02:15:25.578ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1732024-11-20T02:15:25.585ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_92d1e52d-8bff-46a5-a277-b5f8c72db683/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1742024-11-20T02:15:25.609ZINFOSledAgent: successfully created encrypted zvol: name="oxi_92d1e52d-8bff-46a5-a277-b5f8c72db683/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1752024-11-20T02:15:25.609ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_92d1e52d-8bff-46a5-a277-b5f8c72db683/swap" file = sled-agent/src/swap_device.rs:96
1762024-11-20T02:15:25.615ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:434 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
1772024-11-20T02:15:25.615ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1782024-11-20T02:15:25.615ZINFOSledAgent (BackingFs): Ensuring dataset oxi_92d1e52d-8bff-46a5-a277-b5f8c72db683/backing/fmd file = sled-agent/src/backing_fs.rs:138
1792024-11-20T02:15:25.676ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-11-20T02:15:25.677ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 85.777973ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1eef3951-b8df-4aa8-8de5-c89f10a62b1a", "content-length": "124", "date": "Wed, 20 Nov 2024 02:15:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1eef3951-b8df-4aa8-8de5-c89f10a62b1a" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-11-20T02:15:25.700ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1822024-11-20T02:15:25.764ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-11-20T02:15:25.764ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 133.522227ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "97da594c-18e5-48f1-bc38-b7bd970863f6", "content-length": "124", "date": "Wed, 20 Nov 2024 02:15:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "97da594c-18e5-48f1-bc38-b7bd970863f6" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-11-20T02:15:25.899ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1852024-11-20T02:15:25.900ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 163.941653ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0351ffaf-85a6-48b4-baeb-8bdf5d978480", "content-length": "124", "date": "Wed, 20 Nov 2024 02:15:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0351ffaf-85a6-48b4-baeb-8bdf5d978480" } file = clients/ddm-admin-client/src/lib.rs:177
1862024-11-20T02:15:25.919ZINFOSledAgent (BackingFs): Mounting oxi_92d1e52d-8bff-46a5-a277-b5f8c72db683/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1872024-11-20T02:15:25.931ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1882024-11-20T02:15:25.931ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1892024-11-20T02:15:25.931ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1902024-11-20T02:15:25.931ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1912024-11-20T02:15:26.065ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1922024-11-20T02:15:26.065ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 103.945344ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e11ae6a4-430c-4cc0-907d-ffab2b86498d", "content-length": "124", "date": "Wed, 20 Nov 2024 02:15:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e11ae6a4-430c-4cc0-907d-ffab2b86498d" } file = clients/ddm-admin-client/src/lib.rs:177
1932024-11-20T02:15:26.170ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1942024-11-20T02:15:26.171ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 250.565775ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e5853045-89db-4aa3-9691-cef3f802df4d", "content-length": "124", "date": "Wed, 20 Nov 2024 02:15:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e5853045-89db-4aa3-9691-cef3f802df4d" } file = clients/ddm-admin-client/src/lib.rs:177
1952024-11-20T02:15:26.422ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1962024-11-20T02:15:26.423ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 247.889445ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8273bbfd-fe25-475e-9a68-27bb256a1197", "content-length": "124", "date": "Wed, 20 Nov 2024 02:15:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8273bbfd-fe25-475e-9a68-27bb256a1197" } file = clients/ddm-admin-client/src/lib.rs:177
1972024-11-20T02:15:26.660ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
1982024-11-20T02:15:26.665ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:48622 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
1992024-11-20T02:15:26.665ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2002024-11-20T02:15:26.665ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:48622 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2012024-11-20T02:15:26.666ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 267.432065ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2022024-11-20T02:15:26.667ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2032024-11-20T02:15:26.667ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2042024-11-20T02:15:26.667ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:927 underlay_address = fd00:1122:3344:101::1
2052024-11-20T02:15:26.667ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2062024-11-20T02:15:26.672ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2072024-11-20T02:15:26.937ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 278.014632ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2082024-11-20T02:15:27.217ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 667.740239ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2092024-11-20T02:15:27.887ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.064380407s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2102024-11-20T02:15:28.953ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.171179385s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2112024-11-20T02:15:29.176ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2676
2122024-11-20T02:15:29.176ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2921
2132024-11-20T02:15:29.176ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2546
2142024-11-20T02:15:29.176ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2593
2152024-11-20T02:15:29.176ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3002
2162024-11-20T02:15:29.176ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3047
2172024-11-20T02:15:29.178ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2846
2182024-11-20T02:15:29.179ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2587
2192024-11-20T02:15:29.308ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='00bbecab-d592-4401-8ae7-a288c28f848a'/> <propval type="astring" name="rack_id" value='3e1f377b-e332-48a3-82de-d4509c330a4f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fec3:62cd'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='3e1f377b-e332-48a3-82de-d4509c330a4f'/> <propval type="astring" name="sled_id" value='52b4024d-59d8-46f0-844c-2d14ce62d55b'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='52b4024d-59d8-46f0-844c-2d14ce62d55b'/> <propval type="astring" name="rack_uuid" value='3e1f377b-e332-48a3-82de-d4509c330a4f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='52b4024d-59d8-46f0-844c-2d14ce62d55b'/> <propval type="astring" name="rack_uuid" value='3e1f377b-e332-48a3-82de-d4509c330a4f'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2202024-11-20T02:15:29.308ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2212024-11-20T02:15:29.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 67.95476ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-20T02:15:29.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 60.658541ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-20T02:15:29.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 180.005364ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-20T02:15:30.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 512.263201ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-20T02:15:30.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.067307564s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-20T02:15:31.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 646.336829ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-20T02:15:32.126ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.69286629s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2282024-11-20T02:15:32.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 788.452493ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-20T02:15:33.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.243068221s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302024-11-20T02:15:35.441ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/nexus.rs:527 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2312024-11-20T02:15:35.471ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2322024-11-20T02:15:35.472ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2332024-11-20T02:15:35.472ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2342024-11-20T02:15:35.473ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2352024-11-20T02:15:35.473ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2362024-11-20T02:15:35.473ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2372024-11-20T02:15:35.473ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/sled-agent-request.json"
2382024-11-20T02:15:35.473ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2392024-11-20T02:15:35.473ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/sled-agent-request.json"
2402024-11-20T02:15:35.473ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2412024-11-20T02:15:35.473ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2422024-11-20T02:15:35.473ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
2432024-11-20T02:15:35.473ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:54053
2442024-11-20T02:15:35.694ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2452024-11-20T02:15:35.694ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2462024-11-20T02:15:35.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-20T02:15:35.694ZINFOSledAgent (RSS): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2482024-11-20T02:15:35.694ZINFOSledAgent (RSS): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2492024-11-20T02:15:35.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-20T02:15:35.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-20T02:15:35.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2522024-11-20T02:15:35.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2532024-11-20T02:15:35.699ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4326 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2542024-11-20T02:15:35.699ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4342
2552024-11-20T02:15:35.699ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2562024-11-20T02:15:35.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61586
2572024-11-20T02:15:35.983ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2582024-11-20T02:15:35.983ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2592024-11-20T02:15:35.983ZINFOSledAgent (ServiceManager): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json file = common/src/ledger.rs:189
2602024-11-20T02:15:35.983ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json file = common/src/ledger.rs:189
2612024-11-20T02:15:35.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61586 req_id = 31650630-1316-4508-acef-64ac59ad29eb response_code = 200 uri = /inventory
2622024-11-20T02:15:36.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53961
2632024-11-20T02:15:36.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53961 req_id = 97e5e789-67b0-44ac-a768-dfb4be99eaaf response_code = 200 uri = /sled-role
2642024-11-20T02:15:36.014ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2652024-11-20T02:15:36.014ZINFOSledAgent (RSS): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2662024-11-20T02:15:36.014ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/rss-service-plan-v5.json"
2672024-11-20T02:15:36.014ZINFOSledAgent (RSS): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2682024-11-20T02:15:36.015ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/rss-service-plan-v5.json"
2692024-11-20T02:15:36.015ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2702024-11-20T02:15:36.044ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: a4c88566-4a62-4fec-bdc0-3fe78558e41f, pool_id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f308e1f3-be46-44be-9da9-89a446b568b0, pool_id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 0b9b648a-aeca-45cd-ae99-3ffd9bef279f, pool_id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ae182f18-9fd2-4b4f-8212-9098ab83052c, pool_id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 17f217e9-4fec-4f39-b405-e1595df86a3c, pool_id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: c2025702-5ec7-48cf-bc17-a5b890db89b7, pool_id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 148a7b35-0136-45bc-a73a-273b2013f0f8, pool_id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: b5bb761c-d433-43ba-8e89-00e71fd693c5, pool_id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 6203447e-0a05-4617-82d9-dbee1d73d8ec, pool_id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2712024-11-20T02:15:36.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47882
2722024-11-20T02:15:36.044ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:883 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2732024-11-20T02:15:36.044ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: a4c88566-4a62-4fec-bdc0-3fe78558e41f, pool_id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f308e1f3-be46-44be-9da9-89a446b568b0, pool_id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 0b9b648a-aeca-45cd-ae99-3ffd9bef279f, pool_id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ae182f18-9fd2-4b4f-8212-9098ab83052c, pool_id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 17f217e9-4fec-4f39-b405-e1595df86a3c, pool_id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: c2025702-5ec7-48cf-bc17-a5b890db89b7, pool_id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 148a7b35-0136-45bc-a73a-273b2013f0f8, pool_id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: b5bb761c-d433-43ba-8e89-00e71fd693c5, pool_id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 6203447e-0a05-4617-82d9-dbee1d73d8ec, pool_id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2742024-11-20T02:15:36.044ZINFOSledAgent (StorageManager): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2752024-11-20T02:15:36.044ZINFOSledAgent (StorageManager): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2762024-11-20T02:15:36.044ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1175 request = omicron_physical_disks_ensure
2772024-11-20T02:15:36.044ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2782024-11-20T02:15:36.044ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2792024-11-20T02:15:36.044ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2802024-11-20T02:15:36.044ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2812024-11-20T02:15:36.219ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2822024-11-20T02:15:36.219ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool)
2832024-11-20T02:15:36.670ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2842024-11-20T02:15:36.672ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5115632205813099277 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2852024-11-20T02:15:36.672ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/probe_manager.rs:231 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2862024-11-20T02:15:36.672ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3652746957575530757 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
2872024-11-20T02:15:36.727ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }
2882024-11-20T02:15:36.735ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2892024-11-20T02:15:36.735ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2902024-11-20T02:15:36.735ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2912024-11-20T02:15:36.735ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2922024-11-20T02:15:36.735ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-11-20T02:15:36.735ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-11-20T02:15:36.735ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2952024-11-20T02:15:36.770ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2962024-11-20T02:15:36.778ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone file = sled-storage/src/dataset.rs:303
2972024-11-20T02:15:36.946ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17 file = sled-storage/src/dataset.rs:389
2982024-11-20T02:15:36.953ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2992024-11-20T02:15:36.953ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
3002024-11-20T02:15:36.953ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
3012024-11-20T02:15:36.953ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3022024-11-20T02:15:36.953ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
3032024-11-20T02:15:36.963ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3042024-11-20T02:15:36.963ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool)
3052024-11-20T02:15:37.066ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }
3062024-11-20T02:15:37.074ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3072024-11-20T02:15:37.074ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3082024-11-20T02:15:37.074ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3092024-11-20T02:15:37.074ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3102024-11-20T02:15:37.074ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-11-20T02:15:37.074ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-11-20T02:15:37.074ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3132024-11-20T02:15:37.110ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-11-20T02:15:37.118ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone file = sled-storage/src/dataset.rs:303
3152024-11-20T02:15:37.295ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 file = sled-storage/src/dataset.rs:389
3162024-11-20T02:15:37.303ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3172024-11-20T02:15:37.303ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3182024-11-20T02:15:37.303ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3192024-11-20T02:15:37.303ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3202024-11-20T02:15:37.303ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3212024-11-20T02:15:37.314ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3222024-11-20T02:15:37.314ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool)
3232024-11-20T02:15:37.407ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }
3242024-11-20T02:15:37.415ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3252024-11-20T02:15:37.415ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3262024-11-20T02:15:37.415ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3272024-11-20T02:15:37.415ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3282024-11-20T02:15:37.415ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-11-20T02:15:37.415ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-11-20T02:15:37.415ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3312024-11-20T02:15:37.452ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322024-11-20T02:15:37.459ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone file = sled-storage/src/dataset.rs:303
3332024-11-20T02:15:37.633ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc file = sled-storage/src/dataset.rs:389
3342024-11-20T02:15:37.641ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3352024-11-20T02:15:37.641ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3362024-11-20T02:15:37.641ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3372024-11-20T02:15:37.641ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382024-11-20T02:15:37.641ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3392024-11-20T02:15:37.651ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3402024-11-20T02:15:37.651ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool)
3412024-11-20T02:15:37.744ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }
3422024-11-20T02:15:37.751ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3432024-11-20T02:15:37.751ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3442024-11-20T02:15:37.751ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3452024-11-20T02:15:37.751ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3462024-11-20T02:15:37.751ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-11-20T02:15:37.752ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-11-20T02:15:37.752ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3492024-11-20T02:15:37.755ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/probe_manager.rs:231 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
3502024-11-20T02:15:37.787ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512024-11-20T02:15:37.795ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone file = sled-storage/src/dataset.rs:303
3522024-11-20T02:15:37.964ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_98cd316b-55e2-4c2d-813f-e4caae970d59 file = sled-storage/src/dataset.rs:389
3532024-11-20T02:15:37.971ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3542024-11-20T02:15:37.972ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3552024-11-20T02:15:37.972ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3562024-11-20T02:15:37.972ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3572024-11-20T02:15:37.972ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3582024-11-20T02:15:37.981ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3592024-11-20T02:15:37.981ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool)
3602024-11-20T02:15:38.078ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }
3612024-11-20T02:15:38.086ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3622024-11-20T02:15:38.086ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3632024-11-20T02:15:38.086ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3642024-11-20T02:15:38.086ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3652024-11-20T02:15:38.086ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-11-20T02:15:38.086ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-11-20T02:15:38.086ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3682024-11-20T02:15:38.119ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-11-20T02:15:38.126ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone file = sled-storage/src/dataset.rs:303
3702024-11-20T02:15:38.307ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_841052f1-d4ff-4743-9006-a66dddb621f3 file = sled-storage/src/dataset.rs:389
3712024-11-20T02:15:38.315ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3722024-11-20T02:15:38.315ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3732024-11-20T02:15:38.315ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3742024-11-20T02:15:38.315ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3752024-11-20T02:15:38.315ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3762024-11-20T02:15:38.325ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3772024-11-20T02:15:38.325ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9529683f-e460-4948-a032-9f2d5e49707f (zpool)
3782024-11-20T02:15:38.419ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }
3792024-11-20T02:15:38.427ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3802024-11-20T02:15:38.427ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3812024-11-20T02:15:38.427ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3822024-11-20T02:15:38.427ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3832024-11-20T02:15:38.427ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-11-20T02:15:38.427ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-11-20T02:15:38.427ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3862024-11-20T02:15:38.463ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872024-11-20T02:15:38.471ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone file = sled-storage/src/dataset.rs:303
3882024-11-20T02:15:38.647ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9529683f-e460-4948-a032-9f2d5e49707f file = sled-storage/src/dataset.rs:389
3892024-11-20T02:15:38.656ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3902024-11-20T02:15:38.656ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3912024-11-20T02:15:38.656ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3922024-11-20T02:15:38.656ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932024-11-20T02:15:38.656ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3942024-11-20T02:15:38.666ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3952024-11-20T02:15:38.666ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool)
3962024-11-20T02:15:38.761ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }
3972024-11-20T02:15:38.769ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3982024-11-20T02:15:38.769ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3992024-11-20T02:15:38.769ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
4002024-11-20T02:15:38.769ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
4012024-11-20T02:15:38.769ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-11-20T02:15:38.769ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-11-20T02:15:38.769ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4042024-11-20T02:15:38.806ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-11-20T02:15:38.810ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/probe_manager.rs:231 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4062024-11-20T02:15:38.815ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone file = sled-storage/src/dataset.rs:303
4072024-11-20T02:15:39.000ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30 file = sled-storage/src/dataset.rs:389
4082024-11-20T02:15:39.010ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4092024-11-20T02:15:39.010ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4102024-11-20T02:15:39.010ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4112024-11-20T02:15:39.010ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4122024-11-20T02:15:39.010ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4132024-11-20T02:15:39.020ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4142024-11-20T02:15:39.020ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool)
4152024-11-20T02:15:39.114ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }
4162024-11-20T02:15:39.122ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4172024-11-20T02:15:39.122ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4182024-11-20T02:15:39.122ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4192024-11-20T02:15:39.122ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4202024-11-20T02:15:39.122ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-11-20T02:15:39.122ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-11-20T02:15:39.122ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4232024-11-20T02:15:39.154ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4242024-11-20T02:15:39.161ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone file = sled-storage/src/dataset.rs:303
4252024-11-20T02:15:39.320ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 file = sled-storage/src/dataset.rs:389
4262024-11-20T02:15:39.327ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4272024-11-20T02:15:39.327ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4282024-11-20T02:15:39.327ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4292024-11-20T02:15:39.327ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4302024-11-20T02:15:39.327ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4312024-11-20T02:15:39.336ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4322024-11-20T02:15:39.336ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool)
4332024-11-20T02:15:39.448ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }
4342024-11-20T02:15:39.456ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4352024-11-20T02:15:39.456ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4362024-11-20T02:15:39.456ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4372024-11-20T02:15:39.456ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4382024-11-20T02:15:39.456ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4392024-11-20T02:15:39.456ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4402024-11-20T02:15:39.456ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4412024-11-20T02:15:39.494ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4422024-11-20T02:15:39.502ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone file = sled-storage/src/dataset.rs:303
4432024-11-20T02:15:39.674ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 file = sled-storage/src/dataset.rs:389
4442024-11-20T02:15:39.682ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4452024-11-20T02:15:39.682ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4462024-11-20T02:15:39.682ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4472024-11-20T02:15:39.682ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92d1e52d-8bff-46a5-a277-b5f8c72db683 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9b12c4a3-3a43-462c-be72-f4f6d4f154b1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4482024-11-20T02:15:39.682ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4492024-11-20T02:15:39.682ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4502024-11-20T02:15:39.682ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4512024-11-20T02:15:39.682ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4522024-11-20T02:15:39.683ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4532024-11-20T02:15:39.683ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:887 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4542024-11-20T02:15:39.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4552024-11-20T02:15:39.683ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:913 generation = Generation(1) sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4562024-11-20T02:15:39.683ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:918 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4572024-11-20T02:15:39.683ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:923 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4582024-11-20T02:15:39.683ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4592024-11-20T02:15:39.683ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:929 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4602024-11-20T02:15:39.683ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4612024-11-20T02:15:39.683ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:934 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4622024-11-20T02:15:39.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3638977 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47882 req_id = d87e8a14-abae-425f-9920-187133f9c98e response_code = 200 uri = /omicron-physical-disks
4632024-11-20T02:15:39.715ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {000f8a02-a19e-40b8-af15-5359b488136a (dataset): DatasetConfig { id: 000f8a02-a19e-40b8-af15-5359b488136a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 034ef6bc-740d-4494-871b-5a1856dae862 (dataset): DatasetConfig { id: 034ef6bc-740d-4494-871b-5a1856dae862 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a45d666-a519-44c8-9301-8c530c62396a (dataset): DatasetConfig { id: 0a45d666-a519-44c8-9301-8c530c62396a (dataset), name: DatasetName { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 13874568-1e78-4b5d-90db-1c005ff0b9a6 (dataset): DatasetConfig { id: 13874568-1e78-4b5d-90db-1c005ff0b9a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15ada2f6-b67c-48f5-98a3-a57b6478e447 (dataset): DatasetConfig { id: 15ada2f6-b67c-48f5-98a3-a57b6478e447 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 213d4895-434f-4772-9ac7-6bee233b1874 (dataset): DatasetConfig { id: 213d4895-434f-4772-9ac7-6bee233b1874 (dataset), name: DatasetName { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2261b0cd-ad1c-41fd-a043-d295a489bf6b (dataset): DatasetConfig { id: 2261b0cd-ad1c-41fd-a043-d295a489bf6b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 234ac003-bad6-4d11-af72-3a601ebf8afb (dataset): DatasetConfig { id: 234ac003-bad6-4d11-af72-3a601ebf8afb (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fe882ad-f7db-4932-8620-ac3baa9f794a (dataset): DatasetConfig { id: 2fe882ad-f7db-4932-8620-ac3baa9f794a (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34ae7903-a21b-43f5-bc43-10241370effc (dataset): DatasetConfig { id: 34ae7903-a21b-43f5-bc43-10241370effc (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36dadb95-2cba-4596-b31a-32086f188443 (dataset): DatasetConfig { id: 36dadb95-2cba-4596-b31a-32086f188443 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ebdea09-b141-49ca-b9fe-c1e6fbaa3c7b (dataset): DatasetConfig { id: 3ebdea09-b141-49ca-b9fe-c1e6fbaa3c7b (dataset), name: DatasetName { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 46252686-346b-4b5e-add8-93770e14fa42 (dataset): DatasetConfig { id: 46252686-346b-4b5e-add8-93770e14fa42 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a2c6959-4841-465d-961c-3f0ff4f7307f (dataset): DatasetConfig { id: 4a2c6959-4841-465d-961c-3f0ff4f7307f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4cb03e05-7de3-45ea-af20-65b6ac0da3f4 (dataset): DatasetConfig { id: 4cb03e05-7de3-45ea-af20-65b6ac0da3f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5335ceef-a141-41eb-8b86-4dfc7c45bb5c (dataset): DatasetConfig { id: 5335ceef-a141-41eb-8b86-4dfc7c45bb5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 56ad2298-380d-466b-abd5-463e4c5031ec (dataset): DatasetConfig { id: 56ad2298-380d-466b-abd5-463e4c5031ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58545110-4aec-41f0-9c9f-f3cedb88459b (dataset): DatasetConfig { id: 58545110-4aec-41f0-9c9f-f3cedb88459b (dataset), name: DatasetName { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6694cf9e-7d51-491b-bcb6-47c88f931091 (dataset): DatasetConfig { id: 6694cf9e-7d51-491b-bcb6-47c88f931091 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a5e827-c6f4-46d9-98e6-02be45f633c1 (dataset): DatasetConfig { id: 66a5e827-c6f4-46d9-98e6-02be45f633c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69410e4c-9bc7-4815-841b-8500547cacad (dataset): DatasetConfig { id: 69410e4c-9bc7-4815-841b-8500547cacad (dataset), name: DatasetName { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ad69afe-7738-49ff-8ebc-8b0d44842d57 (dataset): DatasetConfig { id: 6ad69afe-7738-49ff-8ebc-8b0d44842d57 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c75b1bf-1549-4525-acf5-d614f5e7a6b0 (dataset): DatasetConfig { id: 6c75b1bf-1549-4525-acf5-d614f5e7a6b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 721ceead-5e8c-49f3-b5ed-475f63c938db (dataset): DatasetConfig { id: 721ceead-5e8c-49f3-b5ed-475f63c938db (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7fd7a407-1d42-4d34-8a47-2dd9e6647916 (dataset): DatasetConfig { id: 7fd7a407-1d42-4d34-8a47-2dd9e6647916 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 85b8aa67-f3cd-4b35-a520-c780e06bb47f (dataset): DatasetConfig { id: 85b8aa67-f3cd-4b35-a520-c780e06bb47f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8810386a-a962-431e-a041-6593d6ca5d64 (dataset): DatasetConfig { id: 8810386a-a962-431e-a041-6593d6ca5d64 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 883c15a7-827d-4d3d-b7ab-e21d00e1acba (dataset): DatasetConfig { id: 883c15a7-827d-4d3d-b7ab-e21d00e1acba (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fdb3046-8193-4b63-a404-dac7eb30e1e4 (dataset): DatasetConfig { id: 8fdb3046-8193-4b63-a404-dac7eb30e1e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 905b952f-ed76-40e7-8537-e34ef058b649 (dataset): DatasetConfig { id: 905b952f-ed76-40e7-8537-e34ef058b649 (dataset), name: DatasetName { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96433691-2376-4e86-beda-1959ff27f0d2 (dataset): DatasetConfig { id: 96433691-2376-4e86-beda-1959ff27f0d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_45a23fab-e521-4372-b089-d43d65804661" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96b6de67-0935-4072-bc5b-d8aa10e4a0e1 (dataset): DatasetConfig { id: 96b6de67-0935-4072-bc5b-d8aa10e4a0e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98c61960-d966-4ecd-834f-51bda69a962d (dataset): DatasetConfig { id: 98c61960-d966-4ecd-834f-51bda69a962d (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ac3d8eb-4279-4936-b142-0de658ccdea2 (dataset): DatasetConfig { id: 9ac3d8eb-4279-4936-b142-0de658ccdea2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a000ac58-9f1e-48c7-a683-134faf80cc56 (dataset): DatasetConfig { id: a000ac58-9f1e-48c7-a683-134faf80cc56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2f4e8d8-42be-445e-9314-5d6e27da5e5e (dataset): DatasetConfig { id: a2f4e8d8-42be-445e-9314-5d6e27da5e5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8f20d42-6535-400d-bf6d-f8a21654bdef (dataset): DatasetConfig { id: a8f20d42-6535-400d-bf6d-f8a21654bdef (dataset), name: DatasetName { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac01550d-7db5-4b03-9a16-dbf045c739bd (dataset): DatasetConfig { id: ac01550d-7db5-4b03-9a16-dbf045c739bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aee7f2c9-8ea7-4c54-8310-0b6afc5eabd7 (dataset): DatasetConfig { id: aee7f2c9-8ea7-4c54-8310-0b6afc5eabd7 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b19239c3-2e2d-4502-bcd2-9df1e7c4af2c (dataset): DatasetConfig { id: b19239c3-2e2d-4502-bcd2-9df1e7c4af2c (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b1df49f5-3e83-4556-b9cd-037fb0a49031 (dataset): DatasetConfig { id: b1df49f5-3e83-4556-b9cd-037fb0a49031 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2680c4d-af0b-4547-8f34-0d2994d72e2b (dataset): DatasetConfig { id: b2680c4d-af0b-4547-8f34-0d2994d72e2b (dataset), name: DatasetName { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b429b8aa-c05f-4d25-9a00-4b49f3de258a (dataset): DatasetConfig { id: b429b8aa-c05f-4d25-9a00-4b49f3de258a (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b4337115-f5c7-4c41-bd6b-04ee33985d5f (dataset): DatasetConfig { id: b4337115-f5c7-4c41-bd6b-04ee33985d5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb505722-b049-4972-ae6a-e0045f88182b (dataset): DatasetConfig { id: bb505722-b049-4972-ae6a-e0045f88182b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb952779-912a-4df1-a25b-4c84ee389a78 (dataset): DatasetConfig { id: bb952779-912a-4df1-a25b-4c84ee389a78 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd5608cc-7fa8-4290-8c2a-c3fe7ad2cd47 (dataset): DatasetConfig { id: bd5608cc-7fa8-4290-8c2a-c3fe7ad2cd47 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bf25e593-5468-4db9-bbda-48fff72dc38b (dataset): DatasetConfig { id: bf25e593-5468-4db9-bbda-48fff72dc38b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf7069bc-6ded-4002-ae12-67b241155b18 (dataset): DatasetConfig { id: bf7069bc-6ded-4002-ae12-67b241155b18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c18318d0-cf00-4106-9d6a-f968b1fa54dc (dataset): DatasetConfig { id: c18318d0-cf00-4106-9d6a-f968b1fa54dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c40df89c-ebcc-4eef-951a-e0e70d325306 (dataset): DatasetConfig { id: c40df89c-ebcc-4eef-951a-e0e70d325306 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c447c386-a850-46a3-81dd-137c495562e3 (dataset): DatasetConfig { id: c447c386-a850-46a3-81dd-137c495562e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cbd94a02-0af3-41c8-8b79-e5d7a536c028 (dataset): DatasetConfig { id: cbd94a02-0af3-41c8-8b79-e5d7a536c028 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce16db82-1f71-4209-9085-d49d66651e84 (dataset): DatasetConfig { id: ce16db82-1f71-4209-9085-d49d66651e84 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5d15dac-9eed-487c-bc80-b43a36f172b4 (dataset): DatasetConfig { id: d5d15dac-9eed-487c-bc80-b43a36f172b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d629c660-ed0e-4032-b29f-8187312b8eef (dataset): DatasetConfig { id: d629c660-ed0e-4032-b29f-8187312b8eef (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df76dbae-ea22-420f-9eb5-b06f15511f48 (dataset): DatasetConfig { id: df76dbae-ea22-420f-9eb5-b06f15511f48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3e4a054-5860-4311-88e8-ed82f6e3f154 (dataset): DatasetConfig { id: e3e4a054-5860-4311-88e8-ed82f6e3f154 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea816a8d-15ee-4b01-a899-fb294a222bc6 (dataset): DatasetConfig { id: ea816a8d-15ee-4b01-a899-fb294a222bc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ecaaa502-0ec1-4d06-8a9b-66a9ae8cc130 (dataset): DatasetConfig { id: ecaaa502-0ec1-4d06-8a9b-66a9ae8cc130 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f162698e-1860-45e2-9efc-ebdb83e5e9da (dataset): DatasetConfig { id: f162698e-1860-45e2-9efc-ebdb83e5e9da (dataset), name: DatasetName { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f16914a4-7add-484e-99e2-d8382668efa5 (dataset): DatasetConfig { id: f16914a4-7add-484e-99e2-d8382668efa5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1aefe0b-59bd-4d22-affe-0fef9688a595 (dataset): DatasetConfig { id: f1aefe0b-59bd-4d22-affe-0fef9688a595 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7cea528-e467-4d82-ba93-53ea6998da42 (dataset): DatasetConfig { id: f7cea528-e467-4d82-ba93-53ea6998da42 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc378e79-5cb0-4b25-89a2-56532e1dd55f (dataset): DatasetConfig { id: fc378e79-5cb0-4b25-89a2-56532e1dd55f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fea0b2e4-b175-4b09-8943-de0125e11820 (dataset): DatasetConfig { id: fea0b2e4-b175-4b09-8943-de0125e11820 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4642024-11-20T02:15:39.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65055
4652024-11-20T02:15:39.716ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:849 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4662024-11-20T02:15:39.716ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {000f8a02-a19e-40b8-af15-5359b488136a (dataset): DatasetConfig { id: 000f8a02-a19e-40b8-af15-5359b488136a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 034ef6bc-740d-4494-871b-5a1856dae862 (dataset): DatasetConfig { id: 034ef6bc-740d-4494-871b-5a1856dae862 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a45d666-a519-44c8-9301-8c530c62396a (dataset): DatasetConfig { id: 0a45d666-a519-44c8-9301-8c530c62396a (dataset), name: DatasetName { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 13874568-1e78-4b5d-90db-1c005ff0b9a6 (dataset): DatasetConfig { id: 13874568-1e78-4b5d-90db-1c005ff0b9a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15ada2f6-b67c-48f5-98a3-a57b6478e447 (dataset): DatasetConfig { id: 15ada2f6-b67c-48f5-98a3-a57b6478e447 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 213d4895-434f-4772-9ac7-6bee233b1874 (dataset): DatasetConfig { id: 213d4895-434f-4772-9ac7-6bee233b1874 (dataset), name: DatasetName { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2261b0cd-ad1c-41fd-a043-d295a489bf6b (dataset): DatasetConfig { id: 2261b0cd-ad1c-41fd-a043-d295a489bf6b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 234ac003-bad6-4d11-af72-3a601ebf8afb (dataset): DatasetConfig { id: 234ac003-bad6-4d11-af72-3a601ebf8afb (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fe882ad-f7db-4932-8620-ac3baa9f794a (dataset): DatasetConfig { id: 2fe882ad-f7db-4932-8620-ac3baa9f794a (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34ae7903-a21b-43f5-bc43-10241370effc (dataset): DatasetConfig { id: 34ae7903-a21b-43f5-bc43-10241370effc (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36dadb95-2cba-4596-b31a-32086f188443 (dataset): DatasetConfig { id: 36dadb95-2cba-4596-b31a-32086f188443 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ebdea09-b141-49ca-b9fe-c1e6fbaa3c7b (dataset): DatasetConfig { id: 3ebdea09-b141-49ca-b9fe-c1e6fbaa3c7b (dataset), name: DatasetName { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 46252686-346b-4b5e-add8-93770e14fa42 (dataset): DatasetConfig { id: 46252686-346b-4b5e-add8-93770e14fa42 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a2c6959-4841-465d-961c-3f0ff4f7307f (dataset): DatasetConfig { id: 4a2c6959-4841-465d-961c-3f0ff4f7307f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4cb03e05-7de3-45ea-af20-65b6ac0da3f4 (dataset): DatasetConfig { id: 4cb03e05-7de3-45ea-af20-65b6ac0da3f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5335ceef-a141-41eb-8b86-4dfc7c45bb5c (dataset): DatasetConfig { id: 5335ceef-a141-41eb-8b86-4dfc7c45bb5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 56ad2298-380d-466b-abd5-463e4c5031ec (dataset): DatasetConfig { id: 56ad2298-380d-466b-abd5-463e4c5031ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58545110-4aec-41f0-9c9f-f3cedb88459b (dataset): DatasetConfig { id: 58545110-4aec-41f0-9c9f-f3cedb88459b (dataset), name: DatasetName { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6694cf9e-7d51-491b-bcb6-47c88f931091 (dataset): DatasetConfig { id: 6694cf9e-7d51-491b-bcb6-47c88f931091 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a5e827-c6f4-46d9-98e6-02be45f633c1 (dataset): DatasetConfig { id: 66a5e827-c6f4-46d9-98e6-02be45f633c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69410e4c-9bc7-4815-841b-8500547cacad (dataset): DatasetConfig { id: 69410e4c-9bc7-4815-841b-8500547cacad (dataset), name: DatasetName { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ad69afe-7738-49ff-8ebc-8b0d44842d57 (dataset): DatasetConfig { id: 6ad69afe-7738-49ff-8ebc-8b0d44842d57 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c75b1bf-1549-4525-acf5-d614f5e7a6b0 (dataset): DatasetConfig { id: 6c75b1bf-1549-4525-acf5-d614f5e7a6b0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 721ceead-5e8c-49f3-b5ed-475f63c938db (dataset): DatasetConfig { id: 721ceead-5e8c-49f3-b5ed-475f63c938db (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7fd7a407-1d42-4d34-8a47-2dd9e6647916 (dataset): DatasetConfig { id: 7fd7a407-1d42-4d34-8a47-2dd9e6647916 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 85b8aa67-f3cd-4b35-a520-c780e06bb47f (dataset): DatasetConfig { id: 85b8aa67-f3cd-4b35-a520-c780e06bb47f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8810386a-a962-431e-a041-6593d6ca5d64 (dataset): DatasetConfig { id: 8810386a-a962-431e-a041-6593d6ca5d64 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 883c15a7-827d-4d3d-b7ab-e21d00e1acba (dataset): DatasetConfig { id: 883c15a7-827d-4d3d-b7ab-e21d00e1acba (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fdb3046-8193-4b63-a404-dac7eb30e1e4 (dataset): DatasetConfig { id: 8fdb3046-8193-4b63-a404-dac7eb30e1e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 905b952f-ed76-40e7-8537-e34ef058b649 (dataset): DatasetConfig { id: 905b952f-ed76-40e7-8537-e34ef058b649 (dataset), name: DatasetName { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96433691-2376-4e86-beda-1959ff27f0d2 (dataset): DatasetConfig { id: 96433691-2376-4e86-beda-1959ff27f0d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_45a23fab-e521-4372-b089-d43d65804661" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96b6de67-0935-4072-bc5b-d8aa10e4a0e1 (dataset): DatasetConfig { id: 96b6de67-0935-4072-bc5b-d8aa10e4a0e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98c61960-d966-4ecd-834f-51bda69a962d (dataset): DatasetConfig { id: 98c61960-d966-4ecd-834f-51bda69a962d (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ac3d8eb-4279-4936-b142-0de658ccdea2 (dataset): DatasetConfig { id: 9ac3d8eb-4279-4936-b142-0de658ccdea2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a000ac58-9f1e-48c7-a683-134faf80cc56 (dataset): DatasetConfig { id: a000ac58-9f1e-48c7-a683-134faf80cc56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2f4e8d8-42be-445e-9314-5d6e27da5e5e (dataset): DatasetConfig { id: a2f4e8d8-42be-445e-9314-5d6e27da5e5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8f20d42-6535-400d-bf6d-f8a21654bdef (dataset): DatasetConfig { id: a8f20d42-6535-400d-bf6d-f8a21654bdef (dataset), name: DatasetName { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac01550d-7db5-4b03-9a16-dbf045c739bd (dataset): DatasetConfig { id: ac01550d-7db5-4b03-9a16-dbf045c739bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aee7f2c9-8ea7-4c54-8310-0b6afc5eabd7 (dataset): DatasetConfig { id: aee7f2c9-8ea7-4c54-8310-0b6afc5eabd7 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b19239c3-2e2d-4502-bcd2-9df1e7c4af2c (dataset): DatasetConfig { id: b19239c3-2e2d-4502-bcd2-9df1e7c4af2c (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b1df49f5-3e83-4556-b9cd-037fb0a49031 (dataset): DatasetConfig { id: b1df49f5-3e83-4556-b9cd-037fb0a49031 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2680c4d-af0b-4547-8f34-0d2994d72e2b (dataset): DatasetConfig { id: b2680c4d-af0b-4547-8f34-0d2994d72e2b (dataset), name: DatasetName { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b429b8aa-c05f-4d25-9a00-4b49f3de258a (dataset): DatasetConfig { id: b429b8aa-c05f-4d25-9a00-4b49f3de258a (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b4337115-f5c7-4c41-bd6b-04ee33985d5f (dataset): DatasetConfig { id: b4337115-f5c7-4c41-bd6b-04ee33985d5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb505722-b049-4972-ae6a-e0045f88182b (dataset): DatasetConfig { id: bb505722-b049-4972-ae6a-e0045f88182b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb952779-912a-4df1-a25b-4c84ee389a78 (dataset): DatasetConfig { id: bb952779-912a-4df1-a25b-4c84ee389a78 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd5608cc-7fa8-4290-8c2a-c3fe7ad2cd47 (dataset): DatasetConfig { id: bd5608cc-7fa8-4290-8c2a-c3fe7ad2cd47 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bf25e593-5468-4db9-bbda-48fff72dc38b (dataset): DatasetConfig { id: bf25e593-5468-4db9-bbda-48fff72dc38b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf7069bc-6ded-4002-ae12-67b241155b18 (dataset): DatasetConfig { id: bf7069bc-6ded-4002-ae12-67b241155b18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c18318d0-cf00-4106-9d6a-f968b1fa54dc (dataset): DatasetConfig { id: c18318d0-cf00-4106-9d6a-f968b1fa54dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c40df89c-ebcc-4eef-951a-e0e70d325306 (dataset): DatasetConfig { id: c40df89c-ebcc-4eef-951a-e0e70d325306 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c447c386-a850-46a3-81dd-137c495562e3 (dataset): DatasetConfig { id: c447c386-a850-46a3-81dd-137c495562e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cbd94a02-0af3-41c8-8b79-e5d7a536c028 (dataset): DatasetConfig { id: cbd94a02-0af3-41c8-8b79-e5d7a536c028 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce16db82-1f71-4209-9085-d49d66651e84 (dataset): DatasetConfig { id: ce16db82-1f71-4209-9085-d49d66651e84 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5d15dac-9eed-487c-bc80-b43a36f172b4 (dataset): DatasetConfig { id: d5d15dac-9eed-487c-bc80-b43a36f172b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d629c660-ed0e-4032-b29f-8187312b8eef (dataset): DatasetConfig { id: d629c660-ed0e-4032-b29f-8187312b8eef (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df76dbae-ea22-420f-9eb5-b06f15511f48 (dataset): DatasetConfig { id: df76dbae-ea22-420f-9eb5-b06f15511f48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3e4a054-5860-4311-88e8-ed82f6e3f154 (dataset): DatasetConfig { id: e3e4a054-5860-4311-88e8-ed82f6e3f154 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea816a8d-15ee-4b01-a899-fb294a222bc6 (dataset): DatasetConfig { id: ea816a8d-15ee-4b01-a899-fb294a222bc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ecaaa502-0ec1-4d06-8a9b-66a9ae8cc130 (dataset): DatasetConfig { id: ecaaa502-0ec1-4d06-8a9b-66a9ae8cc130 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f162698e-1860-45e2-9efc-ebdb83e5e9da (dataset): DatasetConfig { id: f162698e-1860-45e2-9efc-ebdb83e5e9da (dataset), name: DatasetName { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f16914a4-7add-484e-99e2-d8382668efa5 (dataset): DatasetConfig { id: f16914a4-7add-484e-99e2-d8382668efa5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1aefe0b-59bd-4d22-affe-0fef9688a595 (dataset): DatasetConfig { id: f1aefe0b-59bd-4d22-affe-0fef9688a595 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7cea528-e467-4d82-ba93-53ea6998da42 (dataset): DatasetConfig { id: f7cea528-e467-4d82-ba93-53ea6998da42 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc378e79-5cb0-4b25-89a2-56532e1dd55f (dataset): DatasetConfig { id: fc378e79-5cb0-4b25-89a2-56532e1dd55f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fea0b2e4-b175-4b09-8943-de0125e11820 (dataset): DatasetConfig { id: fea0b2e4-b175-4b09-8943-de0125e11820 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4672024-11-20T02:15:39.716ZINFOSledAgent (StorageManager): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4682024-11-20T02:15:39.716ZINFOSledAgent (StorageManager): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4692024-11-20T02:15:39.716ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:906 request = datasets_ensure
4702024-11-20T02:15:39.716ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4712024-11-20T02:15:39.716ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9529683f-e460-4948-a032-9f2d5e49707f/crucible" } file = sled-storage/src/manager.rs:1338
4722024-11-20T02:15:39.804ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4732024-11-20T02:15:39.804ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40"), full_name: "oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40" } file = sled-storage/src/manager.rs:1338
4742024-11-20T02:15:39.814ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/probe_manager.rs:231 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4752024-11-20T02:15:39.902ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4762024-11-20T02:15:39.902ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/debug"), full_name: "oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/debug" } file = sled-storage/src/manager.rs:1338
4772024-11-20T02:15:39.968ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4782024-11-20T02:15:39.968ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c"), full_name: "oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c" } file = sled-storage/src/manager.rs:1338
4792024-11-20T02:15:40.069ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4802024-11-20T02:15:40.069ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crucible" } file = sled-storage/src/manager.rs:1338
4812024-11-20T02:15:40.159ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4822024-11-20T02:15:40.159ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4"), full_name: "oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4" } file = sled-storage/src/manager.rs:1338
4832024-11-20T02:15:40.257ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4842024-11-20T02:15:40.257ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
4852024-11-20T02:15:40.347ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4862024-11-20T02:15:40.347ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079"), full_name: "oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079" } file = sled-storage/src/manager.rs:1338
4872024-11-20T02:15:40.445ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4882024-11-20T02:15:40.445ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
4892024-11-20T02:15:40.537ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4902024-11-20T02:15:40.537ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_98cd316b-55e2-4c2d-813f-e4caae970d59/crucible" } file = sled-storage/src/manager.rs:1338
4912024-11-20T02:15:40.623ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4922024-11-20T02:15:40.623ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crucible" } file = sled-storage/src/manager.rs:1338
4932024-11-20T02:15:40.710ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4942024-11-20T02:15:40.710ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/debug"), full_name: "oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/debug" } file = sled-storage/src/manager.rs:1338
4952024-11-20T02:15:40.776ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4962024-11-20T02:15:40.776ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), full_name: "oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c" } file = sled-storage/src/manager.rs:1338
4972024-11-20T02:15:40.815ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/probe_manager.rs:231 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
4982024-11-20T02:15:40.876ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4992024-11-20T02:15:40.876ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), full_name: "oxp_9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f" } file = sled-storage/src/manager.rs:1338
5002024-11-20T02:15:40.974ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5012024-11-20T02:15:40.974ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f"), full_name: "oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f" } file = sled-storage/src/manager.rs:1338
5022024-11-20T02:15:41.074ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5032024-11-20T02:15:41.074ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/debug"), full_name: "oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/debug" } file = sled-storage/src/manager.rs:1338
5042024-11-20T02:15:41.141ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5052024-11-20T02:15:41.141ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone"), full_name: "oxp_841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone" } file = sled-storage/src/manager.rs:1338
5062024-11-20T02:15:41.208ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5072024-11-20T02:15:41.208ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone"), full_name: "oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone" } file = sled-storage/src/manager.rs:1338
5082024-11-20T02:15:41.276ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5092024-11-20T02:15:41.276ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5102024-11-20T02:15:41.367ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5112024-11-20T02:15:41.367ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82"), full_name: "oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82" } file = sled-storage/src/manager.rs:1338
5122024-11-20T02:15:41.466ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5132024-11-20T02:15:41.466ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crucible" } file = sled-storage/src/manager.rs:1338
5142024-11-20T02:15:41.553ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5152024-11-20T02:15:41.553ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5162024-11-20T02:15:41.641ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5172024-11-20T02:15:41.641ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662"), full_name: "oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662" } file = sled-storage/src/manager.rs:1338
5182024-11-20T02:15:41.739ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5192024-11-20T02:15:41.740ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a" } file = sled-storage/src/manager.rs:1338
5202024-11-20T02:15:41.818ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/probe_manager.rs:231 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
5212024-11-20T02:15:41.837ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5222024-11-20T02:15:41.837ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/debug"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/debug" } file = sled-storage/src/manager.rs:1338
5232024-11-20T02:15:41.905ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5242024-11-20T02:15:41.905ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898"), full_name: "oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone/oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898" } file = sled-storage/src/manager.rs:1338
5252024-11-20T02:15:42.005ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5262024-11-20T02:15:42.005ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone"), full_name: "oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/zone" } file = sled-storage/src/manager.rs:1338
5272024-11-20T02:15:42.078ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5282024-11-20T02:15:42.078ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5292024-11-20T02:15:42.168ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5302024-11-20T02:15:42.168ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c"), full_name: "oxp_841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c" } file = sled-storage/src/manager.rs:1338
5312024-11-20T02:15:42.268ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5322024-11-20T02:15:42.268ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab"), full_name: "oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab" } file = sled-storage/src/manager.rs:1338
5332024-11-20T02:15:42.371ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5342024-11-20T02:15:42.371ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661"), full_name: "oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone/oxz_ntp_45a23fab-e521-4372-b089-d43d65804661" } file = sled-storage/src/manager.rs:1338
5352024-11-20T02:15:42.471ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5362024-11-20T02:15:42.472ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226" } file = sled-storage/src/manager.rs:1338
5372024-11-20T02:15:42.572ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5382024-11-20T02:15:42.572ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5"), full_name: "oxp_98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5" } file = sled-storage/src/manager.rs:1338
5392024-11-20T02:15:42.671ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5402024-11-20T02:15:42.671ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/clickhouse" } file = sled-storage/src/manager.rs:1338
5412024-11-20T02:15:42.760ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5422024-11-20T02:15:42.760ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015" } file = sled-storage/src/manager.rs:1338
5432024-11-20T02:15:42.820ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/probe_manager.rs:231 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
5442024-11-20T02:15:42.820ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.93246114s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
5452024-11-20T02:15:42.859ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5462024-11-20T02:15:42.859ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone"), full_name: "oxp_9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone" } file = sled-storage/src/manager.rs:1338
5472024-11-20T02:15:42.928ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5482024-11-20T02:15:42.928ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8"), full_name: "oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/zone/oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8" } file = sled-storage/src/manager.rs:1338
5492024-11-20T02:15:43.027ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5502024-11-20T02:15:43.027ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5512024-11-20T02:15:43.116ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5522024-11-20T02:15:43.116ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crucible" } file = sled-storage/src/manager.rs:1338
5532024-11-20T02:15:43.201ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5542024-11-20T02:15:43.201ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/debug"), full_name: "oxp_841052f1-d4ff-4743-9006-a66dddb621f3/crypt/debug" } file = sled-storage/src/manager.rs:1338
5552024-11-20T02:15:43.268ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5562024-11-20T02:15:43.268ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone"), full_name: "oxp_98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone" } file = sled-storage/src/manager.rs:1338
5572024-11-20T02:15:43.334ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5582024-11-20T02:15:43.334ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone"), full_name: "oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone" } file = sled-storage/src/manager.rs:1338
5592024-11-20T02:15:43.398ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5602024-11-20T02:15:43.398ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26"), full_name: "oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26" } file = sled-storage/src/manager.rs:1338
5612024-11-20T02:15:43.493ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5622024-11-20T02:15:43.493ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_841052f1-d4ff-4743-9006-a66dddb621f3/crucible" } file = sled-storage/src/manager.rs:1338
5632024-11-20T02:15:43.579ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5642024-11-20T02:15:43.579ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd" } file = sled-storage/src/manager.rs:1338
5652024-11-20T02:15:43.677ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5662024-11-20T02:15:43.677ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c"), full_name: "oxp_98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/zone/oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c" } file = sled-storage/src/manager.rs:1338
5672024-11-20T02:15:43.776ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5682024-11-20T02:15:43.776ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/debug"), full_name: "oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/debug" } file = sled-storage/src/manager.rs:1338
5692024-11-20T02:15:43.822ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/probe_manager.rs:231 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
5702024-11-20T02:15:43.844ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5712024-11-20T02:15:43.844ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5722024-11-20T02:15:43.932ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5732024-11-20T02:15:43.932ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea"), full_name: "oxp_9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea" } file = sled-storage/src/manager.rs:1338
5742024-11-20T02:15:44.028ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5752024-11-20T02:15:44.028ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/debug"), full_name: "oxp_98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/debug" } file = sled-storage/src/manager.rs:1338
5762024-11-20T02:15:44.094ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5772024-11-20T02:15:44.094ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5782024-11-20T02:15:44.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5792024-11-20T02:15:44.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crucible" } file = sled-storage/src/manager.rs:1338
5802024-11-20T02:15:44.266ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5812024-11-20T02:15:44.266ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crucible" } file = sled-storage/src/manager.rs:1338
5822024-11-20T02:15:44.356ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5832024-11-20T02:15:44.356ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76"), full_name: "oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone/oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76" } file = sled-storage/src/manager.rs:1338
5842024-11-20T02:15:44.483ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5852024-11-20T02:15:44.483ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_841052f1-d4ff-4743-9006-a66dddb621f3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5862024-11-20T02:15:44.574ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5872024-11-20T02:15:44.574ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5882024-11-20T02:15:44.664ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5892024-11-20T02:15:44.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone" } file = sled-storage/src/manager.rs:1338
5902024-11-20T02:15:44.732ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5912024-11-20T02:15:44.732ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9"), full_name: "oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/zone/oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9" } file = sled-storage/src/manager.rs:1338
5922024-11-20T02:15:44.825ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/probe_manager.rs:231 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
5932024-11-20T02:15:44.828ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5942024-11-20T02:15:44.828ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01"), full_name: "oxp_841052f1-d4ff-4743-9006-a66dddb621f3/crypt/zone/oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01" } file = sled-storage/src/manager.rs:1338
5952024-11-20T02:15:44.924ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5962024-11-20T02:15:44.924ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3"), full_name: "oxp_9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3" } file = sled-storage/src/manager.rs:1338
5972024-11-20T02:15:45.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5982024-11-20T02:15:45.022ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/debug"), full_name: "oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/debug" } file = sled-storage/src/manager.rs:1338
5992024-11-20T02:15:45.092ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6002024-11-20T02:15:45.092ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone"), full_name: "oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/zone" } file = sled-storage/src/manager.rs:1338
6012024-11-20T02:15:45.159ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6022024-11-20T02:15:45.160ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61"), full_name: "oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/zone/oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61" } file = sled-storage/src/manager.rs:1338
6032024-11-20T02:15:45.261ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6042024-11-20T02:15:45.261ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone"), full_name: "oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/zone" } file = sled-storage/src/manager.rs:1338
6052024-11-20T02:15:45.329ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6062024-11-20T02:15:45.329ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/debug"), full_name: "oxp_9529683f-e460-4948-a032-9f2d5e49707f/crypt/debug" } file = sled-storage/src/manager.rs:1338
6072024-11-20T02:15:45.397ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6082024-11-20T02:15:45.397ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369"), full_name: "oxp_9529683f-e460-4948-a032-9f2d5e49707f/crypt/zone/oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369" } file = sled-storage/src/manager.rs:1338
6092024-11-20T02:15:45.442ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8772354147655947184 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
6102024-11-20T02:15:45.442ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12412858464658743504 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
6112024-11-20T02:15:45.494ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6122024-11-20T02:15:45.494ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-datasets.json" request = datasets_ensure
6132024-11-20T02:15:45.494ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6142024-11-20T02:15:45.495ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-datasets.json" request = datasets_ensure
6152024-11-20T02:15:45.495ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:851 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
6162024-11-20T02:15:45.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5779506 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:65055 req_id = bb55a99f-34f5-4059-8d69-5f64b2f41b53 response_code = 200 uri = /datasets
6172024-11-20T02:15:45.524ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4350
6182024-11-20T02:15:45.524ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4360 gateway = fd00:1122:3344:101::1
6192024-11-20T02:15:45.530ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4439
6202024-11-20T02:15:45.537ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 5f5b358c-72af-40bc-b566-87277a6c9226 (service), filesystem_pool: Some(ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 91f15412-69e9-452d-a9a3-48b1edccb07f (service), filesystem_pool: Some(ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: aef7e376-ca26-4bd7-b310-37f05d027a82 (service), filesystem_pool: Some(ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6212024-11-20T02:15:45.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47018
6222024-11-20T02:15:45.538ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6232024-11-20T02:15:45.538ZINFOSledAgent (ServiceManager): No ledger in /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json file = common/src/ledger.rs:189
6242024-11-20T02:15:45.538ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json file = common/src/ledger.rs:189
6252024-11-20T02:15:45.538ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
6262024-11-20T02:15:45.538ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6272024-11-20T02:15:45.538ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6282024-11-20T02:15:45.538ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
6292024-11-20T02:15:45.538ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6302024-11-20T02:15:45.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6312024-11-20T02:15:45.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6322024-11-20T02:15:45.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6332024-11-20T02:15:45.651ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226 file = illumos-utils/src/zone.rs:325
6342024-11-20T02:15:45.655ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82 file = illumos-utils/src/zone.rs:325
6352024-11-20T02:15:45.662ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f file = illumos-utils/src/zone.rs:325
6362024-11-20T02:15:45.672ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226 file = illumos-utils/src/zone.rs:363
6372024-11-20T02:15:45.677ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82 file = illumos-utils/src/zone.rs:363
6382024-11-20T02:15:45.681ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4505
6392024-11-20T02:15:45.681ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4532
6402024-11-20T02:15:45.684ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f file = illumos-utils/src/zone.rs:363
6412024-11-20T02:15:45.722ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4545
6422024-11-20T02:15:45.722ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4391
6432024-11-20T02:15:45.786ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4433
6442024-11-20T02:15:45.786ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4512 rack_subnet = fd00:1122:3344::
6452024-11-20T02:15:45.812ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4523
6462024-11-20T02:15:45.812ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4565
6472024-11-20T02:15:45.827ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/probe_manager.rs:231 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
6482024-11-20T02:15:45.919ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4597
6492024-11-20T02:15:45.919ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4603
6502024-11-20T02:15:46.061ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4644
6512024-11-20T02:15:46.061ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6522024-11-20T02:15:46.093ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/52b4024d-59d8-46f0-844c-2d14ce62d55b) file = sled-agent/src/nexus.rs:527 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
6532024-11-20T02:15:46.094ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6542024-11-20T02:15:46.126ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6552024-11-20T02:15:46.126ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6562024-11-20T02:15:46.126ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 0
6572024-11-20T02:15:46.126ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6582024-11-20T02:15:46.162ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
6592024-11-20T02:15:46.212ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6602024-11-20T02:15:46.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6612024-11-20T02:15:46.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6622024-11-20T02:15:46.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6632024-11-20T02:15:46.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6642024-11-20T02:15:46.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6652024-11-20T02:15:46.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6662024-11-20T02:15:46.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6672024-11-20T02:15:46.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6682024-11-20T02:15:46.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6692024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6702024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6712024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6722024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6732024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6742024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6752024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6762024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6772024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6782024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6792024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6802024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6812024-11-20T02:15:46.213ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6822024-11-20T02:15:46.674ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5115632205813099277 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
6832024-11-20T02:15:46.675ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3652746957575530757 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
6842024-11-20T02:15:47.298ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852024-11-20T02:15:47.298ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6862024-11-20T02:15:47.298ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
6872024-11-20T02:15:47.785ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6882024-11-20T02:15:48.264ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6892024-11-20T02:15:48.264ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6902024-11-20T02:15:48.264ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6912024-11-20T02:15:48.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226") failed: Property not found. retry in 44.904517ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
6922024-11-20T02:15:48.272ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
6932024-11-20T02:15:48.276ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
6942024-11-20T02:15:48.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226") failed: Property not found. retry in 118.058853ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
6952024-11-20T02:15:48.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82") failed: Property not found. retry in 40.767692ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
6962024-11-20T02:15:48.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f") failed: Property not found. retry in 68.28912ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
6972024-11-20T02:15:48.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82") failed: Property not found. retry in 120.823145ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
6982024-11-20T02:15:48.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226") failed: Property not found. retry in 227.910586ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
6992024-11-20T02:15:48.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f") failed: Property not found. retry in 113.030005ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
7002024-11-20T02:15:48.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82") failed: Property not found. retry in 210.406079ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
7012024-11-20T02:15:48.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226") failed: Property not found. retry in 586.722426ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
7022024-11-20T02:15:48.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f") failed: Property not found. retry in 295.917781ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
7032024-11-20T02:15:48.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82") failed: Property not found. retry in 278.74688ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
7042024-11-20T02:15:49.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f") failed: Property not found. retry in 374.383017ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
7052024-11-20T02:15:49.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82") failed: Property not found. retry in 689.557044ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
7062024-11-20T02:15:49.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226") failed: Property not found. retry in 877.176967ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
7072024-11-20T02:15:49.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f") failed: Property not found. retry in 403.654449ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
7082024-11-20T02:15:49.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f") failed: Property not found. retry in 715.824548ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
7092024-11-20T02:15:49.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82") failed: Property not found. retry in 592.214529ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
7102024-11-20T02:15:50.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226") failed: Property not found. retry in 580.188479ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
7112024-11-20T02:15:50.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82") failed: Property not found. retry in 883.22451ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
7122024-11-20T02:15:50.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f") failed: Property not found. retry in 684.935477ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
7132024-11-20T02:15:50.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226") failed: Property not found. retry in 1.042762337s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
7142024-11-20T02:15:51.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f") failed: Property not found. retry in 1.132039329s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
7152024-11-20T02:15:51.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82") failed: Property not found. retry in 944.468376ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
7162024-11-20T02:15:51.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226") failed: Property not found. retry in 718.79871ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
7172024-11-20T02:15:52.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82") failed: Property not found. retry in 695.682573ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
7182024-11-20T02:15:52.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f") failed: Property not found. retry in 638.570957ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
7192024-11-20T02:15:52.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226") failed: Property not found. retry in 832.457125ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
7202024-11-20T02:15:53.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82") failed: Property not found. retry in 1.392650365s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
7212024-11-20T02:15:53.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f") failed: Property not found. retry in 1.143419477s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
7222024-11-20T02:15:54.457ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_5f5b358c-72af-40bc-b566-87277a6c9226
7232024-11-20T02:15:54.458ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_aef7e376-ca26-4bd7-b310-37f05d027a82
7242024-11-20T02:15:54.458ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_91f15412-69e9-452d-a9a3-48b1edccb07f
7252024-11-20T02:15:54.458ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7262024-11-20T02:15:54.458ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json"
7272024-11-20T02:15:54.458ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7282024-11-20T02:15:54.458ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json"
7292024-11-20T02:15:54.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8920805 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47018 req_id = 7d0e0dfc-eb20-457b-ae40-b0d82c88d41e response_code = 204 uri = /omicron-zones
7302024-11-20T02:15:54.460ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7312024-11-20T02:15:54.513ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7322024-11-20T02:15:54.559ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7332024-11-20T02:15:54.606ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7342024-11-20T02:15:54.606ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7352024-11-20T02:15:54.637ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7362024-11-20T02:15:54.638ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7372024-11-20T02:15:54.638ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7382024-11-20T02:15:54.667ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 5f5b358c-72af-40bc-b566-87277a6c9226 (service), filesystem_pool: Some(ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 91f15412-69e9-452d-a9a3-48b1edccb07f (service), filesystem_pool: Some(ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: aef7e376-ca26-4bd7-b310-37f05d027a82 (service), filesystem_pool: Some(ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 45a23fab-e521-4372-b089-d43d65804661 (service), filesystem_pool: Some(ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: e6a4bf62-1f27-43f8-82db-2a6db0c27052, kind: Service { id: 45a23fab-e521-4372-b089-d43d65804661 }, name: Name("ntp-45a23fab-e521-4372-b089-d43d65804661"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 99])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7392024-11-20T02:15:54.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58083
7402024-11-20T02:15:54.667ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7412024-11-20T02:15:54.667ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json file = common/src/ledger.rs:178
7422024-11-20T02:15:54.667ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json file = common/src/ledger.rs:178
7432024-11-20T02:15:54.667ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
7442024-11-20T02:15:54.667ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7452024-11-20T02:15:54.668ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7462024-11-20T02:15:54.668ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
7472024-11-20T02:15:54.668ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7482024-11-20T02:15:54.680ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7492024-11-20T02:15:54.712ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7502024-11-20T02:15:54.712ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7512024-11-20T02:15:54.712ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7522024-11-20T02:15:54.742ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 202, 99]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7532024-11-20T02:15:54.742ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = boundary_ntp
7542024-11-20T02:15:54.742ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7552024-11-20T02:15:54.742ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7562024-11-20T02:15:54.743ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7572024-11-20T02:15:54.744ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7582024-11-20T02:15:54.769ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 file = illumos-utils/src/zone.rs:325
7592024-11-20T02:15:54.787ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 file = illumos-utils/src/zone.rs:363
7602024-11-20T02:15:55.445ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8772354147655947184 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
7612024-11-20T02:15:55.445ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12412858464658743504 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
7622024-11-20T02:15:55.462ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_45a23fab-e521-4372-b089-d43d65804661: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7632024-11-20T02:15:55.462ZINFOSledAgent (ServiceManager): Booting oxz_ntp_45a23fab-e521-4372-b089-d43d65804661 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_45a23fab-e521-4372-b089-d43d65804661
7642024-11-20T02:15:55.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_45a23fab-e521-4372-b089-d43d65804661") failed: Property not found. retry in 32.373085ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_45a23fab-e521-4372-b089-d43d65804661
7652024-11-20T02:15:55.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_45a23fab-e521-4372-b089-d43d65804661") failed: Property not found. retry in 110.275039ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_45a23fab-e521-4372-b089-d43d65804661
7662024-11-20T02:15:55.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_45a23fab-e521-4372-b089-d43d65804661") failed: Property not found. retry in 271.628506ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_45a23fab-e521-4372-b089-d43d65804661
7672024-11-20T02:15:56.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_45a23fab-e521-4372-b089-d43d65804661") failed: Property not found. retry in 487.604415ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_45a23fab-e521-4372-b089-d43d65804661
7682024-11-20T02:15:56.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_45a23fab-e521-4372-b089-d43d65804661") failed: Property not found. retry in 1.138025155s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_45a23fab-e521-4372-b089-d43d65804661
7692024-11-20T02:15:56.677ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5115632205813099277 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
7702024-11-20T02:15:56.677ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3652746957575530757 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
7712024-11-20T02:15:57.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_45a23fab-e521-4372-b089-d43d65804661") failed: Property not found. retry in 1.274788508s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_45a23fab-e521-4372-b089-d43d65804661
7722024-11-20T02:15:58.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_45a23fab-e521-4372-b089-d43d65804661") failed: Property not found. retry in 891.551691ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_45a23fab-e521-4372-b089-d43d65804661
7732024-11-20T02:15:59.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_45a23fab-e521-4372-b089-d43d65804661") failed: Property not found. retry in 613.868178ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_45a23fab-e521-4372-b089-d43d65804661
7742024-11-20T02:16:00.503ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_ntp_45a23fab-e521-4372-b089-d43d65804661
7752024-11-20T02:16:00.503ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7762024-11-20T02:16:00.503ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json"
7772024-11-20T02:16:00.503ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7782024-11-20T02:16:00.503ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json"
7792024-11-20T02:16:00.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5836501 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58083 req_id = 52d47804-f69d-4954-b5dd-96e89a4a15ac response_code = 204 uri = /omicron-zones
7802024-11-20T02:16:00.506ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7812024-11-20T02:16:00.535ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7822024-11-20T02:16:00.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36717
7832024-11-20T02:16:00.546ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_45a23fab-e521-4372-b089-d43d65804661': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7842024-11-20T02:16:00.546ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10462 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36717 req_id = c6051eb5-4d33-4fa7-94c1-27eaa937ff45 response_code = 500 uri = /timesync
7852024-11-20T02:16:00.548ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7862024-11-20T02:16:00.655ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7872024-11-20T02:16:00.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36713
7882024-11-20T02:16:03.452ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13057755683105750488 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
7892024-11-20T02:16:04.236ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15231879725690362417 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
7902024-11-20T02:16:04.460ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6493419333580758357 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
7912024-11-20T02:16:04.666ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_45a23fab-e521-4372-b089-d43d65804661': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7922024-11-20T02:16:04.667ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4011629 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36713 req_id = 93fbc47d-55af-46d5-9c07-d1edf5340203 response_code = 500 uri = /timesync
7932024-11-20T02:16:04.669ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7942024-11-20T02:16:04.870ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7952024-11-20T02:16:04.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48001
7962024-11-20T02:16:04.878ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_45a23fab-e521-4372-b089-d43d65804661': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7972024-11-20T02:16:04.878ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48001 req_id = e1a41422-b282-4a49-bc24-c8a0055525b3 response_code = 500 uri = /timesync
7982024-11-20T02:16:04.882ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7992024-11-20T02:16:05.101ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8002024-11-20T02:16:05.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40926
8012024-11-20T02:16:05.110ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_45a23fab-e521-4372-b089-d43d65804661': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
8022024-11-20T02:16:05.110ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8703 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40926 req_id = 05d9ec2f-4a4c-4ad2-838a-329883829e0e response_code = 500 uri = /timesync
8032024-11-20T02:16:05.113ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8042024-11-20T02:16:05.403ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8052024-11-20T02:16:05.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46339
8062024-11-20T02:16:05.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46339 req_id = 0b2662a4-0578-4ebd-ab98-0dfbd84fc1aa response_code = 200 uri = /timesync
8072024-11-20T02:16:05.414ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8082024-11-20T02:16:05.414ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8092024-11-20T02:16:05.447ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8772354147655947184 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
8102024-11-20T02:16:05.447ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12412858464658743504 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
8112024-11-20T02:16:05.701ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8122024-11-20T02:16:05.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64992
8132024-11-20T02:16:05.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64992 req_id = adc6bc58-eda4-4bb5-85dd-d61641fc06ca response_code = 200 uri = /timesync
8142024-11-20T02:16:05.712ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8152024-11-20T02:16:05.712ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8162024-11-20T02:16:05.978ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8172024-11-20T02:16:05.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45623
8182024-11-20T02:16:05.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7610 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45623 req_id = 69535dcb-5748-46f3-be4e-4637f598b101 response_code = 200 uri = /timesync
8192024-11-20T02:16:05.988ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8202024-11-20T02:16:05.988ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8212024-11-20T02:16:06.297ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8222024-11-20T02:16:06.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53956
8232024-11-20T02:16:06.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7910 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53956 req_id = f47c1018-1d10-4c59-ae0a-80a7d85ccf09 response_code = 200 uri = /timesync
8242024-11-20T02:16:06.308ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8252024-11-20T02:16:06.308ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8262024-11-20T02:16:06.645ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8272024-11-20T02:16:06.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52392
8282024-11-20T02:16:06.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6661 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52392 req_id = d718aa70-8d4e-4574-8561-4fe6ff4016e3 response_code = 200 uri = /timesync
8292024-11-20T02:16:06.653ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8302024-11-20T02:16:06.653ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8312024-11-20T02:16:06.680ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5115632205813099277 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
8322024-11-20T02:16:06.680ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3652746957575530757 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
8332024-11-20T02:16:06.364ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8342024-11-20T02:16:06.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63491
8352024-11-20T02:16:06.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8667 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63491 req_id = e1b0896a-4e60-4c14-aeea-3db32d2d9c1f response_code = 200 uri = /timesync
8362024-11-20T02:16:06.374ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732068964.7895856, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8372024-11-20T02:16:06.374ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8382024-11-20T02:16:07.167ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8392024-11-20T02:16:07.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54602
8402024-11-20T02:16:07.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54602 req_id = ad33136d-44a8-4369-898e-4fdc2a2724f6 response_code = 200 uri = /timesync
8412024-11-20T02:16:07.178ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732068964.7895856, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8422024-11-20T02:16:07.178ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8432024-11-20T02:16:07.881ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8442024-11-20T02:16:07.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61855
8452024-11-20T02:16:07.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6972 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61855 req_id = 78112d3f-5335-4db1-ae7d-3ac51e5dcdcf response_code = 200 uri = /timesync
8462024-11-20T02:16:07.890ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732068964.7895856, correction: 0.010924918 } file = sled-agent/src/rack_setup/service.rs:740
8472024-11-20T02:16:07.890ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8482024-11-20T02:16:08.917ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8492024-11-20T02:16:08.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50807
8502024-11-20T02:16:08.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8646 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50807 req_id = 56e54e88-1523-4986-a6ed-cbe81c1f1e92 response_code = 200 uri = /timesync
8512024-11-20T02:16:08.928ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732068964.7895856, correction: 0.009448876 } file = sled-agent/src/rack_setup/service.rs:740
8522024-11-20T02:16:08.928ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8532024-11-20T02:16:09.600ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8542024-11-20T02:16:09.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64682
8552024-11-20T02:16:09.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64682 req_id = a28a2c42-9677-4117-8a09-5780de7f735d response_code = 200 uri = /timesync
8562024-11-20T02:16:09.611ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732068964.7895856, correction: 0.007604945 } file = sled-agent/src/rack_setup/service.rs:740
8572024-11-20T02:16:09.611ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8582024-11-20T02:16:09.735ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2908858114172735233 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
8592024-11-20T02:16:09.735ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8793089570890352877 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
8602024-11-20T02:16:10.781ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8612024-11-20T02:16:10.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56237
8622024-11-20T02:16:10.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8481 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56237 req_id = 9ec71597-968b-43da-846b-0611d66a77ff response_code = 200 uri = /timesync
8632024-11-20T02:16:10.792ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732068964.7895856, correction: 0.003440378 } file = sled-agent/src/rack_setup/service.rs:740
8642024-11-20T02:16:10.792ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8652024-11-20T02:16:11.024ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 134.253784ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
8662024-11-20T02:16:11.889ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8672024-11-20T02:16:11.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41204
8682024-11-20T02:16:11.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20659 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41204 req_id = c3675283-5304-4cba-983b-04abe46fb915 response_code = 200 uri = /timesync
8692024-11-20T02:16:11.913ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2873254270, ip_addr: 171.66.97.126, stratum: 3, ref_time: 1732068971.205963, correction: 0.002739104 } file = sled-agent/src/rack_setup/service.rs:740
8702024-11-20T02:16:11.913ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
8712024-11-20T02:16:11.942ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 5f5b358c-72af-40bc-b566-87277a6c9226 (service), filesystem_pool: Some(ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 91f15412-69e9-452d-a9a3-48b1edccb07f (service), filesystem_pool: Some(ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: aef7e376-ca26-4bd7-b310-37f05d027a82 (service), filesystem_pool: Some(ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 45a23fab-e521-4372-b089-d43d65804661 (service), filesystem_pool: Some(ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: e6a4bf62-1f27-43f8-82db-2a6db0c27052, kind: Service { id: 45a23fab-e521-4372-b089-d43d65804661 }, name: Name("ntp-45a23fab-e521-4372-b089-d43d65804661"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 99])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 81f18d2a-d19f-42f7-a195-385605da385a (service), filesystem_pool: Some(ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External } } } }, OmicronZoneConfig { id: b83607c3-8087-42a8-a94e-fd106daf6662 (service), filesystem_pool: Some(ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ff80a10-1025-4323-bd5f-d32d912dee40 (service), filesystem_pool: Some(ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External } } } }, OmicronZoneConfig { id: 5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5 (service), filesystem_pool: Some(ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6ae6c994-8f33-4617-93c3-86479a56575c (service), filesystem_pool: Some(ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
8722024-11-20T02:16:11.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47609
8732024-11-20T02:16:11.942ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8742024-11-20T02:16:11.942ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json file = common/src/ledger.rs:178
8752024-11-20T02:16:11.942ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json file = common/src/ledger.rs:178
8762024-11-20T02:16:11.943ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
8772024-11-20T02:16:11.943ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
8782024-11-20T02:16:11.943ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
8792024-11-20T02:16:11.943ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
8802024-11-20T02:16:11.943ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8812024-11-20T02:16:12.024ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8822024-11-20T02:16:12.024ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8832024-11-20T02:16:12.024ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8842024-11-20T02:16:12.024ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8852024-11-20T02:16:12.024ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8862024-11-20T02:16:12.112ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5 file = illumos-utils/src/zone.rs:325
8872024-11-20T02:16:12.116ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c file = illumos-utils/src/zone.rs:325
8882024-11-20T02:16:12.120ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40 file = illumos-utils/src/zone.rs:325
8892024-11-20T02:16:12.124ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662 file = illumos-utils/src/zone.rs:325
8902024-11-20T02:16:12.128ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a file = illumos-utils/src/zone.rs:325
8912024-11-20T02:16:12.133ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5 file = illumos-utils/src/zone.rs:363
8922024-11-20T02:16:12.138ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c file = illumos-utils/src/zone.rs:363
8932024-11-20T02:16:12.143ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40 file = illumos-utils/src/zone.rs:363
8942024-11-20T02:16:12.148ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662 file = illumos-utils/src/zone.rs:363
8952024-11-20T02:16:12.152ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a file = illumos-utils/src/zone.rs:363
8962024-11-20T02:16:14.983ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54194
8972024-11-20T02:16:14.983ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54194 req_id = 6e17e319-4437-46f4-a76f-ec4634e33905 response_code = 200 uri = /baseboard
8982024-11-20T02:16:16.149ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='81f18d2a-d19f-42f7-a195-385605da385a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8992024-11-20T02:16:16.149ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9002024-11-20T02:16:16.165ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b83607c3-8087-42a8-a94e-fd106daf6662'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9012024-11-20T02:16:16.165ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9022024-11-20T02:16:16.199ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9032024-11-20T02:16:16.199ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9042024-11-20T02:16:16.205ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5ff80a10-1025-4323-bd5f-d32d912dee40'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9052024-11-20T02:16:16.205ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9062024-11-20T02:16:16.211ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='6ae6c994-8f33-4617-93c3-86479a56575c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9072024-11-20T02:16:16.211ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9082024-11-20T02:16:16.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 31.412438ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9092024-11-20T02:16:16.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 69.780317ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9102024-11-20T02:16:16.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 69.209628ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9112024-11-20T02:16:16.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 87.141061ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9122024-11-20T02:16:16.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 66.45935ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9132024-11-20T02:16:16.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 74.738619ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9142024-11-20T02:16:16.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 124.970182ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9152024-11-20T02:16:16.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 135.864157ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9162024-11-20T02:16:16.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 132.363986ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9172024-11-20T02:16:16.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 157.570123ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9182024-11-20T02:16:16.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 94.100554ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9192024-11-20T02:16:16.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 227.386625ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9202024-11-20T02:16:17.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 157.121553ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9212024-11-20T02:16:17.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 223.590927ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9222024-11-20T02:16:17.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 174.114482ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9232024-11-20T02:16:17.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 562.237803ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9242024-11-20T02:16:17.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 301.307119ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9252024-11-20T02:16:17.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 545.01594ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9262024-11-20T02:16:17.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 599.889443ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9272024-11-20T02:16:17.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 318.539424ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9282024-11-20T02:16:17.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.133214459s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9292024-11-20T02:16:17.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 464.606953ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9302024-11-20T02:16:17.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 754.390228ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9312024-11-20T02:16:17.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 921.994014ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9322024-11-20T02:16:17.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.138068319s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9332024-11-20T02:16:18.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 960.640132ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9342024-11-20T02:16:18.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 1.403801642s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9352024-11-20T02:16:18.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 740.354772ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9362024-11-20T02:16:18.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 1.120367771s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9372024-11-20T02:16:19.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.290662528s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9382024-11-20T02:16:19.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 794.66989ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9392024-11-20T02:16:19.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 674.17293ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9402024-11-20T02:16:19.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 1.37975997s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9412024-11-20T02:16:19.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 757.459839ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9422024-11-20T02:16:19.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 1.16153033s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9432024-11-20T02:16:20.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 899.812399ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9442024-11-20T02:16:20.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.484743798s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9452024-11-20T02:16:20.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 1.402016025s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9462024-11-20T02:16:20.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 921.77671ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9472024-11-20T02:16:21.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 852.6594ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9482024-11-20T02:16:21.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 546.706608ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9492024-11-20T02:16:21.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 1.128192495s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9502024-11-20T02:16:21.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.182894128s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9512024-11-20T02:16:21.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.448729978s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9522024-11-20T02:16:21.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 967.9137ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9532024-11-20T02:16:22.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 880.508595ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9542024-11-20T02:16:22.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 1.410886071s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9552024-11-20T02:16:22.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 1.069073065s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9562024-11-20T02:16:22.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 811.399384ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9572024-11-20T02:16:23.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 519.325852ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9582024-11-20T02:16:23.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.035785354s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9592024-11-20T02:16:23.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.224678134s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9602024-11-20T02:16:23.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 1.079401841s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9612024-11-20T02:16:23.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 1.380617781s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9622024-11-20T02:16:24.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 978.139846ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9632024-11-20T02:16:24.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.334404492s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9642024-11-20T02:16:24.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.20660924s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9652024-11-20T02:16:24.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 1.07953981s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9662024-11-20T02:16:25.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 1.484295497s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9672024-11-20T02:16:25.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 682.948038ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9682024-11-20T02:16:25.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 787.112002ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9692024-11-20T02:16:25.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 1.033543077s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9702024-11-20T02:16:25.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 839.35718ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9712024-11-20T02:16:26.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 713.932935ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9722024-11-20T02:16:26.197ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 688.104086ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
9732024-11-20T02:16:26.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.345955305s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9742024-11-20T02:16:26.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 594.988611ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9752024-11-20T02:16:26.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 724.966602ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9762024-11-20T02:16:26.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.153169205s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9772024-11-20T02:16:26.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 1.13271484s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9782024-11-20T02:16:27.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 1.343407994s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9792024-11-20T02:16:27.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 956.451862ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9802024-11-20T02:16:27.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 941.133522ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9812024-11-20T02:16:28.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.352720343s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9822024-11-20T02:16:28.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 1.388097907s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9832024-11-20T02:16:28.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 554.605534ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9842024-11-20T02:16:28.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 864.549507ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9852024-11-20T02:16:28.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 719.669163ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9862024-11-20T02:16:29.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 1.15609337s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9872024-11-20T02:16:29.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.162763516s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9882024-11-20T02:16:29.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662") failed: Property not found. retry in 1.248889463s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
9892024-11-20T02:16:29.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.157502038s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9902024-11-20T02:16:29.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 648.281737ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9912024-11-20T02:16:30.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 1.026171772s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9922024-11-20T02:16:30.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5") failed: Property not found. retry in 1.196476747s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
9932024-11-20T02:16:30.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 856.044323ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9942024-11-20T02:16:30.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.189557472s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
9952024-11-20T02:16:31.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 533.112591ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9962024-11-20T02:16:31.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 541.653342ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9972024-11-20T02:16:31.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 818.641434ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
9982024-11-20T02:16:31.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 915.320885ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
9992024-11-20T02:16:31.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.413707959s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
10002024-11-20T02:16:32.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 1.486753288s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
10012024-11-20T02:16:32.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 813.857538ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
10022024-11-20T02:16:33.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.183243635s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
10032024-11-20T02:16:34.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.109900678s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
10042024-11-20T02:16:34.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 840.136821ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
10052024-11-20T02:16:34.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 823.74912ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
10062024-11-20T02:16:35.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 1.405222903s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
10072024-11-20T02:16:35.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 686.033115ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
10082024-11-20T02:16:35.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.128751344s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
10092024-11-20T02:16:36.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 532.14493ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
10102024-11-20T02:16:36.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 1.409812879s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
10112024-11-20T02:16:36.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 657.240167ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
10122024-11-20T02:16:36.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.468182378s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
10132024-11-20T02:16:37.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.039684288s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
10142024-11-20T02:16:37.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 986.216756ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
10152024-11-20T02:16:38.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.113523781s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
10162024-11-20T02:16:38.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.256406215s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
10172024-11-20T02:16:38.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 529.643087ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
10182024-11-20T02:16:39.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.031566491s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
10192024-11-20T02:16:39.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 764.322473ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
10202024-11-20T02:16:39.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c") failed: Property not found. retry in 1.423058659s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
10212024-11-20T02:16:40.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40") failed: Property not found. retry in 1.361458356s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
10222024-11-20T02:16:40.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a") failed: Property not found. retry in 910.719895ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
10232024-11-20T02:16:41.625ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5
10242024-11-20T02:16:41.625ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_6ae6c994-8f33-4617-93c3-86479a56575c
10252024-11-20T02:16:41.625ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_5ff80a10-1025-4323-bd5f-d32d912dee40
10262024-11-20T02:16:41.625ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_b83607c3-8087-42a8-a94e-fd106daf6662
10272024-11-20T02:16:41.625ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_81f18d2a-d19f-42f7-a195-385605da385a
10282024-11-20T02:16:41.625ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
10292024-11-20T02:16:41.626ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json"
10302024-11-20T02:16:41.626ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
10312024-11-20T02:16:41.627ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json"
10322024-11-20T02:16:41.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29682909 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47609 req_id = 0d912625-d67f-4f4f-86af-ec86487979c2 response_code = 204 uri = /omicron-zones
10332024-11-20T02:16:41.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49967
10342024-11-20T02:16:41.701ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3801
10352024-11-20T02:16:41.935ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 798.802829ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
10362024-11-20T02:16:44.302ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3819
10372024-11-20T02:16:45.018ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35115
10382024-11-20T02:16:45.018ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35115 req_id = f95320b0-bbb9-4974-9386-46fd41c769bb response_code = 200 uri = /baseboard
10392024-11-20T02:16:54.830ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize CockroachDb: Error running command in zone 'oxz_cockroachdb_5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5': Command [/opt/oxide/cockroachdb/bin/cockroach sql --insecure --host [fd00:1122:3344:101::6]:32221 --file /opt/oxide/cockroachdb/sql/dbinit.sql] executed and failed with status: exit status: 1 stdout: BEGIN\nCREATE DATABASE\nCREATE ROLE\nALTER DEFAULT PRIVILEGES\nCONFIGURE ZONE 1\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\n stderr: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_CLIENT_REJECT): "sql txn" meta={id=9a6d8497 key=/NamespaceTable/30/1/106/0/"public"/4/1 pri=0.04232465 epo=0 ts=1732069005.678909762,0 min=1732069005.678909762,0 seq=311} lock=true stat=PENDING rts=1732069005.678909762,0 wto=false gul=1732069006.178909762,0\nSQLSTATE: 40001\nHINT: See: https://www.cockroachlabs.com/docs/v22.1/transaction-retry-error-reference.html#abort_reason_client_reject\nERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_CLIENT_REJECT): "sql txn" meta={id=9a6d8497 key=/NamespaceTable/30/1/106/0/"public"/4/1 pri=0.04232465 epo=0 ts=1732069005.678909762,0 min=1732069005.678909762,0 seq=311} lock=true stat=PENDING rts=1732069005.678909762,0 wto=false gul=1732069006.178909762,0\nSQLSTATE: 40001\nHINT: See: https://www.cockroachlabs.com/docs/v22.1/transaction-retry-error-reference.html#abort_reason_client_reject\nFailed running "sql"\n file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 13161954 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49967 req_id = 7366d74f-45db-418e-9185-275f20aa3186 response_code = 500 uri = /cockroachdb
10402024-11-20T02:16:54.831ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7366d74f-45db-418e-9185-275f20aa3186", "content-length": "124", "date": "Wed, 20 Nov 2024 02:16:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7366d74f-45db-418e-9185-275f20aa3186" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 122.75389ms
10412024-11-20T02:16:55.021ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3801
10422024-11-20T02:16:55.212ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3819
10432024-11-20T02:16:57.935ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3842
10442024-11-20T02:16:57.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2979136 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49967 req_id = 37fb70ab-fb0c-48e8-97d5-53f89e58c802 response_code = 204 uri = /cockroachdb
10452024-11-20T02:16:57.939ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.6535451s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
10462024-11-20T02:16:57.970ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 5f5b358c-72af-40bc-b566-87277a6c9226 (service), filesystem_pool: Some(ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 91f15412-69e9-452d-a9a3-48b1edccb07f (service), filesystem_pool: Some(ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: aef7e376-ca26-4bd7-b310-37f05d027a82 (service), filesystem_pool: Some(ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 45a23fab-e521-4372-b089-d43d65804661 (service), filesystem_pool: Some(ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: e6a4bf62-1f27-43f8-82db-2a6db0c27052, kind: Service { id: 45a23fab-e521-4372-b089-d43d65804661 }, name: Name("ntp-45a23fab-e521-4372-b089-d43d65804661"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 99])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 81f18d2a-d19f-42f7-a195-385605da385a (service), filesystem_pool: Some(ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External } } } }, OmicronZoneConfig { id: b83607c3-8087-42a8-a94e-fd106daf6662 (service), filesystem_pool: Some(ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ff80a10-1025-4323-bd5f-d32d912dee40 (service), filesystem_pool: Some(ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External } } } }, OmicronZoneConfig { id: 5de3a3cd-e9e0-49bf-acfb-5cd00b23b9b5 (service), filesystem_pool: Some(ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6ae6c994-8f33-4617-93c3-86479a56575c (service), filesystem_pool: Some(ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9fe4351b-e265-4106-87d1-05131cb21015 (service), filesystem_pool: Some(ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c (service), filesystem_pool: Some(ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 (service), filesystem_pool: Some(ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c (service), filesystem_pool: Some(ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f (service), filesystem_pool: Some(ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: eb5a339f-68aa-43dd-a9e0-5a593d764f76 (service), filesystem_pool: Some(ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: d8fff464-debf-49cf-bde9-6039821151f9 (service), filesystem_pool: Some(ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2203f339-df1d-4375-adc7-aa6d4752eac3 (service), filesystem_pool: Some(ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 7cd111c8-3a43-44ad-a778-9cdd26757079 (service), filesystem_pool: Some(ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 6832d082-1326-4b84-97c9-53ab1b5d8dab (service), filesystem_pool: Some(ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: c407b09f-09c8-430e-9a61-4fb15c3e6fdd (service), filesystem_pool: Some(ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External } } } }, OmicronZoneConfig { id: 89c4ff8b-3317-4bfc-aeb9-014f92aa8898 (service), filesystem_pool: Some(ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External } } } }, OmicronZoneConfig { id: d7d0afaa-f05f-403e-8c7f-aead8555cc26 (service), filesystem_pool: Some(ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External } } } }, OmicronZoneConfig { id: b9a9b29d-785e-4aae-9919-4d8c788c2f0c (service), filesystem_pool: Some(ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0b0a556e-8c01-4c2b-8174-5878f8f49b01 (service), filesystem_pool: Some(ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 85fc546d-cf74-47d0-bea3-7488929604ea (service), filesystem_pool: Some(ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External } } } }, OmicronZoneConfig { id: d0b5d715-6efd-440d-92e8-06e32eca8da4 (service), filesystem_pool: Some(ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9c1ce14e-4e8c-4569-8039-146f3f31e8d8 (service), filesystem_pool: Some(ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External } } } }, OmicronZoneConfig { id: ac4b94cc-51ea-4477-841d-bace5b843d61 (service), filesystem_pool: Some(ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10472024-11-20T02:16:57.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55317
10482024-11-20T02:16:57.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10492024-11-20T02:16:57.971ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json file = common/src/ledger.rs:178
10502024-11-20T02:16:57.972ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json file = common/src/ledger.rs:178
10512024-11-20T02:16:57.972ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
10522024-11-20T02:16:57.972ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10532024-11-20T02:16:57.972ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10542024-11-20T02:16:57.973ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
10552024-11-20T02:16:57.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10562024-11-20T02:16:58.091ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10572024-11-20T02:16:58.092ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10582024-11-20T02:16:58.093ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10592024-11-20T02:16:58.154ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10602024-11-20T02:16:58.154ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10612024-11-20T02:16:58.154ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10622024-11-20T02:16:58.154ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10632024-11-20T02:16:58.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10642024-11-20T02:16:58.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10652024-11-20T02:16:58.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10662024-11-20T02:16:58.322ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10672024-11-20T02:16:58.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10682024-11-20T02:16:58.323ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10692024-11-20T02:16:58.346ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10702024-11-20T02:16:58.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10712024-11-20T02:16:58.383ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10722024-11-20T02:16:58.383ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10732024-11-20T02:16:58.383ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10742024-11-20T02:16:58.383ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10752024-11-20T02:16:58.383ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4 file = illumos-utils/src/zone.rs:325
10762024-11-20T02:16:58.388ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab file = illumos-utils/src/zone.rs:325
10772024-11-20T02:16:58.392ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26 file = illumos-utils/src/zone.rs:325
10782024-11-20T02:16:58.397ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd file = illumos-utils/src/zone.rs:325
10792024-11-20T02:16:58.403ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c file = illumos-utils/src/zone.rs:325
10802024-11-20T02:16:58.408ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8 file = illumos-utils/src/zone.rs:325
10812024-11-20T02:16:58.412ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898 file = illumos-utils/src/zone.rs:325
10822024-11-20T02:16:58.417ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76 file = illumos-utils/src/zone.rs:325
10832024-11-20T02:16:58.529ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4 file = illumos-utils/src/zone.rs:363
10842024-11-20T02:16:58.534ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab file = illumos-utils/src/zone.rs:363
10852024-11-20T02:16:58.538ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26 file = illumos-utils/src/zone.rs:363
10862024-11-20T02:16:58.542ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd file = illumos-utils/src/zone.rs:363
10872024-11-20T02:16:58.546ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c file = illumos-utils/src/zone.rs:363
10882024-11-20T02:16:58.550ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8 file = illumos-utils/src/zone.rs:363
10892024-11-20T02:16:58.555ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898 file = illumos-utils/src/zone.rs:363
10902024-11-20T02:16:58.560ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76 file = illumos-utils/src/zone.rs:363
10912024-11-20T02:16:58.564ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3 file = illumos-utils/src/zone.rs:325
10922024-11-20T02:16:58.570ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61 file = illumos-utils/src/zone.rs:325
10932024-11-20T02:16:58.575ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9 file = illumos-utils/src/zone.rs:325
10942024-11-20T02:16:58.580ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01 file = illumos-utils/src/zone.rs:325
10952024-11-20T02:16:58.585ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea file = illumos-utils/src/zone.rs:325
10962024-11-20T02:16:58.591ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079 file = illumos-utils/src/zone.rs:325
10972024-11-20T02:16:58.598ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3 file = illumos-utils/src/zone.rs:363
10982024-11-20T02:16:58.606ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61 file = illumos-utils/src/zone.rs:363
10992024-11-20T02:16:58.613ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9 file = illumos-utils/src/zone.rs:363
11002024-11-20T02:16:58.619ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01 file = illumos-utils/src/zone.rs:363
11012024-11-20T02:16:58.626ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea file = illumos-utils/src/zone.rs:363
11022024-11-20T02:16:58.635ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079 file = illumos-utils/src/zone.rs:363
11032024-11-20T02:16:58.702ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11042024-11-20T02:16:58.766ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11052024-11-20T02:16:58.826ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11062024-11-20T02:16:58.887ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11072024-11-20T02:16:58.889ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11082024-11-20T02:16:58.889ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11092024-11-20T02:16:58.952ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 174, 8]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11102024-11-20T02:16:58.952ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
11112024-11-20T02:16:58.954ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11122024-11-20T02:16:58.954ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11132024-11-20T02:16:59.015ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 191, 76]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11142024-11-20T02:16:59.015ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
11152024-11-20T02:16:59.074ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11162024-11-20T02:16:59.076ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11172024-11-20T02:16:59.076ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11182024-11-20T02:16:59.134ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 154, 176]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11192024-11-20T02:16:59.134ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
11202024-11-20T02:16:59.134ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11212024-11-20T02:16:59.134ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11222024-11-20T02:16:59.134ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11232024-11-20T02:16:59.134ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11242024-11-20T02:16:59.136ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11252024-11-20T02:16:59.136ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11262024-11-20T02:16:59.191ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 187, 62]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11272024-11-20T02:16:59.191ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
11282024-11-20T02:16:59.193ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11292024-11-20T02:16:59.193ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11302024-11-20T02:16:59.246ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 233, 239]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11312024-11-20T02:16:59.246ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
11322024-11-20T02:16:59.247ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11332024-11-20T02:16:59.248ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11342024-11-20T02:16:59.250ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11352024-11-20T02:16:59.250ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11362024-11-20T02:16:59.337ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11372024-11-20T02:16:59.337ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11382024-11-20T02:16:59.337ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11392024-11-20T02:16:59.338ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11402024-11-20T02:16:59.338ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c file = illumos-utils/src/zone.rs:325
11412024-11-20T02:16:59.355ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11422024-11-20T02:16:59.355ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11432024-11-20T02:16:59.355ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11442024-11-20T02:16:59.359ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11452024-11-20T02:16:59.362ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11462024-11-20T02:16:59.362ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11472024-11-20T02:16:59.362ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11482024-11-20T02:16:59.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11492024-11-20T02:16:59.507ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c file = illumos-utils/src/zone.rs:363
11502024-11-20T02:16:59.520ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369 file = illumos-utils/src/zone.rs:325
11512024-11-20T02:16:59.608ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f file = illumos-utils/src/zone.rs:325
11522024-11-20T02:16:59.629ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015 file = illumos-utils/src/zone.rs:325
11532024-11-20T02:16:59.655ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369 file = illumos-utils/src/zone.rs:363
11542024-11-20T02:16:59.691ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c file = illumos-utils/src/zone.rs:325
11552024-11-20T02:16:59.725ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f file = illumos-utils/src/zone.rs:363
11562024-11-20T02:16:59.772ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015 file = illumos-utils/src/zone.rs:363
11572024-11-20T02:16:59.801ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c file = illumos-utils/src/zone.rs:363
11582024-11-20T02:17:02.571ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11592024-11-20T02:17:02.622ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11602024-11-20T02:17:02.622ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
11612024-11-20T02:17:02.632ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
11622024-11-20T02:17:02.647ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='23b321f2-82f7-4311-8409-1b9ce6a97ca9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11632024-11-20T02:17:02.647ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
11642024-11-20T02:17:02.660ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f6692952-d869-40ca-9812-5bbbbca8b7b7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11652024-11-20T02:17:02.660ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='41ecc0e4-ec0f-484f-8436-93d3371d52eb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11662024-11-20T02:17:02.660ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
11672024-11-20T02:17:02.675ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
11682024-11-20T02:17:02.697ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e2e7807e-52cd-4aaa-9bfd-3c05c3ae5403'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11692024-11-20T02:17:02.697ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c3ffb491-44f8-461a-b167-f433bd8c5c2e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11702024-11-20T02:17:02.698ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_98cd316b-55e2-4c2d-813f-e4caae970d59/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3d8fa646-b165-42a6-9932-e0df6587acf4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11712024-11-20T02:17:02.699ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
11722024-11-20T02:17:02.731ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
11732024-11-20T02:17:02.763ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
11742024-11-20T02:17:02.867ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_841052f1-d4ff-4743-9006-a66dddb621f3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e0299b82-e135-4974-9fde-aa076f4dd260'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11752024-11-20T02:17:02.870ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
11762024-11-20T02:17:05.388ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1dc7380e-30cc-4307-9e35-47aecaecd3fb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11772024-11-20T02:17:05.529ZINFOSledAgent (ServiceManager): Booting oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
11782024-11-20T02:17:05.745ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9529683f-e460-4948-a032-9f2d5e49707f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0ae676c8-03a1-4a31-87dd-200a4bae4c41'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11792024-11-20T02:17:05.748ZINFOSledAgent (ServiceManager): Booting oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
11802024-11-20T02:17:06.095ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11812024-11-20T02:17:06.096ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
11822024-11-20T02:17:06.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 44.651253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
11832024-11-20T02:17:06.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 37.668943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
11842024-11-20T02:17:06.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 57.220468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
11852024-11-20T02:17:06.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 69.389275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
11862024-11-20T02:17:06.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 31.763065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
11872024-11-20T02:17:06.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 53.464794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
11882024-11-20T02:17:06.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 132.976896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
11892024-11-20T02:17:07.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 80.527302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
11902024-11-20T02:17:07.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 71.466552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
11912024-11-20T02:17:07.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 60.513392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
11922024-11-20T02:17:07.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 100.655053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
11932024-11-20T02:17:07.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 59.233977ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
11942024-11-20T02:17:07.114ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='eb5a339f-68aa-43dd-a9e0-5a593d764f76'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11952024-11-20T02:17:07.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 117.655463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
11962024-11-20T02:17:07.132ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11972024-11-20T02:17:07.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 111.393653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
11982024-11-20T02:17:07.152ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11992024-11-20T02:17:07.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 50.741774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
12002024-11-20T02:17:07.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 29.268564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
12012024-11-20T02:17:07.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 59.061048ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
12022024-11-20T02:17:07.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 120.841128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
12032024-11-20T02:17:07.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 120.544858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
12042024-11-20T02:17:07.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 216.286919ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
12052024-11-20T02:17:07.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 149.509352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
12062024-11-20T02:17:07.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 89.827849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
12072024-11-20T02:17:07.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 219.285872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
12082024-11-20T02:17:07.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 119.238103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
12092024-11-20T02:17:07.313ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
12102024-11-20T02:17:07.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 215.907227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
12112024-11-20T02:17:07.348ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
12122024-11-20T02:17:07.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 196.151408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
12132024-11-20T02:17:07.421ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
12142024-11-20T02:17:07.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 95.773358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
12152024-11-20T02:17:07.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 90.490864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
12162024-11-20T02:17:07.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 67.150218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
12172024-11-20T02:17:07.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 188.688811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
12182024-11-20T02:17:07.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 513.624423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
12192024-11-20T02:17:07.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 368.86047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
12202024-11-20T02:17:07.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 122.868021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
12212024-11-20T02:17:07.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 235.233722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
12222024-11-20T02:17:07.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 489.627116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
12232024-11-20T02:17:07.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 232.390943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
12242024-11-20T02:17:07.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 276.218741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
12252024-11-20T02:17:07.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 152.926978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
12262024-11-20T02:17:07.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 285.461292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
12272024-11-20T02:17:07.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 106.197122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
12282024-11-20T02:17:07.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 44.460777ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
12292024-11-20T02:17:07.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 336.05522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
12302024-11-20T02:17:07.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 73.849458ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
12312024-11-20T02:17:07.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 69.62349ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
12322024-11-20T02:17:07.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 360.155388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
12332024-11-20T02:17:07.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 70.452678ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
12342024-11-20T02:17:07.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 270.015711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
12352024-11-20T02:17:07.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 119.98274ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
12362024-11-20T02:17:07.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 333.607379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
12372024-11-20T02:17:07.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 438.656838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
12382024-11-20T02:17:07.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 205.74531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
12392024-11-20T02:17:07.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 281.404381ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
12402024-11-20T02:17:07.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 418.867382ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
12412024-11-20T02:17:07.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 108.187182ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
12422024-11-20T02:17:08.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 588.234215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
12432024-11-20T02:17:08.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 758.252402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
12442024-11-20T02:17:08.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 1.108200012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
12452024-11-20T02:17:08.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 703.839251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
12462024-11-20T02:17:08.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 906.051812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
12472024-11-20T02:17:08.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 769.695392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
12482024-11-20T02:17:08.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 618.421609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
12492024-11-20T02:17:08.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 293.149884ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
12502024-11-20T02:17:08.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 1.153596834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
12512024-11-20T02:17:08.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 194.150037ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
12522024-11-20T02:17:08.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 229.57054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
12532024-11-20T02:17:08.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 804.102393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
12542024-11-20T02:17:08.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 369.23586ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
12552024-11-20T02:17:08.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 681.141749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
12562024-11-20T02:17:08.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 1.425093427s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
12572024-11-20T02:17:08.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 294.898733ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
12582024-11-20T02:17:08.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 488.293622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
12592024-11-20T02:17:08.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 299.554409ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
12602024-11-20T02:17:08.581ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12612024-11-20T02:17:08.581ZINFOSledAgent (ServiceManager): Booting oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
12622024-11-20T02:17:08.590ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12632024-11-20T02:17:08.591ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
12642024-11-20T02:17:08.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 460.305183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
12652024-11-20T02:17:08.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 667.647919ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
12662024-11-20T02:17:08.642ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12672024-11-20T02:17:08.642ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
12682024-11-20T02:17:08.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 739.184674ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
12692024-11-20T02:17:08.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 1.061236054s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
12702024-11-20T02:17:08.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 1.000692738s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
12712024-11-20T02:17:08.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 856.574713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
12722024-11-20T02:17:08.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 828.383294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
12732024-11-20T02:17:08.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 42.533878ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
12742024-11-20T02:17:08.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 61.352895ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
12752024-11-20T02:17:08.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 558.024673ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
12762024-11-20T02:17:08.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 54.853607ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
12772024-11-20T02:17:08.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 62.618858ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
12782024-11-20T02:17:08.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 67.136586ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
12792024-11-20T02:17:09.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 1.092654853s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
12802024-11-20T02:17:09.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 165.979199ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
12812024-11-20T02:17:09.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 115.21623ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
12822024-11-20T02:17:09.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 748.968602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
12832024-11-20T02:17:09.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 1.481633383s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
12842024-11-20T02:17:09.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 122.719567ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
12852024-11-20T02:17:09.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 865.799683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
12862024-11-20T02:17:09.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 965.194571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
12872024-11-20T02:17:09.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 891.805284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
12882024-11-20T02:17:09.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 432.136636ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
12892024-11-20T02:17:09.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 206.864799ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
12902024-11-20T02:17:09.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 608.405323ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
12912024-11-20T02:17:09.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 195.101141ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
12922024-11-20T02:17:09.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 1.271783528s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
12932024-11-20T02:17:09.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 803.90797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
12942024-11-20T02:17:09.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 1.00957102s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
12952024-11-20T02:17:09.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 611.295255ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
12962024-11-20T02:17:09.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 530.775649ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
12972024-11-20T02:17:09.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 1.492372195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
12982024-11-20T02:17:09.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 1.141704067s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
12992024-11-20T02:17:09.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.176405987s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
13002024-11-20T02:17:09.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 891.124654ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
13012024-11-20T02:17:09.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 1.068781353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
13022024-11-20T02:17:09.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 536.01815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
13032024-11-20T02:17:09.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 901.376955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
13042024-11-20T02:17:09.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 1.155176768s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
13052024-11-20T02:17:10.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 1.194762429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
13062024-11-20T02:17:10.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 985.417615ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
13072024-11-20T02:17:10.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 810.291548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
13082024-11-20T02:17:10.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 1.038492222s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
13092024-11-20T02:17:10.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 661.382651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
13102024-11-20T02:17:10.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 1.315998856s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
13112024-11-20T02:17:10.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 624.312541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
13122024-11-20T02:17:10.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 683.504994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
13132024-11-20T02:17:10.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 1.466609634s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
13142024-11-20T02:17:10.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 617.499823ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
13152024-11-20T02:17:10.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 732.182244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
13162024-11-20T02:17:10.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 1.451623977s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
13172024-11-20T02:17:10.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 1.178390529s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
13182024-11-20T02:17:10.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 548.08629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
13192024-11-20T02:17:10.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 926.828125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
13202024-11-20T02:17:10.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.022147943s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
13212024-11-20T02:17:10.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 1.136443409s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
13222024-11-20T02:17:10.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 1.103781132s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
13232024-11-20T02:17:11.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 766.209171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
13242024-11-20T02:17:11.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 854.464709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
13252024-11-20T02:17:11.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 840.350978ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
13262024-11-20T02:17:11.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 627.856454ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
13272024-11-20T02:17:11.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 1.494076175s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
13282024-11-20T02:17:11.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 1.052135996s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
13292024-11-20T02:17:11.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 542.36148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
13302024-11-20T02:17:11.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 933.48696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
13312024-11-20T02:17:11.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 838.084809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
13322024-11-20T02:17:11.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 1.122876055s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
13332024-11-20T02:17:11.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 1.498724919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
13342024-11-20T02:17:11.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 1.46293619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
13352024-11-20T02:17:11.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 668.32509ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
13362024-11-20T02:17:11.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 1.332474714s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
13372024-11-20T02:17:11.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 941.829735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
13382024-11-20T02:17:11.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.142931345s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
13392024-11-20T02:17:11.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 1.392867009s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
13402024-11-20T02:17:12.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 770.013588ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
13412024-11-20T02:17:12.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 937.733996ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
13422024-11-20T02:17:12.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 645.975863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
13432024-11-20T02:17:12.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 728.732491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
13442024-11-20T02:17:12.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 1.31318676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
13452024-11-20T02:17:12.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 713.704103ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
13462024-11-20T02:17:12.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 623.017595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
13472024-11-20T02:17:12.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 676.957897ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
13482024-11-20T02:17:12.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 1.025204034s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
13492024-11-20T02:17:12.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 1.374659058s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
13502024-11-20T02:17:12.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 1.011880837s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
13512024-11-20T02:17:12.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 576.476163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
13522024-11-20T02:17:12.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 910.952526ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
13532024-11-20T02:17:12.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 602.617024ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
13542024-11-20T02:17:12.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 743.921874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
13552024-11-20T02:17:12.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 905.370558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
13562024-11-20T02:17:12.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 939.418628ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
13572024-11-20T02:17:12.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 670.937637ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
13582024-11-20T02:17:12.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 524.123532ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
13592024-11-20T02:17:12.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 1.133123342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
13602024-11-20T02:17:13.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 1.200443621s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
13612024-11-20T02:17:13.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.00613898s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
13622024-11-20T02:17:13.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 686.325355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
13632024-11-20T02:17:13.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 581.741233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
13642024-11-20T02:17:13.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 794.662522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
13652024-11-20T02:17:13.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 715.351417ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
13662024-11-20T02:17:13.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 1.372453947s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
13672024-11-20T02:17:13.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 1.472849645s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
13682024-11-20T02:17:13.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 870.847402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
13692024-11-20T02:17:13.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 809.483072ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
13702024-11-20T02:17:13.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 1.459039591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
13712024-11-20T02:17:13.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 1.237483466s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
13722024-11-20T02:17:13.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 697.82777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
13732024-11-20T02:17:13.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 1.249166622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
13742024-11-20T02:17:13.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 1.12488123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
13752024-11-20T02:17:13.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 525.670537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
13762024-11-20T02:17:13.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 892.647014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
13772024-11-20T02:17:13.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 608.102011ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
13782024-11-20T02:17:13.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 1.314370281s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
13792024-11-20T02:17:14.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 529.886765ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
13802024-11-20T02:17:14.105ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13812024-11-20T02:17:14.105ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
13822024-11-20T02:17:14.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 847.582933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
13832024-11-20T02:17:14.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.195587972s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
13842024-11-20T02:17:14.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 1.360003653s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
13852024-11-20T02:17:14.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 1.247062715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
13862024-11-20T02:17:14.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 765.925346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
13872024-11-20T02:17:14.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 1.330345719s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
13882024-11-20T02:17:14.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 847.674969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
13892024-11-20T02:17:14.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 42.388516ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
13902024-11-20T02:17:14.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 1.033929104s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
13912024-11-20T02:17:14.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 99.695016ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
13922024-11-20T02:17:14.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 1.217686927s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
13932024-11-20T02:17:14.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 177.539217ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
13942024-11-20T02:17:14.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 1.491451362s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
13952024-11-20T02:17:14.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 497.732914ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
13962024-11-20T02:17:14.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 887.050149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
13972024-11-20T02:17:14.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 1.361480407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
13982024-11-20T02:17:14.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 1.470745211s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
13992024-11-20T02:17:14.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 651.343675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
14002024-11-20T02:17:14.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 1.030803353s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
14012024-11-20T02:17:14.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 905.895431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
14022024-11-20T02:17:14.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 1.484752066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
14032024-11-20T02:17:15.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 1.375977752s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
14042024-11-20T02:17:15.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 1.473419872s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
14052024-11-20T02:17:15.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 823.319864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
14062024-11-20T02:17:15.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 829.441355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
14072024-11-20T02:17:15.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 763.077404ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
14082024-11-20T02:17:15.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.477069046s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
14092024-11-20T02:17:15.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 939.987992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
14102024-11-20T02:17:15.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 674.919899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
14112024-11-20T02:17:15.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 757.286657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
14122024-11-20T02:17:15.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 862.43523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
14132024-11-20T02:17:15.722ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.199227499s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
14142024-11-20T02:17:15.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 1.225782536s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
14152024-11-20T02:17:15.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 514.948848ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
14162024-11-20T02:17:15.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 1.244998568s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
14172024-11-20T02:17:15.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 1.355885821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
14182024-11-20T02:17:15.912ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44157
14192024-11-20T02:17:15.964ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10740 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44157 req_id = e2608e63-62e9-4e27-995a-4b0a6164f3c7 response_code = 200 uri = /baseboard
14202024-11-20T02:17:15.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 953.710957ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
14212024-11-20T02:17:16.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 1.409538324s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
14222024-11-20T02:17:16.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 1.244574551s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
14232024-11-20T02:17:16.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 1.18944658s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
14242024-11-20T02:17:16.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 811.526437ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
14252024-11-20T02:17:16.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 1.467277127s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
14262024-11-20T02:17:16.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 953.580612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
14272024-11-20T02:17:16.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 878.519328ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
14282024-11-20T02:17:16.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 1.326360347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
14292024-11-20T02:17:16.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 1.130053044s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
14302024-11-20T02:17:16.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 999.994466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
14312024-11-20T02:17:16.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 1.021973103s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
14322024-11-20T02:17:16.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 976.284769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
14332024-11-20T02:17:16.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 560.386675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
14342024-11-20T02:17:16.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 1.219510157s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
14352024-11-20T02:17:16.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.068281676s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
14362024-11-20T02:17:16.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 1.076461284s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
14372024-11-20T02:17:16.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 553.644435ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
14382024-11-20T02:17:16.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 1.01551459s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
14392024-11-20T02:17:17.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 1.489923069s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
14402024-11-20T02:17:17.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 853.467405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
14412024-11-20T02:17:17.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 1.339535571s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
14422024-11-20T02:17:17.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 1.108658168s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
14432024-11-20T02:17:17.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 1.038296393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
14442024-11-20T02:17:17.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 746.544018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
14452024-11-20T02:17:17.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 665.359967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
14462024-11-20T02:17:17.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 1.462985629s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
14472024-11-20T02:17:17.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 1.407379334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
14482024-11-20T02:17:17.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 1.059482327s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
14492024-11-20T02:17:17.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 954.692167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
14502024-11-20T02:17:17.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 1.453877365s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
14512024-11-20T02:17:17.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 1.314752741s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
14522024-11-20T02:17:17.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 679.122581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
14532024-11-20T02:17:17.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 699.18178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
14542024-11-20T02:17:17.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 1.412769878s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
14552024-11-20T02:17:17.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 842.651558ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
14562024-11-20T02:17:17.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 1.40269452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
14572024-11-20T02:17:17.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 1.463066229s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
14582024-11-20T02:17:18.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 1.291504434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
14592024-11-20T02:17:18.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 802.269591ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
14602024-11-20T02:17:18.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 1.022590735s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
14612024-11-20T02:17:18.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 570.090766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
14622024-11-20T02:17:18.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 805.721089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
14632024-11-20T02:17:18.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 1.148186411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
14642024-11-20T02:17:18.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 785.034843ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
14652024-11-20T02:17:18.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 1.014950527s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
14662024-11-20T02:17:18.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 1.039894897s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
14672024-11-20T02:17:18.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 948.141543ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
14682024-11-20T02:17:18.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 679.011437ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
14692024-11-20T02:17:18.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.284905243s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
14702024-11-20T02:17:18.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 688.771736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
14712024-11-20T02:17:18.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 1.063284946s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
14722024-11-20T02:17:18.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 1.209225354s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
14732024-11-20T02:17:18.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 931.647041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
14742024-11-20T02:17:18.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 1.31410703s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
14752024-11-20T02:17:18.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 924.344095ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
14762024-11-20T02:17:19.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 603.448644ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
14772024-11-20T02:17:19.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 892.704179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
14782024-11-20T02:17:19.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 654.191297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
14792024-11-20T02:17:19.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 1.337391475s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
14802024-11-20T02:17:19.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 845.747782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
14812024-11-20T02:17:19.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 965.492189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
14822024-11-20T02:17:19.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 540.014392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
14832024-11-20T02:17:19.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 1.41999938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
14842024-11-20T02:17:19.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 534.133073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
14852024-11-20T02:17:19.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 1.222407051s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
14862024-11-20T02:17:19.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 810.059484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
14872024-11-20T02:17:19.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 821.691954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
14882024-11-20T02:17:19.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 1.200423456s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
14892024-11-20T02:17:19.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 744.994183ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
14902024-11-20T02:17:19.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 1.224454823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
14912024-11-20T02:17:19.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 502.839165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
14922024-11-20T02:17:19.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 1.082214878s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
14932024-11-20T02:17:19.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 1.252780185s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
14942024-11-20T02:17:19.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 1.485747216s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
14952024-11-20T02:17:20.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 1.023330196s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
14962024-11-20T02:17:20.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 603.852854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
14972024-11-20T02:17:20.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.12792274s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
14982024-11-20T02:17:20.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 1.284473636s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
14992024-11-20T02:17:20.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 556.600416ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
15002024-11-20T02:17:20.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 1.245354794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
15012024-11-20T02:17:20.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 1.18146302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
15022024-11-20T02:17:20.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 819.625668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
15032024-11-20T02:17:20.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 737.605677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
15042024-11-20T02:17:20.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 1.271527776s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
15052024-11-20T02:17:20.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 1.06263466s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
15062024-11-20T02:17:20.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 753.898579ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
15072024-11-20T02:17:20.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 1.409223421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
15082024-11-20T02:17:20.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 986.422742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
15092024-11-20T02:17:20.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 1.497729226s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
15102024-11-20T02:17:20.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 1.185564379s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
15112024-11-20T02:17:20.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 1.385386731s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
15122024-11-20T02:17:20.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 1.327926758s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
15132024-11-20T02:17:21.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 1.447924701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
15142024-11-20T02:17:21.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 1.040689874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
15152024-11-20T02:17:21.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 1.006034068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
15162024-11-20T02:17:21.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 880.181115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
15172024-11-20T02:17:21.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 1.077461418s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
15182024-11-20T02:17:21.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.232586891s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
15192024-11-20T02:17:21.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 549.711603ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
15202024-11-20T02:17:21.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 1.134712196s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
15212024-11-20T02:17:21.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 1.353862027s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
15222024-11-20T02:17:21.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 922.265147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
15232024-11-20T02:17:21.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 1.147582279s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
15242024-11-20T02:17:21.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 1.130300523s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
15252024-11-20T02:17:21.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 1.008311496s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
15262024-11-20T02:17:21.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 801.241687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
15272024-11-20T02:17:21.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 890.339467ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
15282024-11-20T02:17:21.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 933.595382ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
15292024-11-20T02:17:22.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 646.401246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
15302024-11-20T02:17:22.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4") failed: Property not found. retry in 1.485237141s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
15312024-11-20T02:17:22.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 1.068991981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
15322024-11-20T02:17:22.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 678.334161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
15332024-11-20T02:17:22.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 760.225883ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
15342024-11-20T02:17:22.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd") failed: Property not found. retry in 1.394251904s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
15352024-11-20T02:17:22.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 518.423836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
15362024-11-20T02:17:22.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c") failed: Property not found. retry in 1.101572381s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
15372024-11-20T02:17:22.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab") failed: Property not found. retry in 1.314260438s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
15382024-11-20T02:17:22.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.361866814s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
15392024-11-20T02:17:22.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 615.512583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
15402024-11-20T02:17:22.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 848.309903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
15412024-11-20T02:17:22.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 1.157263429s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
15422024-11-20T02:17:22.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01") failed: Property not found. retry in 761.612459ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
15432024-11-20T02:17:22.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 920.978172ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
15442024-11-20T02:17:22.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079") failed: Property not found. retry in 1.188509157s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
15452024-11-20T02:17:22.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 731.492357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
15462024-11-20T02:17:22.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26") failed: Property not found. retry in 1.268416851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
15472024-11-20T02:17:22.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c") failed: Property not found. retry in 1.291712542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
15482024-11-20T02:17:22.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 1.308767078s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
15492024-11-20T02:17:22.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8") failed: Property not found. retry in 681.109105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
15502024-11-20T02:17:22.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015") failed: Property not found. retry in 821.109728ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
15512024-11-20T02:17:22.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 665.138539ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
15522024-11-20T02:17:23.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3") failed: Property not found. retry in 1.301463957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
15532024-11-20T02:17:23.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea") failed: Property not found. retry in 1.457365532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
15542024-11-20T02:17:23.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61") failed: Property not found. retry in 1.484117411s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
15552024-11-20T02:17:23.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898") failed: Property not found. retry in 1.456240092s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
15562024-11-20T02:17:23.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 885.45725ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
15572024-11-20T02:17:23.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76") failed: Property not found. retry in 922.069631ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
15582024-11-20T02:17:23.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c") failed: Property not found. retry in 1.297360315s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
15592024-11-20T02:17:23.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 959.337086ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
15602024-11-20T02:17:24.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 1.090049802s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
15612024-11-20T02:17:24.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f") failed: Property not found. retry in 1.168120994s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
15622024-11-20T02:17:24.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369") failed: Property not found. retry in 1.478593952s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
15632024-11-20T02:17:25.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 660.514364ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
15642024-11-20T02:17:25.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 901.16235ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
15652024-11-20T02:17:26.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 1.067482007s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
15662024-11-20T02:17:27.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9") failed: Property not found. retry in 1.39430423s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
15672024-11-20T02:17:29.343ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.960786766s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
15682024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_d0b5d715-6efd-440d-92e8-06e32eca8da4
15692024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_1b0321a7-e87f-4d37-98f5-c9bde7249e7c
15702024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_c85c19d7-e1ed-418c-891f-6c69a7a89369
15712024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_6832d082-1326-4b84-97c9-53ab1b5d8dab
15722024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_d7d0afaa-f05f-403e-8c7f-aead8555cc26
15732024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_c407b09f-09c8-430e-9a61-4fb15c3e6fdd
15742024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_b9a9b29d-785e-4aae-9919-4d8c788c2f0c
15752024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_9c1ce14e-4e8c-4569-8039-146f3f31e8d8
15762024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_89c4ff8b-3317-4bfc-aeb9-014f92aa8898
15772024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_oximeter_eb5a339f-68aa-43dd-a9e0-5a593d764f76
15782024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_2203f339-df1d-4375-adc7-aa6d4752eac3
15792024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_66a399b7-22f3-4a37-9012-cc8bfd88683c
15802024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_4585f7b5-dbc1-4a10-8096-3ca4a94d621f
15812024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_ac4b94cc-51ea-4477-841d-bace5b843d61
15822024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_9fe4351b-e265-4106-87d1-05131cb21015
15832024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_clickhouse_d8fff464-debf-49cf-bde9-6039821151f9
15842024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_0b0a556e-8c01-4c2b-8174-5878f8f49b01
15852024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_85fc546d-cf74-47d0-bea3-7488929604ea
15862024-11-20T02:17:29.357ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_7cd111c8-3a43-44ad-a778-9cdd26757079
15872024-11-20T02:17:29.372ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
15882024-11-20T02:17:29.376ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json"
15892024-11-20T02:17:29.376ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
15902024-11-20T02:17:29.382ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json"
15912024-11-20T02:17:29.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31412876 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55317 req_id = 74ad3a1a-9ede-4e56-924d-626e6dfdc10d response_code = 204 uri = /omicron-zones
15922024-11-20T02:17:29.415ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
15932024-11-20T02:17:29.415ZINFOSledAgent (RSS): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
15942024-11-20T02:17:29.415ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/rss-plan-completed.marker"
15952024-11-20T02:17:29.415ZINFOSledAgent (RSS): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
15962024-11-20T02:17:29.415ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/rss-plan-completed.marker"
15972024-11-20T02:17:29.430ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
15982024-11-20T02:17:29.437ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
15992024-11-20T02:17:29.472ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
16002024-11-20T02:17:29.490ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16012024-11-20T02:17:29.554ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16022024-11-20T02:17:29.700ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16032024-11-20T02:17:29.907ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16042024-11-20T02:17:30.046ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16052024-11-20T02:17:30.233ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16062024-11-20T02:17:30.380ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16072024-11-20T02:17:30.574ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16082024-11-20T02:17:30.887ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16092024-11-20T02:17:31.421ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16102024-11-20T02:17:32.090ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16112024-11-20T02:17:32.572ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16122024-11-20T02:17:33.540ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16132024-11-20T02:17:34.260ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3e1f377b-e332-48a3-82de-d4509c330a4f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16142024-11-20T02:17:35.684ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "dea6476f-e1dd-4048-9129-d58c9db6e8bc", "content-length": "173", "date": "Wed, 20 Nov 2024 02:17:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"3e1f377b-e332-48a3-82de-d4509c330a4f\"", request_id: "dea6476f-e1dd-4048-9129-d58c9db6e8bc" } file = sled-agent/src/rack_setup/service.rs:1075
16152024-11-20T02:17:37.054ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "add0a6de-cd90-44b1-a633-5411f17339cb", "content-length": "173", "date": "Wed, 20 Nov 2024 02:17:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"3e1f377b-e332-48a3-82de-d4509c330a4f\"", request_id: "add0a6de-cd90-44b1-a633-5411f17339cb" } file = sled-agent/src/rack_setup/service.rs:1075
16162024-11-20T02:17:39.708ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "de2d83ff-f81a-4a0b-bd7e-ae1b48475a8a", "content-length": "173", "date": "Wed, 20 Nov 2024 02:17:39 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"52b4024d-59d8-46f0-844c-2d14ce62d55b\"", request_id: "de2d83ff-f81a-4a0b-bd7e-ae1b48475a8a" } file = sled-agent/src/rack_setup/service.rs:1075
16172024-11-20T02:17:41.168ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "abb128a3-930c-46e2-9c4b-9d8418eb14fa", "content-length": "173", "date": "Wed, 20 Nov 2024 02:17:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"52b4024d-59d8-46f0-844c-2d14ce62d55b\"", request_id: "abb128a3-930c-46e2-9c4b-9d8418eb14fa" } file = sled-agent/src/rack_setup/service.rs:1075
16182024-11-20T02:17:43.736ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2f5bee93-ea16-4076-a6d8-91c3f908f204", "content-length": "173", "date": "Wed, 20 Nov 2024 02:17:43 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"52b4024d-59d8-46f0-844c-2d14ce62d55b\"", request_id: "2f5bee93-ea16-4076-a6d8-91c3f908f204" } file = sled-agent/src/rack_setup/service.rs:1075
16192024-11-20T02:17:46.005ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54980
16202024-11-20T02:17:46.006ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54980 req_id = f09a9209-0f05-4965-b3cc-790669210fde response_code = 200 uri = /baseboard
16212024-11-20T02:17:46.204ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "20402e3a-9cde-4f4e-b868-157f96ab1333", "content-length": "173", "date": "Wed, 20 Nov 2024 02:17:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"52b4024d-59d8-46f0-844c-2d14ce62d55b\"", request_id: "20402e3a-9cde-4f4e-b868-157f96ab1333" } file = sled-agent/src/rack_setup/service.rs:1075
16222024-11-20T02:17:50.989ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "face126e-5824-4432-8f6b-70535ecc332e", "content-length": "173", "date": "Wed, 20 Nov 2024 02:17:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"52b4024d-59d8-46f0-844c-2d14ce62d55b\"", request_id: "face126e-5824-4432-8f6b-70535ecc332e" } file = sled-agent/src/rack_setup/service.rs:1075
16232024-11-20T02:17:53.899ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "818e1baa-5562-4a49-bddd-fe0751d88b71", "content-length": "173", "date": "Wed, 20 Nov 2024 02:17:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"52b4024d-59d8-46f0-844c-2d14ce62d55b\"", request_id: "818e1baa-5562-4a49-bddd-fe0751d88b71" } file = sled-agent/src/rack_setup/service.rs:1075
16242024-11-20T02:17:54.491ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:48622 remote_addr = [fd00:1122:3344:101::d]:50983 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
16252024-11-20T02:17:54.521ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28733 local_addr = [fd00:1122:3344:101::1]:48622 method = GET remote_addr = [fd00:1122:3344:101::d]:50983 req_id = 9d43b287-9b03-482b-baff-7a73b5aea3b3 response_code = 200 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b uri = /52b4024d-59d8-46f0-844c-2d14ce62d55b
16262024-11-20T02:18:00.558ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "00e2114d-9c2e-44a9-9435-85c45d057f90", "content-length": "173", "date": "Wed, 20 Nov 2024 02:18:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"52b4024d-59d8-46f0-844c-2d14ce62d55b\"", request_id: "00e2114d-9c2e-44a9-9435-85c45d057f90" } file = sled-agent/src/rack_setup/service.rs:1075
16272024-11-20T02:18:08.611ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "58982f6b-b14f-4b9c-8c4c-d066727feb68", "content-length": "173", "date": "Wed, 20 Nov 2024 02:18:08 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"52b4024d-59d8-46f0-844c-2d14ce62d55b\"", request_id: "58982f6b-b14f-4b9c-8c4c-d066727feb68" } file = sled-agent/src/rack_setup/service.rs:1075
16282024-11-20T02:18:13.168ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
16292024-11-20T02:18:13.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50021
16302024-11-20T02:18:13.264ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16312024-11-20T02:18:13.264ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16322024-11-20T02:18:13.264ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json file = common/src/ledger.rs:178
16332024-11-20T02:18:13.269ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json file = common/src/ledger.rs:178
16342024-11-20T02:18:13.281ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16352024-11-20T02:18:13.281ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17
16362024-11-20T02:18:13.302ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16372024-11-20T02:18:13.302ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4
16382024-11-20T02:18:13.322ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16392024-11-20T02:18:13.322ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc
16402024-11-20T02:18:13.343ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16412024-11-20T02:18:13.343ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_98cd316b-55e2-4c2d-813f-e4caae970d59
16422024-11-20T02:18:13.361ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16432024-11-20T02:18:13.361ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_841052f1-d4ff-4743-9006-a66dddb621f3
16442024-11-20T02:18:13.381ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16452024-11-20T02:18:13.381ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_9529683f-e460-4948-a032-9f2d5e49707f
16462024-11-20T02:18:13.400ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16472024-11-20T02:18:13.400ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30
16482024-11-20T02:18:13.419ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16492024-11-20T02:18:13.419ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83
16502024-11-20T02:18:13.437ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16512024-11-20T02:18:13.437ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6
16522024-11-20T02:18:13.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50021 req_id = a830541f-5a7a-413d-a8aa-864795646995 response_code = 200 uri = /inventory
16532024-11-20T02:18:16.054ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52604
16542024-11-20T02:18:16.054ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52604 req_id = 4ade71a2-40c3-43c5-b035-976ba0f25aa5 response_code = 200 uri = /baseboard
16552024-11-20T02:18:19.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46561
16562024-11-20T02:18:19.162ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16572024-11-20T02:18:19.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16582024-11-20T02:18:19.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16592024-11-20T02:18:19.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16602024-11-20T02:18:19.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16612024-11-20T02:18:19.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16622024-11-20T02:18:19.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16632024-11-20T02:18:19.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5555 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46561 req_id = 1ba36c60-234d-4f20-bb03-b46c5cd7d801 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16642024-11-20T02:18:19.165ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
16652024-11-20T02:18:19.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33683
16662024-11-20T02:18:19.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16672024-11-20T02:18:19.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16682024-11-20T02:18:19.496ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json file = common/src/ledger.rs:178
16692024-11-20T02:18:19.496ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json file = common/src/ledger.rs:178
16702024-11-20T02:18:19.508ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16712024-11-20T02:18:19.508ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17
16722024-11-20T02:18:19.533ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16732024-11-20T02:18:19.533ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4
16742024-11-20T02:18:19.554ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16752024-11-20T02:18:19.554ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc
16762024-11-20T02:18:19.574ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16772024-11-20T02:18:19.574ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_98cd316b-55e2-4c2d-813f-e4caae970d59
16782024-11-20T02:18:19.593ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16792024-11-20T02:18:19.593ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_841052f1-d4ff-4743-9006-a66dddb621f3
16802024-11-20T02:18:19.611ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16812024-11-20T02:18:19.611ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_9529683f-e460-4948-a032-9f2d5e49707f
16822024-11-20T02:18:19.630ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16832024-11-20T02:18:19.630ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30
16842024-11-20T02:18:19.648ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16852024-11-20T02:18:19.648ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83
16862024-11-20T02:18:19.666ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16872024-11-20T02:18:19.666ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6
16882024-11-20T02:18:19.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180736 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33683 req_id = 5fe31cc9-b5c4-4aa7-986c-ac502b796b95 response_code = 200 uri = /inventory
16892024-11-20T02:18:19.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47331
16902024-11-20T02:18:19.919ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16912024-11-20T02:18:19.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16922024-11-20T02:18:19.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16932024-11-20T02:18:19.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16942024-11-20T02:18:19.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16952024-11-20T02:18:19.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16962024-11-20T02:18:19.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16972024-11-20T02:18:19.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47331 req_id = e801f6fa-3f50-433c-856b-3343c3676827 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16982024-11-20T02:18:20.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41983
16992024-11-20T02:18:20.104ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17002024-11-20T02:18:20.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17012024-11-20T02:18:20.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17022024-11-20T02:18:20.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17032024-11-20T02:18:20.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17042024-11-20T02:18:20.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17052024-11-20T02:18:20.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17062024-11-20T02:18:20.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 398 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41983 req_id = 3ecc42ee-cd8a-43c2-a4b8-2379a5391660 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17072024-11-20T02:18:20.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32972
17082024-11-20T02:18:20.831ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17092024-11-20T02:18:20.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17102024-11-20T02:18:20.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17112024-11-20T02:18:20.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17122024-11-20T02:18:20.832ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17132024-11-20T02:18:20.832ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17142024-11-20T02:18:20.832ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17152024-11-20T02:18:20.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32972 req_id = 712a1534-c0ca-4e61-a854-51b57e5796eb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17162024-11-20T02:18:25.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37233
17172024-11-20T02:18:25.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 680 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37233 req_id = 2fe59db6-fbdb-425c-8045-371e8eefd9fa response_code = 200 uri = /vpc-routes
17182024-11-20T02:18:25.324ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
17192024-11-20T02:18:25.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37233 req_id = b77a6142-12aa-4cca-a09d-d837bff72f1a response_code = 204 uri = /eip-gateways
17202024-11-20T02:18:25.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2742 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37233 req_id = 53401d38-139a-4888-8ae1-0b5a7c522331 response_code = 204 uri = /vpc-routes
17212024-11-20T02:18:38.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40109
17222024-11-20T02:18:38.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40109 req_id = 8a350d23-34ce-43e3-9ee5-4556df74f2cd response_code = 200 uri = /vpc-routes
17232024-11-20T02:18:38.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34013
17242024-11-20T02:18:38.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34013 req_id = 078210b3-b810-4189-9476-b1fb2c75c4ea response_code = 200 uri = /vpc-routes
17252024-11-20T02:18:38.686ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
17262024-11-20T02:18:38.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40109 req_id = a9ba348a-0c1a-4f37-b95d-e1455e4dd91d response_code = 204 uri = /eip-gateways
17272024-11-20T02:18:38.700ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
17282024-11-20T02:18:38.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34013 req_id = 25fe5da6-7488-413c-9ca1-ef7aa5a90539 response_code = 204 uri = /eip-gateways
17292024-11-20T02:18:38.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40109 req_id = 8e91e542-d637-4cb0-a512-d4d4b89cd014 response_code = 204 uri = /vpc-routes
17302024-11-20T02:18:38.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37978
17312024-11-20T02:18:38.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 537 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37978 req_id = 03c510b0-e122-4fb4-840f-0defaf99a99b response_code = 200 uri = /v2p
17322024-11-20T02:18:38.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34013 req_id = 1eb446b7-dfbc-4b39-8abf-cad9f8531eca response_code = 204 uri = /vpc-routes
17332024-11-20T02:18:38.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35025
17342024-11-20T02:18:38.872ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
17352024-11-20T02:18:38.966ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
17362024-11-20T02:18:39.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35025 req_id = 364da110-7169-49dd-b111-faa2c055af02 response_code = 204 uri = /switch-ports
17372024-11-20T02:18:39.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57113
17382024-11-20T02:18:39.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40063
17392024-11-20T02:18:39.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61922
17402024-11-20T02:18:39.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40063 req_id = 563740f0-a22b-42ff-83db-30257d4ad412 response_code = 200 uri = /vpc-routes
17412024-11-20T02:18:39.036ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
17422024-11-20T02:18:39.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57113 req_id = 6a6c3015-1715-412c-a536-ebd9bba259b3 response_code = 200 uri = /v2p
17432024-11-20T02:18:39.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35025 req_id = 836f2383-4628-4ee0-94c8-924d4c37ac81 response_code = 200 uri = /network-bootstore-config
17442024-11-20T02:18:39.076ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17452024-11-20T02:18:39.076ZINFOSledAgent (bootstore): Writing ledger to /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
17462024-11-20T02:18:39.077ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
17472024-11-20T02:18:39.077ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
17482024-11-20T02:18:39.078ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
17492024-11-20T02:18:39.078ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17502024-11-20T02:18:39.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4830 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35025 req_id = f9a8b9b0-4a84-4ecf-bca0-9639cd40fce9 response_code = 204 uri = /network-bootstore-config
17512024-11-20T02:18:39.084ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
17522024-11-20T02:18:39.088ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
17532024-11-20T02:18:39.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 704 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40063 req_id = 249e9651-dd23-43fd-b01e-78388162a562 response_code = 204 uri = /eip-gateways
17542024-11-20T02:18:39.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57353
17552024-11-20T02:18:39.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57353 req_id = 7a04ee82-f55a-4562-a7b7-970905069fb9 response_code = 200 uri = /v2p
17562024-11-20T02:18:39.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40063 req_id = f71feabb-4bc8-4fb7-8fc4-3c2b4895da1a response_code = 204 uri = /vpc-routes
17572024-11-20T02:18:39.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113217 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61922 req_id = fb64f277-78da-4931-a8fa-6eb5a35e66a6 response_code = 204 uri = /switch-ports
17582024-11-20T02:18:39.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61922 req_id = 08020bfd-8605-4261-8165-f84915eb13be response_code = 200 uri = /network-bootstore-config
17592024-11-20T02:18:39.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62426
17602024-11-20T02:18:39.226ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
17612024-11-20T02:18:39.261ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
17622024-11-20T02:18:39.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90648 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62426 req_id = 0b619bea-a77b-4ffe-8bc9-1cc82c196cfe response_code = 204 uri = /switch-ports
17632024-11-20T02:18:39.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62426 req_id = e911a684-824f-4ee2-b653-dbb53bf6b607 response_code = 200 uri = /network-bootstore-config
17642024-11-20T02:18:46.088ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56767
17652024-11-20T02:18:46.089ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56767 req_id = c82de94d-39cd-40fd-9692-90377e9d556f response_code = 200 uri = /baseboard
17662024-11-20T02:19:08.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60730
17672024-11-20T02:19:08.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60730 req_id = 78a72dc7-f587-4e1d-ab71-f4ed0d01829c response_code = 200 uri = /vpc-routes
17682024-11-20T02:19:08.546ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
17692024-11-20T02:19:08.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60730 req_id = 39e013cf-8c09-4744-8d88-2b822735c1c7 response_code = 204 uri = /eip-gateways
17702024-11-20T02:19:08.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60730 req_id = 9d5d1092-afdd-4653-bf3e-2f46528ae6d9 response_code = 204 uri = /vpc-routes
17712024-11-20T02:19:08.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64692
17722024-11-20T02:19:08.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64692 req_id = eebbf312-57f2-4b17-823f-ffed843d39d7 response_code = 200 uri = /vpc-routes
17732024-11-20T02:19:08.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61973
17742024-11-20T02:19:08.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61973 req_id = a78b0c99-9338-43bc-b96a-e333b5aba797 response_code = 200 uri = /v2p
17752024-11-20T02:19:08.600ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
17762024-11-20T02:19:08.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64692 req_id = ac43a6c7-6d63-4639-a215-09460506153c response_code = 204 uri = /eip-gateways
17772024-11-20T02:19:08.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64692 req_id = 01385246-1129-4e13-a2af-9dc3e9a34d58 response_code = 204 uri = /vpc-routes
17782024-11-20T02:19:08.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56653
17792024-11-20T02:19:08.711ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
17802024-11-20T02:19:08.750ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
17812024-11-20T02:19:08.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94808 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56653 req_id = d2874aed-7529-4e85-b70f-bd0f864249f0 response_code = 204 uri = /switch-ports
17822024-11-20T02:19:08.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35622
17832024-11-20T02:19:08.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56462
17842024-11-20T02:19:08.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56462 req_id = a392429b-ae95-4109-9284-cb607d1fb0c2 response_code = 200 uri = /v2p
17852024-11-20T02:19:08.806ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
17862024-11-20T02:19:08.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56653 req_id = 37e662ea-27d0-4c5d-92d9-74a3354d2514 response_code = 200 uri = /network-bootstore-config
17872024-11-20T02:19:08.840ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
17882024-11-20T02:19:08.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34821
17892024-11-20T02:19:08.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34821 req_id = 63724e19-f951-4f21-ae7a-fbcab6544bf3 response_code = 200 uri = /vpc-routes
17902024-11-20T02:19:08.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49063
17912024-11-20T02:19:08.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 395 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49063 req_id = efd4dd35-edc4-4299-adfb-6490274ed8cc response_code = 200 uri = /v2p
17922024-11-20T02:19:08.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90203 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35622 req_id = 5321b17a-87a2-4311-995f-de6daf36cbf4 response_code = 204 uri = /switch-ports
17932024-11-20T02:19:08.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35622 req_id = bc2a2c50-dd35-4461-b236-bbd3bf34acd7 response_code = 200 uri = /network-bootstore-config
17942024-11-20T02:19:08.899ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
17952024-11-20T02:19:08.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34821 req_id = 4b60e4ba-e7d0-499c-83e3-bfc86d61867d response_code = 204 uri = /eip-gateways
17962024-11-20T02:19:08.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34821 req_id = 2f586929-f132-4672-9245-c46330a3a943 response_code = 204 uri = /vpc-routes
17972024-11-20T02:19:08.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65483
17982024-11-20T02:19:08.956ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
17992024-11-20T02:19:08.990ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18002024-11-20T02:19:09.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89068 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65483 req_id = 9106485e-d534-48ad-b784-6bb95b38c9ea response_code = 204 uri = /switch-ports
18012024-11-20T02:19:09.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65483 req_id = 33fc32b0-d62b-4c30-a02f-b646a582ed93 response_code = 200 uri = /network-bootstore-config
18022024-11-20T02:19:16.121ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62340
18032024-11-20T02:19:16.121ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62340 req_id = 166bb05d-7004-482a-ae54-bfbda6f6a84a response_code = 200 uri = /baseboard
18042024-11-20T02:19:38.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55285
18052024-11-20T02:19:38.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55285 req_id = 61177e10-561c-43e3-aa00-e48e213c7941 response_code = 200 uri = /vpc-routes
18062024-11-20T02:19:38.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57955
18072024-11-20T02:19:38.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57955 req_id = c6b4e3b0-4dd3-48d2-b824-32b7fc5a0a9f response_code = 200 uri = /vpc-routes
18082024-11-20T02:19:38.736ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
18092024-11-20T02:19:38.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55285 req_id = 78e1a4b6-2f44-482b-bdf0-9e9d31e40a07 response_code = 204 uri = /eip-gateways
18102024-11-20T02:19:38.744ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
18112024-11-20T02:19:38.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57955 req_id = b3f76c81-6de5-4d0e-8634-5e4e2849be3d response_code = 204 uri = /eip-gateways
18122024-11-20T02:19:38.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57955 req_id = 55e82245-9476-4d25-ab93-c55d3e79fd30 response_code = 204 uri = /vpc-routes
18132024-11-20T02:19:38.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60369
18142024-11-20T02:19:38.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60369 req_id = 3636c8cb-2ef7-4a8a-93a0-3b5e395ec209 response_code = 200 uri = /v2p
18152024-11-20T02:19:38.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57328
18162024-11-20T02:19:38.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57328 req_id = 8fc30fe3-c123-4981-80ae-2e4ae6f02b54 response_code = 200 uri = /vpc-routes
18172024-11-20T02:19:38.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54847
18182024-11-20T02:19:38.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54847 req_id = 27266956-c2b9-4536-818e-61a760fd6eb3 response_code = 200 uri = /v2p
18192024-11-20T02:19:38.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55285 req_id = bcdbb91e-fad9-48fc-af40-e34b43d7453d response_code = 204 uri = /vpc-routes
18202024-11-20T02:19:38.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63132
18212024-11-20T02:19:38.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18222024-11-20T02:19:38.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18232024-11-20T02:19:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90035 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63132 req_id = 716f9353-3a22-4a2c-badd-97225a03e230 response_code = 204 uri = /switch-ports
18242024-11-20T02:19:39.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
18252024-11-20T02:19:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57328 req_id = c4878ee3-2820-423b-93c1-444e1a7f7490 response_code = 204 uri = /eip-gateways
18262024-11-20T02:19:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63132 req_id = f1e22468-c25b-4adf-bc29-77e5269c193f response_code = 200 uri = /network-bootstore-config
18272024-11-20T02:19:39.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57328 req_id = fa2ec183-3f9e-4d6e-8a01-e14b5d59d8db response_code = 204 uri = /vpc-routes
18282024-11-20T02:19:39.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63524
18292024-11-20T02:19:39.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63524 req_id = a80a6ff5-e921-4c46-a4ce-75437e5f6140 response_code = 200 uri = /v2p
18302024-11-20T02:19:39.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47899
18312024-11-20T02:19:39.070ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18322024-11-20T02:19:39.110ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18332024-11-20T02:19:39.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62909
18342024-11-20T02:19:39.155ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18352024-11-20T02:19:39.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85034 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47899 req_id = b50ce6a8-61d2-4407-85ef-85a587b2f6a1 response_code = 204 uri = /switch-ports
18362024-11-20T02:19:39.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47899 req_id = 3b90189d-e10e-4cde-91cb-bf4fa818238c response_code = 200 uri = /network-bootstore-config
18372024-11-20T02:19:39.185ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18382024-11-20T02:19:39.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108552 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62909 req_id = b2d40ddc-2ce1-4d24-ad12-a0ded9ce6c8c response_code = 204 uri = /switch-ports
18392024-11-20T02:19:39.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62909 req_id = 8b56ddf5-b0c0-4060-9fcb-a4f075d3c28b response_code = 200 uri = /network-bootstore-config
18402024-11-20T02:19:46.154ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63140
18412024-11-20T02:19:46.154ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63140 req_id = fbf0bd73-a7c1-486f-97f1-2298e2356ff3 response_code = 200 uri = /baseboard
18422024-11-20T02:20:08.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43487
18432024-11-20T02:20:08.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43487 req_id = 61eb8505-e2fd-4e93-af8c-1aafbe28a250 response_code = 200 uri = /vpc-routes
18442024-11-20T02:20:08.543ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
18452024-11-20T02:20:08.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43487 req_id = 21da34ff-db87-4335-a244-053723dfb4d8 response_code = 204 uri = /eip-gateways
18462024-11-20T02:20:08.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49458
18472024-11-20T02:20:08.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49458 req_id = ff8105fe-e4b7-4dea-98e8-d26dbae8c25c response_code = 200 uri = /v2p
18482024-11-20T02:20:08.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43487 req_id = 0fcac326-df6f-4f1e-81a5-cc4e00568ea1 response_code = 204 uri = /vpc-routes
18492024-11-20T02:20:08.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61235
18502024-11-20T02:20:08.634ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18512024-11-20T02:20:08.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18522024-11-20T02:20:08.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114164 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61235 req_id = 10413167-f44a-4fc2-8e8c-ffddcc25ad2e response_code = 204 uri = /switch-ports
18532024-11-20T02:20:08.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39407
18542024-11-20T02:20:08.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61235 req_id = 6ef1ff6e-8686-453f-8357-d980abaadcd7 response_code = 200 uri = /network-bootstore-config
18552024-11-20T02:20:08.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39407 req_id = 5013113e-926c-46b3-a4f2-89d1fa0d459f response_code = 200 uri = /vpc-routes
18562024-11-20T02:20:08.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38787
18572024-11-20T02:20:08.749ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18582024-11-20T02:20:08.789ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18592024-11-20T02:20:08.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94779 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38787 req_id = 2920299c-d7cb-4d81-955d-616e516cd1dd response_code = 204 uri = /switch-ports
18602024-11-20T02:20:08.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34301
18612024-11-20T02:20:08.844ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
18622024-11-20T02:20:08.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52789
18632024-11-20T02:20:08.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39407 req_id = d812be6b-66be-4efa-aeca-38e273df1729 response_code = 204 uri = /eip-gateways
18642024-11-20T02:20:08.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4798 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34301 req_id = 1dd158e7-8641-43ce-a21f-47744dfdc4dc response_code = 200 uri = /v2p
18652024-11-20T02:20:08.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4897 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38787 req_id = 0ef5556e-f0ff-4027-ae5a-5cc8f66413dc response_code = 200 uri = /network-bootstore-config
18662024-11-20T02:20:08.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52789 req_id = 6d7d1bcb-8875-4581-9922-5e9e97c81824 response_code = 200 uri = /vpc-routes
18672024-11-20T02:20:08.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39407 req_id = cbd4bf5b-e3f9-4b1c-a3a4-085061628fd1 response_code = 204 uri = /vpc-routes
18682024-11-20T02:20:08.873ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
18692024-11-20T02:20:08.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52789 req_id = c4ad6be4-64b4-4360-b474-f2642346652f response_code = 204 uri = /eip-gateways
18702024-11-20T02:20:08.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52789 req_id = 85425f13-82c4-4f52-8e57-13e326df407c response_code = 204 uri = /vpc-routes
18712024-11-20T02:20:08.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49703
18722024-11-20T02:20:08.931ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18732024-11-20T02:20:08.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18742024-11-20T02:20:09.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49703 req_id = 42565f16-e378-42a9-8f69-a7dd9a684449 response_code = 204 uri = /switch-ports
18752024-11-20T02:20:09.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48829
18762024-11-20T02:20:09.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48829 req_id = 968faf46-0f5d-46f9-9fd7-a930070a6b1d response_code = 200 uri = /v2p
18772024-11-20T02:20:09.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49703 req_id = dee1a535-c4e5-42ea-bbcb-79204e280ab1 response_code = 200 uri = /network-bootstore-config
18782024-11-20T02:20:16.186ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33732
18792024-11-20T02:20:16.187ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33732 req_id = fbe97094-d250-46b2-8f6c-b0369c5045bf response_code = 200 uri = /baseboard
18802024-11-20T02:20:38.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64407
18812024-11-20T02:20:38.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64407 req_id = 82beb44c-0418-4615-b77e-ae38f4fbcd96 response_code = 200 uri = /vpc-routes
18822024-11-20T02:20:38.646ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
18832024-11-20T02:20:38.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64407 req_id = 395fb00a-a810-43e3-947f-3d4901b838b5 response_code = 204 uri = /eip-gateways
18842024-11-20T02:20:38.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39904
18852024-11-20T02:20:38.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39904 req_id = 9356746a-3494-4960-bc6b-cb54c20ad948 response_code = 200 uri = /vpc-routes
18862024-11-20T02:20:38.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42714
18872024-11-20T02:20:38.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42714 req_id = 3bbce7f5-7f4b-45bb-9c7d-0a18bfff3f85 response_code = 200 uri = /v2p
18882024-11-20T02:20:38.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64407 req_id = 2cf5f0ef-3bba-4005-a85c-b3a9cbd8cca2 response_code = 204 uri = /vpc-routes
18892024-11-20T02:20:38.871ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
18902024-11-20T02:20:38.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39904 req_id = 404dd160-414e-482b-9d76-2aa52feb477e response_code = 204 uri = /eip-gateways
18912024-11-20T02:20:38.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39904 req_id = 11bc4ba7-49e2-4670-8d74-a85e749e22fd response_code = 204 uri = /vpc-routes
18922024-11-20T02:20:38.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45606
18932024-11-20T02:20:38.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45606 req_id = dbb4308b-17dc-4461-a279-4fe6a8d70bf5 response_code = 200 uri = /v2p
18942024-11-20T02:20:38.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49624
18952024-11-20T02:20:38.913ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18962024-11-20T02:20:38.950ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18972024-11-20T02:20:39.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49624 req_id = 6823ce00-b010-4d57-8247-69a215c5c0f2 response_code = 204 uri = /switch-ports
18982024-11-20T02:20:39.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44290
18992024-11-20T02:20:39.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54033
19002024-11-20T02:20:39.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19012024-11-20T02:20:39.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49624 req_id = 2706ee86-8b0d-46ea-93ce-78bd6c6bf32f response_code = 200 uri = /network-bootstore-config
19022024-11-20T02:20:39.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54033 req_id = 8c41d3a8-7e72-4297-bb07-484961fd06c4 response_code = 200 uri = /vpc-routes
19032024-11-20T02:20:39.017ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19042024-11-20T02:20:39.054ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19052024-11-20T02:20:39.064ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
19062024-11-20T02:20:39.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54033 req_id = 42de2804-a88b-4fbe-86bf-57d7ad401e43 response_code = 204 uri = /eip-gateways
19072024-11-20T02:20:39.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 946 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54033 req_id = bcd4a96b-d1c7-4bf9-8674-b90d04c3e161 response_code = 204 uri = /vpc-routes
19082024-11-20T02:20:39.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44290 req_id = dd0d3e30-08e5-4f72-b8d9-0c7d9ded4d30 response_code = 204 uri = /switch-ports
19092024-11-20T02:20:39.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44290 req_id = bb5d7268-ba98-4640-88e8-c221d52b69ce response_code = 200 uri = /network-bootstore-config
19102024-11-20T02:20:39.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55978
19112024-11-20T02:20:39.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55978 req_id = 4c03493a-fd21-4118-8a5a-07829ce98dc9 response_code = 200 uri = /v2p
19122024-11-20T02:20:39.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56739
19132024-11-20T02:20:39.275ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19142024-11-20T02:20:39.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19152024-11-20T02:20:39.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84379 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56739 req_id = 4608b751-f9ee-436c-8ca4-a95d330c4cf1 response_code = 204 uri = /switch-ports
19162024-11-20T02:20:39.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56739 req_id = 1072e65b-5b99-4dea-a5f5-658ee23f4ebd response_code = 200 uri = /network-bootstore-config
19172024-11-20T02:20:46.224ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54306
19182024-11-20T02:20:46.224ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54306 req_id = 19fc8392-2104-4541-9b7c-f869954c8ae2 response_code = 200 uri = /baseboard
19192024-11-20T02:21:08.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37914
19202024-11-20T02:21:08.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37914 req_id = 7cd456b2-67ca-421f-9d80-99d39b393ccb response_code = 200 uri = /vpc-routes
19212024-11-20T02:21:08.595ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
19222024-11-20T02:21:08.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37914 req_id = 91013bf9-c16f-4b8a-9bd1-97560c662303 response_code = 204 uri = /eip-gateways
19232024-11-20T02:21:08.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50507
19242024-11-20T02:21:08.598ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19252024-11-20T02:21:08.636ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19262024-11-20T02:21:08.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120561 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50507 req_id = 9ba8eba8-f29b-40c4-b276-fefaf059d3d6 response_code = 204 uri = /switch-ports
19272024-11-20T02:21:08.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39999
19282024-11-20T02:21:08.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47501
19292024-11-20T02:21:08.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39999 req_id = a62afc2b-f721-46eb-b0d0-722892d16c77 response_code = 200 uri = /vpc-routes
19302024-11-20T02:21:08.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50507 req_id = 6a6f1fd8-6930-4742-92e6-5d2f52854c0f response_code = 200 uri = /network-bootstore-config
19312024-11-20T02:21:08.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47501 req_id = b6910111-63c2-4c05-93e3-7b0fd1b52beb response_code = 200 uri = /v2p
19322024-11-20T02:21:08.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 572 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37914 req_id = fcf811e5-34c4-4cc4-82c5-f9390ed34c60 response_code = 204 uri = /vpc-routes
19332024-11-20T02:21:08.736ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
19342024-11-20T02:21:08.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39999 req_id = 62bd2274-ff24-4877-93d3-3f8258491602 response_code = 204 uri = /eip-gateways
19352024-11-20T02:21:08.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48211
19362024-11-20T02:21:08.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48211 req_id = 3f8a77ef-116e-47ce-83ce-fea13313d21d response_code = 200 uri = /v2p
19372024-11-20T02:21:08.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39999 req_id = dedb9897-3c4e-4be0-88e6-d32b0b720076 response_code = 204 uri = /vpc-routes
19382024-11-20T02:21:08.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43601
19392024-11-20T02:21:08.776ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19402024-11-20T02:21:08.811ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19412024-11-20T02:21:08.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91159 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43601 req_id = 1f606821-cc58-41b1-8daa-d5eebe7df716 response_code = 204 uri = /switch-ports
19422024-11-20T02:21:08.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34902
19432024-11-20T02:21:08.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34902 req_id = 6106b37a-5eeb-4085-8390-ceef2ff97fe6 response_code = 200 uri = /vpc-routes
19442024-11-20T02:21:08.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43601 req_id = 5773eadf-89ef-46c9-9952-21093777c6be response_code = 200 uri = /network-bootstore-config
19452024-11-20T02:21:08.911ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
19462024-11-20T02:21:08.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34902 req_id = 8246def4-d294-4c70-9b59-6e8235f113f2 response_code = 204 uri = /eip-gateways
19472024-11-20T02:21:08.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34902 req_id = d2cf016d-eae0-40da-8bb3-0138038b5e8e response_code = 204 uri = /vpc-routes
19482024-11-20T02:21:08.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65322
19492024-11-20T02:21:08.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65322 req_id = 83682f7f-1f3b-4f31-9c93-6e207ea56b72 response_code = 200 uri = /v2p
19502024-11-20T02:21:08.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33897
19512024-11-20T02:21:08.940ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19522024-11-20T02:21:08.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19532024-11-20T02:21:09.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91224 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33897 req_id = 34b5d324-215c-4c84-b435-bfd23448ae66 response_code = 204 uri = /switch-ports
19542024-11-20T02:21:09.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33897 req_id = a50daee4-98a8-4b61-88d7-fc6e3b4cca9f response_code = 200 uri = /network-bootstore-config
19552024-11-20T02:21:16.258ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58619
19562024-11-20T02:21:16.258ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58619 req_id = 55582e86-f90d-4f2a-96b2-9e29658793b3 response_code = 200 uri = /baseboard
19572024-11-20T02:21:38.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54595
19582024-11-20T02:21:38.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54595 req_id = 4519b3a7-e095-4717-a5f6-e2fb063ba746 response_code = 200 uri = /vpc-routes
19592024-11-20T02:21:38.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64363
19602024-11-20T02:21:38.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64363 req_id = 59c8f06d-b216-4a0f-aa5e-158790a7a241 response_code = 200 uri = /vpc-routes
19612024-11-20T02:21:38.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
19622024-11-20T02:21:38.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54595 req_id = 526de413-565e-4f23-a771-ba1e5e651469 response_code = 204 uri = /eip-gateways
19632024-11-20T02:21:38.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54595 req_id = fdbe99a7-1498-45e1-b8f8-d1d6ba7d8b03 response_code = 204 uri = /vpc-routes
19642024-11-20T02:21:38.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
19652024-11-20T02:21:38.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64363 req_id = 6d2c051b-2261-4350-b658-070e7ea07bdc response_code = 204 uri = /eip-gateways
19662024-11-20T02:21:38.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64363 req_id = a2c5fd3f-132a-4f60-9265-15a683da726f response_code = 204 uri = /vpc-routes
19672024-11-20T02:21:38.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59988
19682024-11-20T02:21:38.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59988 req_id = dba00a69-f728-42ef-a649-5647d6dca521 response_code = 200 uri = /v2p
19692024-11-20T02:21:38.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36411
19702024-11-20T02:21:38.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36411 req_id = 79b37396-4139-4a10-b942-586f7ce7d408 response_code = 200 uri = /v2p
19712024-11-20T02:21:38.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56613
19722024-11-20T02:21:38.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19732024-11-20T02:21:38.959ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19742024-11-20T02:21:39.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88380 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56613 req_id = da382f2f-addd-4e87-9b80-ea5a367b9a5c response_code = 204 uri = /switch-ports
19752024-11-20T02:21:39.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45453
19762024-11-20T02:21:39.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19772024-11-20T02:21:39.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4696 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56613 req_id = af829d88-4971-4a2c-a5e8-6b1658bacd29 response_code = 200 uri = /network-bootstore-config
19782024-11-20T02:21:39.044ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19792024-11-20T02:21:39.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45453 req_id = cc445965-bfba-4b8c-9564-d60b4dd143c9 response_code = 204 uri = /switch-ports
19802024-11-20T02:21:39.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45453 req_id = 1c789f2c-8e78-4580-ae22-4a641f432ca9 response_code = 200 uri = /network-bootstore-config
19812024-11-20T02:21:39.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40738
19822024-11-20T02:21:39.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40738 req_id = ea2d4f0e-3d35-4c4b-b584-bb53e8b4dacc response_code = 200 uri = /vpc-routes
19832024-11-20T02:21:39.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
19842024-11-20T02:21:39.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40738 req_id = 6026d02e-0d37-465f-9a72-f14f2609944d response_code = 204 uri = /eip-gateways
19852024-11-20T02:21:39.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40738 req_id = 3128df3b-8e60-460e-a778-f6a1c34f9e0b response_code = 204 uri = /vpc-routes
19862024-11-20T02:21:39.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39220
19872024-11-20T02:21:39.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39220 req_id = 376447d7-1149-415d-842e-ba504e486fbe response_code = 200 uri = /v2p
19882024-11-20T02:21:39.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39003
19892024-11-20T02:21:39.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19902024-11-20T02:21:39.241ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19912024-11-20T02:21:39.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82848 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39003 req_id = 281fe4cf-eaa9-466d-9214-a7b02bd08cb1 response_code = 204 uri = /switch-ports
19922024-11-20T02:21:39.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39003 req_id = 9382b924-c444-4d3e-983c-32901d87c9df response_code = 200 uri = /network-bootstore-config
19932024-11-20T02:21:46.291ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58938
19942024-11-20T02:21:46.292ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58938 req_id = 5a4506e2-59e3-4c72-81da-3a9d97c789ea response_code = 200 uri = /baseboard
19952024-11-20T02:22:08.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54149
19962024-11-20T02:22:08.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54149 req_id = 6304239e-dc62-4ed6-adb5-76649c944c1f response_code = 200 uri = /vpc-routes
19972024-11-20T02:22:08.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52199
19982024-11-20T02:22:08.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52199 req_id = 9459f02e-b609-436e-9819-e372e85afb6a response_code = 200 uri = /vpc-routes
19992024-11-20T02:22:08.602ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
20002024-11-20T02:22:08.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54149 req_id = b7b8ce0a-85ca-475a-97de-b85fedb5eb41 response_code = 204 uri = /eip-gateways
20012024-11-20T02:22:08.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42618
20022024-11-20T02:22:08.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42618 req_id = 2c609e0d-b0e9-4772-8b95-075c09ec8407 response_code = 200 uri = /v2p
20032024-11-20T02:22:08.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54149 req_id = 48af266b-32c2-43eb-95e1-2224393bd7ca response_code = 204 uri = /vpc-routes
20042024-11-20T02:22:08.618ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
20052024-11-20T02:22:08.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52199 req_id = 1da6e55a-b425-4eec-bfbd-f961d094d168 response_code = 204 uri = /eip-gateways
20062024-11-20T02:22:08.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52199 req_id = 4faae35c-8023-4108-94bb-bd5aa51884b1 response_code = 204 uri = /vpc-routes
20072024-11-20T02:22:08.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38090
20082024-11-20T02:22:08.643ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20092024-11-20T02:22:08.697ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20102024-11-20T02:22:08.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122195 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38090 req_id = 7fb59040-d34d-41bf-97e2-deea685a713e response_code = 204 uri = /switch-ports
20112024-11-20T02:22:08.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48363
20122024-11-20T02:22:08.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42517
20132024-11-20T02:22:08.765ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20142024-11-20T02:22:08.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3923 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48363 req_id = c4789401-7229-4bbd-8e8d-e48209ca819d response_code = 200 uri = /v2p
20152024-11-20T02:22:08.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4332 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38090 req_id = 2d741a68-7503-4088-848d-0e9cedc4d83f response_code = 200 uri = /network-bootstore-config
20162024-11-20T02:22:08.799ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20172024-11-20T02:22:08.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34601
20182024-11-20T02:22:08.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34601 req_id = 8ac5e4e7-7d25-4931-a676-83a05dc0607b response_code = 200 uri = /vpc-routes
20192024-11-20T02:22:08.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86167 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42517 req_id = f6aabbe0-8526-4b6c-8f47-07fbcbd43023 response_code = 204 uri = /switch-ports
20202024-11-20T02:22:08.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42517 req_id = b569f4cd-0f58-4940-a644-1909da636041 response_code = 200 uri = /network-bootstore-config
20212024-11-20T02:22:08.879ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
20222024-11-20T02:22:08.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34601 req_id = 81c05744-827b-4f11-8836-17da9e7ff63d response_code = 204 uri = /eip-gateways
20232024-11-20T02:22:08.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34601 req_id = 3446bb4a-27e0-4d41-81ed-c4abc490071b response_code = 204 uri = /vpc-routes
20242024-11-20T02:22:08.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39556
20252024-11-20T02:22:08.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39556 req_id = aa5b2c7d-c621-45a5-9484-ef35dbab51b2 response_code = 200 uri = /v2p
20262024-11-20T02:22:08.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49395
20272024-11-20T02:22:08.923ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20282024-11-20T02:22:08.958ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20292024-11-20T02:22:09.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85352 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49395 req_id = 00157a6f-615f-4ab5-b02b-c19e1f9e5c82 response_code = 204 uri = /switch-ports
20302024-11-20T02:22:09.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49395 req_id = eff41133-c58c-4752-8a27-2b0ae644c1c5 response_code = 200 uri = /network-bootstore-config
20312024-11-20T02:22:16.324ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60548
20322024-11-20T02:22:16.324ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60548 req_id = b9d2add3-7f09-4354-90e0-97eec85b811a response_code = 200 uri = /baseboard
20332024-11-20T02:22:38.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43902
20342024-11-20T02:22:38.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43902 req_id = fe260063-c791-465b-acd9-8254b65c3830 response_code = 200 uri = /vpc-routes
20352024-11-20T02:22:38.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
20362024-11-20T02:22:38.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43902 req_id = 91755613-bfe7-427d-81f4-8976edabc1a0 response_code = 204 uri = /eip-gateways
20372024-11-20T02:22:38.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56299
20382024-11-20T02:22:38.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56299 req_id = 91cb778e-a26a-4d3a-998c-dd116e08024c response_code = 200 uri = /vpc-routes
20392024-11-20T02:22:38.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43902 req_id = 280efe47-c5ed-4d65-b7bb-f2ee2bff6130 response_code = 204 uri = /vpc-routes
20402024-11-20T02:22:38.795ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
20412024-11-20T02:22:38.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56299 req_id = af9ea344-ece2-478c-9147-b7d450bef9bc response_code = 204 uri = /eip-gateways
20422024-11-20T02:22:38.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56299 req_id = 1f55ec36-710c-495d-bf16-cfe0c61cadb4 response_code = 204 uri = /vpc-routes
20432024-11-20T02:22:38.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37929
20442024-11-20T02:22:38.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37929 req_id = 65471eb5-9834-46ff-8edd-0c493cfa3169 response_code = 200 uri = /v2p
20452024-11-20T02:22:38.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61158
20462024-11-20T02:22:38.918ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20472024-11-20T02:22:38.960ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20482024-11-20T02:22:39.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106400 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61158 req_id = 5416c9c7-de4f-4e97-a0b3-adae86d7a636 response_code = 204 uri = /switch-ports
20492024-11-20T02:22:39.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59100
20502024-11-20T02:22:39.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57688
20512024-11-20T02:22:39.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45792
20522024-11-20T02:22:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45792 req_id = 622d1fd4-51d4-4c9b-a385-d7d7d6db53e7 response_code = 200 uri = /v2p
20532024-11-20T02:22:39.025ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20542024-11-20T02:22:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57688 req_id = 6fc103c6-d122-42cb-b370-3a7ca8b7a18f response_code = 200 uri = /vpc-routes
20552024-11-20T02:22:39.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 374 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61158 req_id = 5fbc0096-f703-47f8-a944-d08511743f7c response_code = 200 uri = /network-bootstore-config
20562024-11-20T02:22:39.067ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20572024-11-20T02:22:39.075ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
20582024-11-20T02:22:39.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57688 req_id = 35fee125-c2a3-4335-9adf-4f66c5f02249 response_code = 204 uri = /eip-gateways
20592024-11-20T02:22:39.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55272
20602024-11-20T02:22:39.077ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20612024-11-20T02:22:39.077ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20622024-11-20T02:22:39.077ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20632024-11-20T02:22:39.077ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20642024-11-20T02:22:39.078ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20652024-11-20T02:22:39.078ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20662024-11-20T02:22:39.078ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20672024-11-20T02:22:39.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55272 req_id = ac515125-0b8c-4a04-8499-5d291cff4f5a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20682024-11-20T02:22:39.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105798 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59100 req_id = 10e034b4-19d1-456a-b157-7a823d31d78e response_code = 204 uri = /switch-ports
20692024-11-20T02:22:39.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59100 req_id = 09ca897a-4fb3-4c1c-910d-1bdc708ad424 response_code = 200 uri = /network-bootstore-config
20702024-11-20T02:22:39.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49354
20712024-11-20T02:22:39.135ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20722024-11-20T02:22:39.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20732024-11-20T02:22:39.136ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20742024-11-20T02:22:39.136ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20752024-11-20T02:22:39.136ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20762024-11-20T02:22:39.136ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20772024-11-20T02:22:39.136ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20782024-11-20T02:22:39.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49354 req_id = 860e85d5-f19f-4783-a323-abd7a618fb29 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20792024-11-20T02:22:39.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38329
20802024-11-20T02:22:39.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38329 req_id = 54d47ff0-1f83-450f-80b0-8c0fa8182e40 response_code = 200 uri = /v2p
20812024-11-20T02:22:39.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57688 req_id = 6b33dcd8-36b3-419e-bbf9-85f18a27c971 response_code = 204 uri = /vpc-routes
20822024-11-20T02:22:39.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62717
20832024-11-20T02:22:39.175ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20842024-11-20T02:22:39.208ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20852024-11-20T02:22:39.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85368 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62717 req_id = 96fc5efa-2354-47ac-9b44-952c4e34d731 response_code = 204 uri = /switch-ports
20862024-11-20T02:22:39.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54021
20872024-11-20T02:22:39.260ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20882024-11-20T02:22:39.260ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20892024-11-20T02:22:39.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62717 req_id = 75a275ba-cfea-4d6b-a145-5c442cf32ae7 response_code = 200 uri = /network-bootstore-config
20902024-11-20T02:22:39.261ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20912024-11-20T02:22:39.261ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20922024-11-20T02:22:39.261ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20932024-11-20T02:22:39.261ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20942024-11-20T02:22:39.261ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20952024-11-20T02:22:39.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 436 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54021 req_id = 3eb02345-ffb7-4e48-8984-d665670d24cb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20962024-11-20T02:22:46.358ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40213
20972024-11-20T02:22:46.359ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40213 req_id = cd587ca0-89d6-4216-b971-44a14234ef7e response_code = 200 uri = /baseboard
20982024-11-20T02:23:08.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56706
20992024-11-20T02:23:08.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56706 req_id = 057986d4-89f7-4b49-8efa-92a520cce9e5 response_code = 200 uri = /vpc-routes
21002024-11-20T02:23:08.635ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
21012024-11-20T02:23:08.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56706 req_id = f3cb249d-4793-4690-af3d-a09ec4b7a00e response_code = 204 uri = /eip-gateways
21022024-11-20T02:23:08.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56706 req_id = 359e9f8f-a1fe-4f11-8cf6-4465c60c2eb4 response_code = 204 uri = /vpc-routes
21032024-11-20T02:23:08.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61359
21042024-11-20T02:23:08.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61359 req_id = baefcceb-e269-4a1f-bd9c-2ad08a7d3f62 response_code = 200 uri = /vpc-routes
21052024-11-20T02:23:08.677ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
21062024-11-20T02:23:08.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61359 req_id = 6215d311-821c-4f92-bcee-5c8f331c3312 response_code = 204 uri = /eip-gateways
21072024-11-20T02:23:08.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61359 req_id = ea0b22b1-7b46-409f-a340-232b136d3223 response_code = 204 uri = /vpc-routes
21082024-11-20T02:23:08.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51270
21092024-11-20T02:23:08.711ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21102024-11-20T02:23:08.751ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21112024-11-20T02:23:08.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96508 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51270 req_id = 54a8b3b9-4501-44ca-affb-9b2fc9cbb6e0 response_code = 204 uri = /switch-ports
21122024-11-20T02:23:08.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42875
21132024-11-20T02:23:08.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62148
21142024-11-20T02:23:08.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51270 req_id = f607d9cd-2f9d-4408-9457-9e3454c042ef response_code = 200 uri = /network-bootstore-config
21152024-11-20T02:23:08.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39017
21162024-11-20T02:23:08.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42875 req_id = b09f342f-a860-4142-b2df-1c7d102515e1 response_code = 200 uri = /v2p
21172024-11-20T02:23:08.808ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21182024-11-20T02:23:08.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62148 req_id = dacf228b-04e4-4e0c-8080-8967a31a1eb3 response_code = 200 uri = /v2p
21192024-11-20T02:23:08.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53825
21202024-11-20T02:23:08.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53825 req_id = be213634-dbd5-4906-8ff3-a03de3a22fe7 response_code = 200 uri = /v2p
21212024-11-20T02:23:08.854ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21222024-11-20T02:23:08.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53341
21232024-11-20T02:23:08.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53341 req_id = af2adee8-80ea-4e77-9ffb-013317dd821b response_code = 200 uri = /vpc-routes
21242024-11-20T02:23:08.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
21252024-11-20T02:23:08.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53341 req_id = fc9a5aed-3c83-4126-85a3-28ad9a61c08b response_code = 204 uri = /eip-gateways
21262024-11-20T02:23:08.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53341 req_id = 837bc0d3-d32a-4037-ac9f-e97e9c340900 response_code = 204 uri = /vpc-routes
21272024-11-20T02:23:08.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39017 req_id = 44809b4d-24fb-4e95-88e1-7ccb617c083b response_code = 204 uri = /switch-ports
21282024-11-20T02:23:08.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39017 req_id = 46746ef1-cd08-4ea2-85c1-29d6741d6f6b response_code = 200 uri = /network-bootstore-config
21292024-11-20T02:23:08.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43169
21302024-11-20T02:23:08.982ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21312024-11-20T02:23:09.015ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21322024-11-20T02:23:09.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86515 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43169 req_id = c30a3f70-6d55-4799-8c02-2938b4fd590e response_code = 204 uri = /switch-ports
21332024-11-20T02:23:09.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43169 req_id = d33e9079-ecd7-4086-b2be-500e6de5e301 response_code = 200 uri = /network-bootstore-config
21342024-11-20T02:23:16.390ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59766
21352024-11-20T02:23:16.390ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59766 req_id = 3d5368bd-5762-476d-b459-835750b05652 response_code = 200 uri = /baseboard
21362024-11-20T02:23:38.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63052
21372024-11-20T02:23:38.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63052 req_id = 88bcf7fe-03f0-4eae-b795-8fbaeffc36a4 response_code = 200 uri = /v2p
21382024-11-20T02:23:38.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59035
21392024-11-20T02:23:38.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59035 req_id = 96994755-b239-4189-8359-f604b1c50f58 response_code = 200 uri = /vpc-routes
21402024-11-20T02:23:38.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64192
21412024-11-20T02:23:38.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64192 req_id = d7409605-aa0e-4694-a5fc-cc4f5400d37f response_code = 200 uri = /v2p
21422024-11-20T02:23:38.846ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
21432024-11-20T02:23:38.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59035 req_id = fd44d2d4-f14a-4c18-83bf-3cca4f2c1d1a response_code = 204 uri = /eip-gateways
21442024-11-20T02:23:38.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65086
21452024-11-20T02:23:38.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65086 req_id = 36cbb0a3-871a-4faa-9cfb-4fee5a4e3d00 response_code = 200 uri = /vpc-routes
21462024-11-20T02:23:38.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59035 req_id = 2b1b9960-3202-4e27-9631-cf742f65799f response_code = 204 uri = /vpc-routes
21472024-11-20T02:23:38.899ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
21482024-11-20T02:23:38.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65086 req_id = 47587379-81f6-4411-bf0b-9d7e5bbc086b response_code = 204 uri = /eip-gateways
21492024-11-20T02:23:38.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50967
21502024-11-20T02:23:38.904ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21512024-11-20T02:23:38.943ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21522024-11-20T02:23:39.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101020 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50967 req_id = cbc116da-c851-4698-a163-2dcc21c2c3d8 response_code = 204 uri = /switch-ports
21532024-11-20T02:23:39.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52784
21542024-11-20T02:23:39.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59637
21552024-11-20T02:23:39.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57815
21562024-11-20T02:23:39.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65086 req_id = ab3adaaf-05bd-42b3-9ee7-95a075c4af97 response_code = 204 uri = /vpc-routes
21572024-11-20T02:23:39.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50967 req_id = 42acdc68-825d-42cb-a7bc-bb420325006f response_code = 200 uri = /network-bootstore-config
21582024-11-20T02:23:39.006ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21592024-11-20T02:23:39.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59637 req_id = 81697500-a5f0-4cc1-9833-84fa6e58a8cc response_code = 200 uri = /vpc-routes
21602024-11-20T02:23:39.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52784 req_id = b43f035d-fd9c-4dbf-b753-1d4bb43e4ea6 response_code = 200 uri = /v2p
21612024-11-20T02:23:39.049ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21622024-11-20T02:23:39.055ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
21632024-11-20T02:23:39.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59637 req_id = 588879bf-71b4-4d05-b9a5-0b191a232df4 response_code = 204 uri = /eip-gateways
21642024-11-20T02:23:39.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 452 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59637 req_id = 4ce6c697-7e3b-4b3a-8a33-25bb1009c90e response_code = 204 uri = /vpc-routes
21652024-11-20T02:23:39.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100763 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57815 req_id = 68ed90b7-d01c-4108-9461-de642be42daa response_code = 204 uri = /switch-ports
21662024-11-20T02:23:39.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57815 req_id = 7ff0854d-ebe4-4765-8215-704980e230f2 response_code = 200 uri = /network-bootstore-config
21672024-11-20T02:23:39.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63533
21682024-11-20T02:23:39.179ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21692024-11-20T02:23:39.216ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21702024-11-20T02:23:39.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93140 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63533 req_id = 85bfaec9-7bf0-41b8-83aa-809f9487b3b8 response_code = 204 uri = /switch-ports
21712024-11-20T02:23:39.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63533 req_id = bf598d23-953e-4190-8ba4-1fdd7e16bd1d response_code = 200 uri = /network-bootstore-config
21722024-11-20T02:23:46.423ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34034
21732024-11-20T02:23:46.423ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34034 req_id = 97f772a0-55fc-417b-8347-91e5c294a710 response_code = 200 uri = /baseboard
21742024-11-20T02:24:08.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59607
21752024-11-20T02:24:08.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59607 req_id = b9a9b614-40ac-43a6-8930-6976cd2f30b7 response_code = 200 uri = /vpc-routes
21762024-11-20T02:24:08.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39273
21772024-11-20T02:24:08.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39273 req_id = 0322e076-d2da-4bcb-97b3-3e868829cc76 response_code = 200 uri = /vpc-routes
21782024-11-20T02:24:08.574ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
21792024-11-20T02:24:08.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59607 req_id = 3a85288b-4ebd-456d-8fad-b6dcf9c8f808 response_code = 204 uri = /eip-gateways
21802024-11-20T02:24:08.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59607 req_id = a5b2690f-c26c-41c8-a15e-4ce81728398c response_code = 204 uri = /vpc-routes
21812024-11-20T02:24:08.614ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
21822024-11-20T02:24:08.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39273 req_id = 4a7a336f-bd10-4b82-b577-30a5c0ddfcf5 response_code = 204 uri = /eip-gateways
21832024-11-20T02:24:08.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39273 req_id = 00d50967-b8bc-45d2-8fde-534899ed0e78 response_code = 204 uri = /vpc-routes
21842024-11-20T02:24:08.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62417
21852024-11-20T02:24:08.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62417 req_id = 4b8bb451-7192-477a-b31d-51bb350e2d67 response_code = 200 uri = /v2p
21862024-11-20T02:24:08.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65367
21872024-11-20T02:24:08.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21882024-11-20T02:24:08.707ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21892024-11-20T02:24:08.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121219 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65367 req_id = cd915adc-fa0f-4fa8-a72f-0df80942f7c7 response_code = 204 uri = /switch-ports
21902024-11-20T02:24:08.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46740
21912024-11-20T02:24:08.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50013
21922024-11-20T02:24:08.775ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21932024-11-20T02:24:08.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65367 req_id = 053e394a-7f64-4a60-9078-e4bc7be31655 response_code = 200 uri = /network-bootstore-config
21942024-11-20T02:24:08.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4044 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50013 req_id = f991c4b4-d2fc-4e18-88c6-03b18e33a2be response_code = 200 uri = /v2p
21952024-11-20T02:24:08.810ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21962024-11-20T02:24:08.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91394 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46740 req_id = 552fe3dc-9fbd-4d3d-8bbc-7a0bd752d1a8 response_code = 204 uri = /switch-ports
21972024-11-20T02:24:08.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46740 req_id = 6bea6c43-854a-4fbe-8f9f-3c607aae7c76 response_code = 200 uri = /network-bootstore-config
21982024-11-20T02:24:08.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42968
21992024-11-20T02:24:08.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42968 req_id = b6e0b1d5-69fa-4355-ae14-03d9be8dd253 response_code = 200 uri = /vpc-routes
22002024-11-20T02:24:08.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
22012024-11-20T02:24:08.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42968 req_id = 56e85025-b70c-4eea-ade1-10241bafe732 response_code = 204 uri = /eip-gateways
22022024-11-20T02:24:08.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42968 req_id = 078a78af-c409-4b5f-b4de-7a305dbf1762 response_code = 204 uri = /vpc-routes
22032024-11-20T02:24:09.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41561
22042024-11-20T02:24:09.002ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22052024-11-20T02:24:09.045ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22062024-11-20T02:24:09.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100593 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41561 req_id = 6f0cbb64-842c-4468-be6d-ed3f15a464be response_code = 204 uri = /switch-ports
22072024-11-20T02:24:09.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41561 req_id = 1b1d4eb5-eb03-4672-87a0-2e64a9e7f0d5 response_code = 200 uri = /network-bootstore-config
22082024-11-20T02:24:09.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45231
22092024-11-20T02:24:09.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45231 req_id = 244d9796-9fbd-4d58-9293-c9045d1b6184 response_code = 200 uri = /v2p
22102024-11-20T02:24:16.471ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59283
22112024-11-20T02:24:16.471ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59283 req_id = edd53b2c-0900-4091-b230-a438a653a8e7 response_code = 200 uri = /baseboard
22122024-11-20T02:24:38.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63357
22132024-11-20T02:24:38.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63357 req_id = 06f7e180-bd8c-42dd-932d-6ce02290bdf6 response_code = 200 uri = /vpc-routes
22142024-11-20T02:24:38.664ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
22152024-11-20T02:24:38.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63357 req_id = 02619ac5-acb4-4b68-a116-204f72b030dd response_code = 204 uri = /eip-gateways
22162024-11-20T02:24:38.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63357 req_id = e76a1d26-3af9-49b6-939b-f1564eae4497 response_code = 204 uri = /vpc-routes
22172024-11-20T02:24:38.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53169
22182024-11-20T02:24:38.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53169 req_id = 8bfd91f3-0dff-492c-9144-d47750779591 response_code = 200 uri = /vpc-routes
22192024-11-20T02:24:38.866ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
22202024-11-20T02:24:38.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53169 req_id = 0ac72dd9-8315-408a-afdb-789d22dd2ae4 response_code = 204 uri = /eip-gateways
22212024-11-20T02:24:38.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39018
22222024-11-20T02:24:38.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39018 req_id = a9f154de-6ca6-4d98-a162-1d561a740cec response_code = 200 uri = /v2p
22232024-11-20T02:24:38.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53169 req_id = af3f5a4c-e25e-466c-9551-90bf5949a1af response_code = 204 uri = /vpc-routes
22242024-11-20T02:24:38.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64027
22252024-11-20T02:24:38.911ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22262024-11-20T02:24:38.951ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22272024-11-20T02:24:39.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64027 req_id = c95928e9-3a7a-401f-bf72-8b8bc0d16c47 response_code = 204 uri = /switch-ports
22282024-11-20T02:24:39.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57618
22292024-11-20T02:24:39.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60957
22302024-11-20T02:24:39.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 510 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60957 req_id = 2d488deb-ca50-4a32-8883-a4a83d1f5c3f response_code = 200 uri = /vpc-routes
22312024-11-20T02:24:39.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 757 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57618 req_id = 6bef5c46-a8c4-4a62-879b-11ac0cc71bfd response_code = 200 uri = /v2p
22322024-11-20T02:24:39.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6542 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64027 req_id = bb90f870-b0e7-4907-95b9-8df505e61e1a response_code = 200 uri = /network-bootstore-config
22332024-11-20T02:24:39.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37787
22342024-11-20T02:24:39.030ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22352024-11-20T02:24:39.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22362024-11-20T02:24:39.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37787 req_id = 2e890d8a-643d-455c-86a8-7b647f666258 response_code = 204 uri = /switch-ports
22372024-11-20T02:24:39.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53802
22382024-11-20T02:24:39.124ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
22392024-11-20T02:24:39.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60957 req_id = 0fde7562-e67a-4035-b684-077da144ca3b response_code = 204 uri = /eip-gateways
22402024-11-20T02:24:39.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36809
22412024-11-20T02:24:39.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37787 req_id = ad468d11-c7f6-48e9-a726-92047b50c90c response_code = 200 uri = /network-bootstore-config
22422024-11-20T02:24:39.124ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22432024-11-20T02:24:39.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53802 req_id = beb0d698-e3bd-4d4f-b689-610c1ec98ca5 response_code = 200 uri = /v2p
22442024-11-20T02:24:39.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60957 req_id = 292c800a-edd5-42ea-af26-bdabd200875e response_code = 204 uri = /vpc-routes
22452024-11-20T02:24:39.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22462024-11-20T02:24:39.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36809 req_id = 7c53bb1c-8aab-4d2a-bae2-cd0012da3910 response_code = 204 uri = /switch-ports
22472024-11-20T02:24:39.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36809 req_id = c96a0f5e-8a91-47a8-a81d-128427f850c4 response_code = 200 uri = /network-bootstore-config
22482024-11-20T02:24:46.503ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34114
22492024-11-20T02:24:46.503ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34114 req_id = 3276af83-7126-4962-a940-e8a9f29ad3b8 response_code = 200 uri = /baseboard
22502024-11-20T02:24:52.435ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22512024-11-20T02:24:52.435ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22522024-11-20T02:24:52.436ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22532024-11-20T02:24:52.437ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22542024-11-20T02:24:52.438ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22552024-11-20T02:24:52.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22562024-11-20T02:24:52.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22572024-11-20T02:24:52.469ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22582024-11-20T02:24:52.863ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22592024-11-20T02:24:55.431ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22602024-11-20T02:24:55.684ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22612024-11-20T02:24:55.686ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22622024-11-20T02:24:55.687ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22632024-11-20T02:24:58.219ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22642024-11-20T02:24:58.220ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22652024-11-20T02:24:59.903ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22662024-11-20T02:24:59.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22672024-11-20T02:25:02.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22682024-11-20T02:25:02.440ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22692024-11-20T02:25:02.440ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22702024-11-20T02:25:02.441ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22712024-11-20T02:25:02.442ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22722024-11-20T02:25:02.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22732024-11-20T02:25:02.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22742024-11-20T02:25:02.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22752024-11-20T02:25:02.471ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22762024-11-20T02:25:02.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22772024-11-20T02:25:05.433ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22782024-11-20T02:25:05.686ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22792024-11-20T02:25:05.687ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22802024-11-20T02:25:05.689ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22812024-11-20T02:25:08.224ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22822024-11-20T02:25:08.225ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
22832024-11-20T02:25:08.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44311
22842024-11-20T02:25:08.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44311 req_id = 3cdd9a2a-5520-4262-9839-aa5e08ca889d response_code = 200 uri = /vpc-routes
22852024-11-20T02:25:08.578ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
22862024-11-20T02:25:08.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44311 req_id = 619ce3ff-b63f-4670-b191-ab5b2215e447 response_code = 204 uri = /eip-gateways
22872024-11-20T02:25:08.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35127
22882024-11-20T02:25:08.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35127 req_id = 3e624020-5de5-488f-9bd8-f8c93876014b response_code = 200 uri = /v2p
22892024-11-20T02:25:08.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44311 req_id = 494d7dba-68cd-432c-9a57-ab705702d26f response_code = 204 uri = /vpc-routes
22902024-11-20T02:25:08.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42310
22912024-11-20T02:25:08.620ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22922024-11-20T02:25:08.680ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22932024-11-20T02:25:08.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143790 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42310 req_id = 3378d5a5-13ab-4374-a07e-cf72f057614b response_code = 204 uri = /switch-ports
22942024-11-20T02:25:08.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54059
22952024-11-20T02:25:08.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54059 req_id = 75c09a81-dc77-493e-9b75-752ea681269b response_code = 200 uri = /vpc-routes
22962024-11-20T02:25:08.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42310 req_id = 22d4b2a8-d5cd-442a-b834-4f8184b95061 response_code = 200 uri = /network-bootstore-config
22972024-11-20T02:25:08.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
22982024-11-20T02:25:08.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54059 req_id = f7331213-d752-4e13-b3ad-15841cea49c2 response_code = 204 uri = /eip-gateways
22992024-11-20T02:25:08.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54059 req_id = 10d7a3f8-baba-4a04-853a-283d8e78fa41 response_code = 204 uri = /vpc-routes
23002024-11-20T02:25:08.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48910
23012024-11-20T02:25:08.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48910 req_id = 5e5b703a-b9f8-429f-aaa7-e52bc965c041 response_code = 200 uri = /v2p
23022024-11-20T02:25:08.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57233
23032024-11-20T02:25:08.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57233 req_id = 66ab2310-3dcc-4633-b7e9-42b594789654 response_code = 200 uri = /vpc-routes
23042024-11-20T02:25:08.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53731
23052024-11-20T02:25:08.880ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23062024-11-20T02:25:08.919ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23072024-11-20T02:25:08.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95592 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53731 req_id = 22a30c39-875b-40ab-be2b-2ee1ee720f68 response_code = 204 uri = /switch-ports
23082024-11-20T02:25:08.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41758
23092024-11-20T02:25:08.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
23102024-11-20T02:25:08.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57233 req_id = dd84c988-fc08-47e2-aa54-8c86abcba468 response_code = 204 uri = /eip-gateways
23112024-11-20T02:25:08.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41758 req_id = 25580b83-a225-4e05-b5f0-d320a313cf0b response_code = 200 uri = /v2p
23122024-11-20T02:25:08.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53731 req_id = 4e06c91e-fa40-4780-a86c-bbb65dfce2f6 response_code = 200 uri = /network-bootstore-config
23132024-11-20T02:25:08.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57233 req_id = 9a67edbc-283a-4956-9b91-c72729ac23b8 response_code = 204 uri = /vpc-routes
23142024-11-20T02:25:09.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44386
23152024-11-20T02:25:09.001ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23162024-11-20T02:25:09.041ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23172024-11-20T02:25:09.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98403 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44386 req_id = 47685065-bf2c-49b6-92a0-18b5e51a3c1c response_code = 204 uri = /switch-ports
23182024-11-20T02:25:09.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44386 req_id = 66ebf79d-2338-4864-b812-204a5b1359cf response_code = 200 uri = /network-bootstore-config
23192024-11-20T02:25:09.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23202024-11-20T02:25:09.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23212024-11-20T02:25:12.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23222024-11-20T02:25:12.444ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23232024-11-20T02:25:12.445ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23242024-11-20T02:25:12.445ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23252024-11-20T02:25:12.446ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23262024-11-20T02:25:12.447ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23272024-11-20T02:25:12.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23282024-11-20T02:25:12.463ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23292024-11-20T02:25:12.472ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23302024-11-20T02:25:12.869ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23312024-11-20T02:25:15.435ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23322024-11-20T02:25:15.688ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23332024-11-20T02:25:15.689ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23342024-11-20T02:25:15.692ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23352024-11-20T02:25:16.536ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33773
23362024-11-20T02:25:16.536ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33773 req_id = 77ac988f-bbe8-4000-8fe2-eb3c67fba30c response_code = 200 uri = /baseboard
23372024-11-20T02:25:18.228ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23382024-11-20T02:25:18.229ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23392024-11-20T02:25:19.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23402024-11-20T02:25:19.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23412024-11-20T02:25:22.447ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23422024-11-20T02:25:22.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23432024-11-20T02:25:22.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23442024-11-20T02:25:22.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23452024-11-20T02:25:22.450ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23462024-11-20T02:25:22.450ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23472024-11-20T02:25:22.451ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23482024-11-20T02:25:22.466ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23492024-11-20T02:25:22.474ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23502024-11-20T02:25:22.871ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23512024-11-20T02:25:24.742ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23522024-11-20T02:25:24.743ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23532024-11-20T02:25:24.778ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2016, tv_nsec: 886581872 } time_to_next_cleanup = 599.99999974s
23542024-11-20T02:25:25.437ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23552024-11-20T02:25:25.691ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23562024-11-20T02:25:25.692ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23572024-11-20T02:25:25.694ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23582024-11-20T02:25:28.232ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23592024-11-20T02:25:28.233ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23602024-11-20T02:25:29.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23612024-11-20T02:25:29.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23622024-11-20T02:25:32.451ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23632024-11-20T02:25:32.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23642024-11-20T02:25:32.453ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23652024-11-20T02:25:32.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23662024-11-20T02:25:32.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23672024-11-20T02:25:32.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23682024-11-20T02:25:32.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23692024-11-20T02:25:32.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23702024-11-20T02:25:32.475ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23712024-11-20T02:25:32.872ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23722024-11-20T02:25:35.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23732024-11-20T02:25:35.693ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23742024-11-20T02:25:35.694ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23752024-11-20T02:25:35.695ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23762024-11-20T02:25:38.236ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23772024-11-20T02:25:38.237ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
23782024-11-20T02:25:38.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55124
23792024-11-20T02:25:38.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55124 req_id = e4d8e59a-da29-4976-b0dd-7f387fa6ad1c response_code = 200 uri = /vpc-routes
23802024-11-20T02:25:38.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34702
23812024-11-20T02:25:38.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34702 req_id = 530ce418-b301-401c-a257-2dc4a9244d15 response_code = 200 uri = /v2p
23822024-11-20T02:25:38.847ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
23832024-11-20T02:25:38.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 860 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55124 req_id = f01a9c2e-aa47-4820-a311-f02626a16a7a response_code = 204 uri = /eip-gateways
23842024-11-20T02:25:38.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55124 req_id = 9482d2b3-05de-482e-916f-fdc0c8622366 response_code = 204 uri = /vpc-routes
23852024-11-20T02:25:38.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50080
23862024-11-20T02:25:38.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50080 req_id = c6199596-bead-4044-b3ab-a3bf2c745148 response_code = 200 uri = /vpc-routes
23872024-11-20T02:25:38.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62226
23882024-11-20T02:25:38.919ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23892024-11-20T02:25:38.961ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23902024-11-20T02:25:39.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62226 req_id = 4001fa13-8c6b-48e6-9289-ddf973bb313a response_code = 204 uri = /switch-ports
23912024-11-20T02:25:39.024ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23922024-11-20T02:25:39.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65153
23932024-11-20T02:25:39.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65153 req_id = 29f572c1-4824-42ad-bd58-1d010570cf4c response_code = 200 uri = /vpc-routes
23942024-11-20T02:25:39.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
23952024-11-20T02:25:39.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50080 req_id = 3ce00af4-e612-4ca5-a371-6f3d8bce5d87 response_code = 204 uri = /eip-gateways
23962024-11-20T02:25:39.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62226 req_id = 71818f52-57b8-4cfc-96ef-a98e306e3298 response_code = 200 uri = /network-bootstore-config
23972024-11-20T02:25:39.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55655
23982024-11-20T02:25:39.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55655 req_id = 77f324f0-a41b-453a-b31d-1ab347691c01 response_code = 200 uri = /v2p
23992024-11-20T02:25:39.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50080 req_id = 06132a69-6692-4570-bd7f-ce62aa14c105 response_code = 204 uri = /vpc-routes
24002024-11-20T02:25:39.071ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
24012024-11-20T02:25:39.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65153 req_id = 605b2288-ce6e-42c8-8dcd-ec5c8bd9dc84 response_code = 204 uri = /eip-gateways
24022024-11-20T02:25:39.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45746
24032024-11-20T02:25:39.080ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24042024-11-20T02:25:39.118ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24052024-11-20T02:25:39.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94158 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45746 req_id = 5a76f9ea-f66e-453c-be8d-eb149d6752df response_code = 204 uri = /switch-ports
24062024-11-20T02:25:39.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58519
24072024-11-20T02:25:39.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45746 req_id = ef967acc-02f1-4aeb-bd5a-bdc1223b83d1 response_code = 200 uri = /network-bootstore-config
24082024-11-20T02:25:39.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58519 req_id = fd9fcc26-a627-4988-80fb-07b603fc7242 response_code = 200 uri = /v2p
24092024-11-20T02:25:39.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 441 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65153 req_id = c3d98b1c-32b0-47b1-b264-0caaf9838da7 response_code = 204 uri = /vpc-routes
24102024-11-20T02:25:39.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46283
24112024-11-20T02:25:39.216ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24122024-11-20T02:25:39.251ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24132024-11-20T02:25:39.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89088 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46283 req_id = af55bf26-03ae-49e9-bb6e-97fc51d15e7f response_code = 204 uri = /switch-ports
24142024-11-20T02:25:39.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46283 req_id = bc6baf7c-8000-499a-a298-e6c003fd4749 response_code = 200 uri = /network-bootstore-config
24152024-11-20T02:25:39.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24162024-11-20T02:25:39.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24172024-11-20T02:25:42.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24182024-11-20T02:25:42.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24192024-11-20T02:25:42.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24202024-11-20T02:25:42.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24212024-11-20T02:25:42.457ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24222024-11-20T02:25:42.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24232024-11-20T02:25:42.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24242024-11-20T02:25:42.470ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24252024-11-20T02:25:42.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24262024-11-20T02:25:42.874ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24272024-11-20T02:25:45.441ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24282024-11-20T02:25:45.695ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24292024-11-20T02:25:45.696ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24302024-11-20T02:25:45.697ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24312024-11-20T02:25:46.569ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42267
24322024-11-20T02:25:46.569ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42267 req_id = a19a46dd-79af-4181-bde9-7c911d03d47b response_code = 200 uri = /baseboard
24332024-11-20T02:25:48.240ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24342024-11-20T02:25:48.241ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24352024-11-20T02:25:49.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24362024-11-20T02:25:49.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24372024-11-20T02:25:52.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24382024-11-20T02:25:52.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24392024-11-20T02:25:52.460ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24402024-11-20T02:25:52.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24412024-11-20T02:25:52.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24422024-11-20T02:25:52.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24432024-11-20T02:25:52.463ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24442024-11-20T02:25:52.471ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24452024-11-20T02:25:52.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24462024-11-20T02:25:52.876ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24472024-11-20T02:25:55.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24482024-11-20T02:25:55.697ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24492024-11-20T02:25:55.698ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24502024-11-20T02:25:55.699ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24512024-11-20T02:25:58.245ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24522024-11-20T02:25:58.246ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24532024-11-20T02:25:59.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24542024-11-20T02:25:59.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24552024-11-20T02:26:02.463ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24562024-11-20T02:26:02.463ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24572024-11-20T02:26:02.464ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24582024-11-20T02:26:02.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24592024-11-20T02:26:02.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24602024-11-20T02:26:02.466ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24612024-11-20T02:26:02.467ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24622024-11-20T02:26:02.474ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24632024-11-20T02:26:02.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24642024-11-20T02:26:02.879ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24652024-11-20T02:26:05.445ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24662024-11-20T02:26:05.699ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24672024-11-20T02:26:05.700ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24682024-11-20T02:26:05.701ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24692024-11-20T02:26:08.249ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24702024-11-20T02:26:08.250ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
24712024-11-20T02:26:08.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60574
24722024-11-20T02:26:08.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60574 req_id = 607da698-c950-437c-ac17-539077cf8b8b response_code = 200 uri = /vpc-routes
24732024-11-20T02:26:08.611ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
24742024-11-20T02:26:08.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60574 req_id = 58866fa7-5fa5-4d78-9489-0b0e8d54a450 response_code = 204 uri = /eip-gateways
24752024-11-20T02:26:08.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61868
24762024-11-20T02:26:08.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61868 req_id = 53f98b38-01c1-4fbc-a6dd-6949a63e25a2 response_code = 200 uri = /v2p
24772024-11-20T02:26:08.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60574 req_id = 5da90310-3b65-4f60-9e26-1239ad67cae9 response_code = 204 uri = /vpc-routes
24782024-11-20T02:26:08.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51968
24792024-11-20T02:26:08.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51968 req_id = 077ea750-5cf2-4e45-8630-3abbe8219ae2 response_code = 200 uri = /vpc-routes
24802024-11-20T02:26:08.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56127
24812024-11-20T02:26:08.667ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24822024-11-20T02:26:08.723ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24832024-11-20T02:26:08.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141904 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56127 req_id = 8ceeb130-b78d-41ef-8826-5bb3ad0d7bdc response_code = 204 uri = /switch-ports
24842024-11-20T02:26:08.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37936
24852024-11-20T02:26:08.809ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
24862024-11-20T02:26:08.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51968 req_id = a503fc15-5025-4a78-a7fc-68e8c5ca5b66 response_code = 204 uri = /eip-gateways
24872024-11-20T02:26:08.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56127 req_id = b3f03047-e786-4757-88c6-a329f27a03a5 response_code = 200 uri = /network-bootstore-config
24882024-11-20T02:26:08.810ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24892024-11-20T02:26:08.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51968 req_id = 3de75026-e619-408a-a65a-1f6589619eff response_code = 204 uri = /vpc-routes
24902024-11-20T02:26:08.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24912024-11-20T02:26:08.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64331
24922024-11-20T02:26:08.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64331 req_id = 58fe9f5c-d4c2-4d13-9a4d-7d804fd5038f response_code = 200 uri = /vpc-routes
24932024-11-20T02:26:08.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64294
24942024-11-20T02:26:08.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64294 req_id = b58c7ecd-bc19-4061-a945-1de8b60c5c99 response_code = 200 uri = /v2p
24952024-11-20T02:26:08.903ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
24962024-11-20T02:26:08.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64331 req_id = 7885c843-7a42-42f5-93ff-5deb8231613b response_code = 204 uri = /eip-gateways
24972024-11-20T02:26:08.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64331 req_id = 3f38b725-6b84-4475-b83a-a0221b24f260 response_code = 204 uri = /vpc-routes
24982024-11-20T02:26:08.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104746 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37936 req_id = 4ed9b369-0175-4b06-adfa-4e278d5347f8 response_code = 204 uri = /switch-ports
24992024-11-20T02:26:08.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37936 req_id = 7f111eec-48d9-4d09-83cf-02296a4d0b8b response_code = 200 uri = /network-bootstore-config
25002024-11-20T02:26:08.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56765
25012024-11-20T02:26:08.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56765 req_id = 7500e073-d681-4405-b8dd-e8249def6217 response_code = 200 uri = /v2p
25022024-11-20T02:26:09.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39228
25032024-11-20T02:26:09.025ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25042024-11-20T02:26:09.058ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25052024-11-20T02:26:09.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39228 req_id = 59d54e9e-53d3-4ce2-8b1d-720f328c1a16 response_code = 204 uri = /switch-ports
25062024-11-20T02:26:09.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39228 req_id = 5ccc3b12-1370-4f06-ac9a-07bd38f6b3cb response_code = 200 uri = /network-bootstore-config
25072024-11-20T02:26:09.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25082024-11-20T02:26:09.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25092024-11-20T02:26:12.467ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25102024-11-20T02:26:12.467ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25112024-11-20T02:26:12.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25122024-11-20T02:26:12.469ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25132024-11-20T02:26:12.470ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25142024-11-20T02:26:12.470ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25152024-11-20T02:26:12.471ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25162024-11-20T02:26:12.476ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25172024-11-20T02:26:12.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25182024-11-20T02:26:12.881ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25192024-11-20T02:26:15.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25202024-11-20T02:26:15.702ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25212024-11-20T02:26:15.703ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25222024-11-20T02:26:15.703ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25232024-11-20T02:26:16.601ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56747
25242024-11-20T02:26:16.601ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56747 req_id = 0f1d0b88-0e2d-4e12-9f3a-70d36dced13f response_code = 200 uri = /baseboard
25252024-11-20T02:26:18.253ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25262024-11-20T02:26:18.254ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25272024-11-20T02:26:19.922ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25282024-11-20T02:26:19.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25292024-11-20T02:26:22.470ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25302024-11-20T02:26:22.470ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25312024-11-20T02:26:22.471ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25322024-11-20T02:26:22.472ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25332024-11-20T02:26:22.472ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25342024-11-20T02:26:22.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25352024-11-20T02:26:22.474ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25362024-11-20T02:26:22.478ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25372024-11-20T02:26:22.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25382024-11-20T02:26:22.882ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25392024-11-20T02:26:25.451ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25402024-11-20T02:26:25.704ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25412024-11-20T02:26:25.705ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25422024-11-20T02:26:25.705ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25432024-11-20T02:26:28.257ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25442024-11-20T02:26:28.258ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25452024-11-20T02:26:29.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25462024-11-20T02:26:29.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25472024-11-20T02:26:32.472ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25482024-11-20T02:26:32.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25492024-11-20T02:26:32.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25502024-11-20T02:26:32.474ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25512024-11-20T02:26:32.475ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25522024-11-20T02:26:32.475ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25532024-11-20T02:26:32.476ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25542024-11-20T02:26:32.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25552024-11-20T02:26:32.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25562024-11-20T02:26:32.884ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25572024-11-20T02:26:35.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25582024-11-20T02:26:35.705ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25592024-11-20T02:26:35.706ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25602024-11-20T02:26:35.707ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25612024-11-20T02:26:38.261ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25622024-11-20T02:26:38.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
25632024-11-20T02:26:38.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38315
25642024-11-20T02:26:38.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38315 req_id = 00724779-3af2-4f6f-afaa-db6f1bf927a2 response_code = 200 uri = /vpc-routes
25652024-11-20T02:26:38.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54258
25662024-11-20T02:26:38.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54258 req_id = 1deadde3-8d26-4041-b70b-20be570ddb2b response_code = 200 uri = /vpc-routes
25672024-11-20T02:26:38.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
25682024-11-20T02:26:38.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38315 req_id = cdf56807-6c5f-4c9b-a764-db1df84f8af6 response_code = 204 uri = /eip-gateways
25692024-11-20T02:26:38.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38315 req_id = e75e4305-7170-4dc8-81aa-fb4cb82dae7a response_code = 204 uri = /vpc-routes
25702024-11-20T02:26:38.831ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
25712024-11-20T02:26:38.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54258 req_id = dc1af232-6eda-409e-9577-0971acb252a8 response_code = 204 uri = /eip-gateways
25722024-11-20T02:26:38.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54258 req_id = f18ac380-8670-4f44-813f-e339b0e9db0c response_code = 204 uri = /vpc-routes
25732024-11-20T02:26:38.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43043
25742024-11-20T02:26:38.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43043 req_id = cee2aaa4-71da-4d93-a782-8a758c201b38 response_code = 200 uri = /v2p
25752024-11-20T02:26:38.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53860
25762024-11-20T02:26:38.937ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25772024-11-20T02:26:38.982ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25782024-11-20T02:26:39.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103548 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53860 req_id = efb180d1-eb06-4bea-a273-e4fefc217195 response_code = 204 uri = /switch-ports
25792024-11-20T02:26:39.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54341
25802024-11-20T02:26:39.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50948
25812024-11-20T02:26:39.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34744
25822024-11-20T02:26:39.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34744 req_id = 12c79aab-3389-4c23-99c9-c8b9dd53e29b response_code = 200 uri = /v2p
25832024-11-20T02:26:39.042ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25842024-11-20T02:26:39.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50948 req_id = bdf055b8-303c-4913-a8db-4dfde63597d7 response_code = 200 uri = /vpc-routes
25852024-11-20T02:26:39.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53860 req_id = 03bde1a3-e3d1-4fa2-b0eb-b50cb8ff9bac response_code = 200 uri = /network-bootstore-config
25862024-11-20T02:26:39.083ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25872024-11-20T02:26:39.095ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
25882024-11-20T02:26:39.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50948 req_id = eba446ab-c4b4-41dd-b969-21424cc21c49 response_code = 204 uri = /eip-gateways
25892024-11-20T02:26:39.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105851 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54341 req_id = 799621bb-1477-40ef-844e-bbea66be4686 response_code = 204 uri = /switch-ports
25902024-11-20T02:26:39.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54341 req_id = fbd3acc1-9bb5-4f1e-abd7-9e28551573a0 response_code = 200 uri = /network-bootstore-config
25912024-11-20T02:26:39.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36768
25922024-11-20T02:26:39.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36768 req_id = adeeae39-a177-4bc3-adad-f4be3025e297 response_code = 200 uri = /v2p
25932024-11-20T02:26:39.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50948 req_id = 9f98a262-cb3a-467d-a506-a6ff9da3ee89 response_code = 204 uri = /vpc-routes
25942024-11-20T02:26:39.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64973
25952024-11-20T02:26:39.332ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25962024-11-20T02:26:39.371ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25972024-11-20T02:26:39.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64973 req_id = 90dd4fed-74a5-4338-adfa-688d880f115e response_code = 204 uri = /switch-ports
25982024-11-20T02:26:39.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64973 req_id = 75449855-1309-4a30-957e-abaa0d03faa2 response_code = 200 uri = /network-bootstore-config
25992024-11-20T02:26:39.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26002024-11-20T02:26:39.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26012024-11-20T02:26:42.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26022024-11-20T02:26:42.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26032024-11-20T02:26:42.478ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26042024-11-20T02:26:42.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26052024-11-20T02:26:42.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26062024-11-20T02:26:42.480ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26072024-11-20T02:26:42.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26082024-11-20T02:26:42.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26092024-11-20T02:26:42.487ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26102024-11-20T02:26:42.886ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26112024-11-20T02:26:45.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26122024-11-20T02:26:45.707ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26132024-11-20T02:26:45.708ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26142024-11-20T02:26:45.710ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26152024-11-20T02:26:46.636ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63478
26162024-11-20T02:26:46.636ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63478 req_id = daa66953-90e4-4298-a370-2d027dd950b9 response_code = 200 uri = /baseboard
26172024-11-20T02:26:48.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26182024-11-20T02:26:48.266ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26192024-11-20T02:26:49.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26202024-11-20T02:26:49.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26212024-11-20T02:26:52.480ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26222024-11-20T02:26:52.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26232024-11-20T02:26:52.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26242024-11-20T02:26:52.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26252024-11-20T02:26:52.483ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26262024-11-20T02:26:52.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26272024-11-20T02:26:52.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26282024-11-20T02:26:52.485ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26292024-11-20T02:26:52.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26302024-11-20T02:26:52.888ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26312024-11-20T02:26:55.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26322024-11-20T02:26:55.710ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26332024-11-20T02:26:55.711ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26342024-11-20T02:26:55.711ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26352024-11-20T02:26:58.278ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26362024-11-20T02:26:58.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26372024-11-20T02:26:59.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26382024-11-20T02:26:59.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26392024-11-20T02:27:02.485ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26402024-11-20T02:27:02.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26412024-11-20T02:27:02.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26422024-11-20T02:27:02.487ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26432024-11-20T02:27:02.488ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26442024-11-20T02:27:02.488ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26452024-11-20T02:27:02.489ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26462024-11-20T02:27:02.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26472024-11-20T02:27:02.491ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26482024-11-20T02:27:02.890ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26492024-11-20T02:27:05.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26502024-11-20T02:27:05.712ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26512024-11-20T02:27:05.713ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26522024-11-20T02:27:05.714ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26532024-11-20T02:27:08.282ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26542024-11-20T02:27:08.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26552024-11-20T02:27:08.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50767
26562024-11-20T02:27:08.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50767 req_id = a6e4c3d8-be45-4c33-9a7f-da404a36b0db response_code = 200 uri = /vpc-routes
26572024-11-20T02:27:08.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57750
26582024-11-20T02:27:08.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57750 req_id = 0e2f4c62-3604-42d4-91f6-849a1cc5913a response_code = 200 uri = /v2p
26592024-11-20T02:27:08.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46761
26602024-11-20T02:27:08.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46761 req_id = 56680562-6b38-4a86-b0ee-63f7ffb18827 response_code = 200 uri = /vpc-routes
26612024-11-20T02:27:08.713ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
26622024-11-20T02:27:08.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 380 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50767 req_id = d7d47ffb-c56f-4bab-bc11-31f82d76c99a response_code = 204 uri = /eip-gateways
26632024-11-20T02:27:08.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
26642024-11-20T02:27:08.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46761 req_id = 0117ea7c-de78-4a70-ad48-4cd9a89d63e9 response_code = 204 uri = /eip-gateways
26652024-11-20T02:27:08.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50767 req_id = 7d45595a-44b8-45ef-8647-9bf4c9a86d11 response_code = 204 uri = /vpc-routes
26662024-11-20T02:27:08.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46761 req_id = 2476470b-4a99-481f-9942-b7139fcc52af response_code = 204 uri = /vpc-routes
26672024-11-20T02:27:08.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65494
26682024-11-20T02:27:08.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26692024-11-20T02:27:08.785ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26702024-11-20T02:27:08.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118986 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65494 req_id = a17f305d-6a5a-4b04-9539-9e2be8163254 response_code = 204 uri = /switch-ports
26712024-11-20T02:27:08.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59064
26722024-11-20T02:27:08.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65492
26732024-11-20T02:27:08.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56808
26742024-11-20T02:27:08.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56808 req_id = 641fee93-e582-4e51-adf5-5b42e8bb8f42 response_code = 200 uri = /vpc-routes
26752024-11-20T02:27:08.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65492 req_id = d4a7e45c-f07d-4eae-b332-e5e30c782250 response_code = 200 uri = /v2p
26762024-11-20T02:27:08.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26772024-11-20T02:27:08.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65494 req_id = 3256d658-2f65-4c4a-9fcf-7be14c0cd4a3 response_code = 200 uri = /network-bootstore-config
26782024-11-20T02:27:08.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26792024-11-20T02:27:08.914ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
26802024-11-20T02:27:08.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 635 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56808 req_id = 051ae695-31a2-4cd1-a331-a0eb3970b50c response_code = 204 uri = /eip-gateways
26812024-11-20T02:27:08.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 981 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56808 req_id = 63878281-3412-4316-951b-64bc429f53c1 response_code = 204 uri = /vpc-routes
26822024-11-20T02:27:08.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64228
26832024-11-20T02:27:08.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64228 req_id = 54806e03-383d-4324-bfbe-a403f2cea8df response_code = 200 uri = /v2p
26842024-11-20T02:27:08.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64915
26852024-11-20T02:27:08.985ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26862024-11-20T02:27:08.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125780 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59064 req_id = 148856fc-b97c-42b9-85a4-cbcbbb663494 response_code = 204 uri = /switch-ports
26872024-11-20T02:27:08.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 684 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59064 req_id = 664bb616-3e8c-43ff-834f-a0387069de0e response_code = 200 uri = /network-bootstore-config
26882024-11-20T02:27:09.026ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26892024-11-20T02:27:09.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118205 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64915 req_id = f3a7a6eb-4c91-466f-8d77-6cedd1e27247 response_code = 204 uri = /switch-ports
26902024-11-20T02:27:09.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64915 req_id = fb4eff87-3a3e-4700-b4e1-c26d531395f7 response_code = 200 uri = /network-bootstore-config
26912024-11-20T02:27:09.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26922024-11-20T02:27:09.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26932024-11-20T02:27:12.489ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26942024-11-20T02:27:12.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26952024-11-20T02:27:12.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26962024-11-20T02:27:12.491ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26972024-11-20T02:27:12.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26982024-11-20T02:27:12.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
26992024-11-20T02:27:12.493ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27002024-11-20T02:27:12.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27012024-11-20T02:27:12.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27022024-11-20T02:27:12.892ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27032024-11-20T02:27:15.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27042024-11-20T02:27:15.714ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27052024-11-20T02:27:15.714ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27062024-11-20T02:27:15.715ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27072024-11-20T02:27:16.670ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53437
27082024-11-20T02:27:16.670ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53437 req_id = 3175df99-148c-480d-8e2e-5b89a3b241aa response_code = 200 uri = /baseboard
27092024-11-20T02:27:18.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27102024-11-20T02:27:18.287ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27112024-11-20T02:27:19.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27122024-11-20T02:27:19.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27132024-11-20T02:27:22.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27142024-11-20T02:27:22.493ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27152024-11-20T02:27:22.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27162024-11-20T02:27:22.495ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27172024-11-20T02:27:22.495ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27182024-11-20T02:27:22.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27192024-11-20T02:27:22.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27202024-11-20T02:27:22.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27212024-11-20T02:27:22.498ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27222024-11-20T02:27:22.894ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27232024-11-20T02:27:25.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27242024-11-20T02:27:25.716ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27252024-11-20T02:27:25.717ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27262024-11-20T02:27:25.717ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27272024-11-20T02:27:28.290ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27282024-11-20T02:27:28.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27292024-11-20T02:27:29.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27302024-11-20T02:27:29.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27312024-11-20T02:27:32.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27322024-11-20T02:27:32.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27332024-11-20T02:27:32.498ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27342024-11-20T02:27:32.498ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27352024-11-20T02:27:32.499ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27362024-11-20T02:27:32.500ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27372024-11-20T02:27:32.500ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27382024-11-20T02:27:32.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27392024-11-20T02:27:32.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27402024-11-20T02:27:32.896ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27412024-11-20T02:27:35.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27422024-11-20T02:27:35.718ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27432024-11-20T02:27:35.719ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27442024-11-20T02:27:35.720ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27452024-11-20T02:27:38.293ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27462024-11-20T02:27:38.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
27472024-11-20T02:27:38.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32918
27482024-11-20T02:27:38.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32918 req_id = 2fa44dab-25b6-4ee5-9c3f-bd667bbb6335 response_code = 200 uri = /vpc-routes
27492024-11-20T02:27:38.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56115
27502024-11-20T02:27:38.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56115 req_id = 979d6d9d-06ce-4e73-b2fc-c6f963cb3d91 response_code = 200 uri = /vpc-routes
27512024-11-20T02:27:38.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38168
27522024-11-20T02:27:38.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38168 req_id = 087e33b1-a673-4e2c-a819-14630592b189 response_code = 200 uri = /v2p
27532024-11-20T02:27:38.870ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
27542024-11-20T02:27:38.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56115 req_id = b53f1e22-6b59-4e3e-858f-ada052fbc22f response_code = 204 uri = /eip-gateways
27552024-11-20T02:27:38.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56115 req_id = 67b553f1-1af4-4ec5-8322-8ac11c8af90d response_code = 204 uri = /vpc-routes
27562024-11-20T02:27:38.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
27572024-11-20T02:27:38.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32918 req_id = 72aa166c-1ac7-43fd-a5e7-ef3f3b37c7be response_code = 204 uri = /eip-gateways
27582024-11-20T02:27:38.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64074
27592024-11-20T02:27:38.943ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27602024-11-20T02:27:38.943ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27612024-11-20T02:27:38.943ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json file = common/src/ledger.rs:178
27622024-11-20T02:27:38.943ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json file = common/src/ledger.rs:178
27632024-11-20T02:27:38.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 395 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32918 req_id = 0ed4c1a3-c73b-46d4-abcf-7fc5db8c0077 response_code = 204 uri = /vpc-routes
27642024-11-20T02:27:38.959ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27652024-11-20T02:27:38.959ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17
27662024-11-20T02:27:38.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38697
27672024-11-20T02:27:38.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64796
27682024-11-20T02:27:38.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64796 req_id = 6db918e5-eb1b-4196-969a-44701596081b response_code = 200 uri = /v2p
27692024-11-20T02:27:38.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27702024-11-20T02:27:38.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27712024-11-20T02:27:38.976ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json file = common/src/ledger.rs:178
27722024-11-20T02:27:38.984ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json file = common/src/ledger.rs:178
27732024-11-20T02:27:38.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43557
27742024-11-20T02:27:38.991ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27752024-11-20T02:27:38.996ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27762024-11-20T02:27:38.997ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4
27772024-11-20T02:27:39.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59819
27782024-11-20T02:27:39.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59819 req_id = de7aee61-12a7-4bc4-9633-d430488048f4 response_code = 200 uri = /vpc-routes
27792024-11-20T02:27:39.017ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27802024-11-20T02:27:39.017ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17
27812024-11-20T02:27:39.039ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27822024-11-20T02:27:39.050ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27832024-11-20T02:27:39.050ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4
27842024-11-20T02:27:39.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34579
27852024-11-20T02:27:39.064ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27862024-11-20T02:27:39.064ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27872024-11-20T02:27:39.064ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27882024-11-20T02:27:39.064ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27892024-11-20T02:27:39.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27902024-11-20T02:27:39.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27912024-11-20T02:27:39.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27922024-11-20T02:27:39.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34579 req_id = dbbd7b20-6c78-40fc-91a8-a0ead4dca92c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27932024-11-20T02:27:39.069ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27942024-11-20T02:27:39.069ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc
27952024-11-20T02:27:39.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63082
27962024-11-20T02:27:39.089ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27972024-11-20T02:27:39.089ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc
27982024-11-20T02:27:39.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42671
27992024-11-20T02:27:39.100ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28002024-11-20T02:27:39.100ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28012024-11-20T02:27:39.100ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28022024-11-20T02:27:39.100ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28032024-11-20T02:27:39.100ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28042024-11-20T02:27:39.100ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28052024-11-20T02:27:39.100ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28062024-11-20T02:27:39.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 498 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42671 req_id = 3e32db05-74b6-4a9f-ac63-691d1350145b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28072024-11-20T02:27:39.106ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28082024-11-20T02:27:39.106ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_98cd316b-55e2-4c2d-813f-e4caae970d59
28092024-11-20T02:27:39.125ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28102024-11-20T02:27:39.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134588 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43557 req_id = df588fc2-ee8a-456d-8203-09e132793713 response_code = 204 uri = /switch-ports
28112024-11-20T02:27:39.135ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28122024-11-20T02:27:39.136ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_841052f1-d4ff-4743-9006-a66dddb621f3
28132024-11-20T02:27:39.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43557 req_id = a5bb6ce6-dc7e-4bc9-8950-76bf17da2368 response_code = 200 uri = /network-bootstore-config
28142024-11-20T02:27:39.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44061
28152024-11-20T02:27:39.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44061 req_id = e6765f5d-ed0e-43de-ae18-a8d0738fa8d1 response_code = 200 uri = /v2p
28162024-11-20T02:27:39.161ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28172024-11-20T02:27:39.161ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_98cd316b-55e2-4c2d-813f-e4caae970d59
28182024-11-20T02:27:39.172ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28192024-11-20T02:27:39.185ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28202024-11-20T02:27:39.185ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_9529683f-e460-4948-a032-9f2d5e49707f
28212024-11-20T02:27:39.194ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
28222024-11-20T02:27:39.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59819 req_id = 03fdf375-b145-4924-80f4-78b8107da441 response_code = 204 uri = /eip-gateways
28232024-11-20T02:27:39.209ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28242024-11-20T02:27:39.209ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_841052f1-d4ff-4743-9006-a66dddb621f3
28252024-11-20T02:27:39.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44386
28262024-11-20T02:27:39.229ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28272024-11-20T02:27:39.229ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30
28282024-11-20T02:27:39.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59819 req_id = 7c445e52-346b-40e9-b8e8-f6c51f05539d response_code = 204 uri = /vpc-routes
28292024-11-20T02:27:39.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28302024-11-20T02:27:39.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28312024-11-20T02:27:39.244ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/config/omicron-zones.json file = common/src/ledger.rs:178
28322024-11-20T02:27:39.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41939
28332024-11-20T02:27:39.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171308 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63082 req_id = d4aaf805-d1b7-4e70-a295-f459f286ebda response_code = 204 uri = /switch-ports
28342024-11-20T02:27:39.256ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/config/omicron-zones.json file = common/src/ledger.rs:178
28352024-11-20T02:27:39.256ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28362024-11-20T02:27:39.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63082 req_id = eae6d2ec-9d4e-47da-88cb-7401f954a3dd response_code = 200 uri = /network-bootstore-config
28372024-11-20T02:27:39.261ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28382024-11-20T02:27:39.262ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_9529683f-e460-4948-a032-9f2d5e49707f
28392024-11-20T02:27:39.279ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28402024-11-20T02:27:39.279ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83
28412024-11-20T02:27:39.295ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3512857a-ab87-49e5-8a00-5418fbf6ac17 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28422024-11-20T02:27:39.299ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3512857a-ab87-49e5-8a00-5418fbf6ac17
28432024-11-20T02:27:39.305ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28442024-11-20T02:27:39.316ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28452024-11-20T02:27:39.317ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30
28462024-11-20T02:27:39.347ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3a2d0809-94fd-45cc-ba0b-a34ecb38eda4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28472024-11-20T02:27:39.347ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3a2d0809-94fd-45cc-ba0b-a34ecb38eda4
28482024-11-20T02:27:39.363ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28492024-11-20T02:27:39.363ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6
28502024-11-20T02:27:39.382ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28512024-11-20T02:27:39.382ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83
28522024-11-20T02:27:39.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43266
28532024-11-20T02:27:39.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 444862 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64074 req_id = 7906fce9-b43a-478e-8ef7-4455b33dbf18 response_code = 200 uri = /inventory
28542024-11-20T02:27:39.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132327 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41939 req_id = 1d933a2e-370c-4387-868d-2ffedc4fd201 response_code = 204 uri = /switch-ports
28552024-11-20T02:27:39.388ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5453ee1f-57a7-421a-ac7a-aeadfec775af, kind: Service { id: 9fe4351b-e265-4106-87d1-05131cb21015 }, name: Name("external-dns-9fe4351b-e265-4106-87d1-05131cb21015"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 96f9a48c-c388-4220-877c-a9d42b5b2ce6, kind: Service { id: 66a399b7-22f3-4a37-9012-cc8bfd88683c }, name: Name("external-dns-66a399b7-22f3-4a37-9012-cc8bfd88683c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 62])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 95387cb2-af36-4182-823a-33142ebf39fb, kind: Service { id: 4585f7b5-dbc1-4a10-8096-3ca4a94d621f }, name: Name("nexus-4585f7b5-dbc1-4a10-8096-3ca4a94d621f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d0b2fc5b-7e3c-40a6-a04a-2e1177025aea, kind: Service { id: c85c19d7-e1ed-418c-891f-6c69a7a89369 }, name: Name("nexus-c85c19d7-e1ed-418c-891f-6c69a7a89369"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e0308b00-0621-4743-b22f-30c9625834fc, kind: Service { id: 1b0321a7-e87f-4d37-98f5-c9bde7249e7c }, name: Name("nexus-1b0321a7-e87f-4d37-98f5-c9bde7249e7c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28562024-11-20T02:27:39.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28572024-11-20T02:27:39.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28582024-11-20T02:27:39.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28592024-11-20T02:27:39.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28602024-11-20T02:27:39.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28612024-11-20T02:27:39.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28622024-11-20T02:27:39.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43266 req_id = 1ee4af0d-0ae6-4343-b27a-1c43d8efcbbb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28632024-11-20T02:27:39.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41939 req_id = c2cce2ec-2441-46b6-abcf-dd60e1461ccb response_code = 200 uri = /network-bootstore-config
28642024-11-20T02:27:39.397ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28652024-11-20T02:27:39.397ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc
28662024-11-20T02:27:39.426ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98cd316b-55e2-4c2d-813f-e4caae970d59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28672024-11-20T02:27:39.426ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_98cd316b-55e2-4c2d-813f-e4caae970d59
28682024-11-20T02:27:39.441ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28692024-11-20T02:27:39.441ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6
28702024-11-20T02:27:39.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 484603 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38697 req_id = a8cc7df9-f1e8-40be-99f2-bf9202bb3865 response_code = 200 uri = /inventory
28712024-11-20T02:27:39.460ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 841052f1-d4ff-4743-9006-a66dddb621f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28722024-11-20T02:27:39.460ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_841052f1-d4ff-4743-9006-a66dddb621f3
28732024-11-20T02:27:39.491ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9529683f-e460-4948-a032-9f2d5e49707f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28742024-11-20T02:27:39.491ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_9529683f-e460-4948-a032-9f2d5e49707f
28752024-11-20T02:27:39.521ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b905cd08-9ec5-42bd-890c-f6f56b8d0c30 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28762024-11-20T02:27:39.521ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b905cd08-9ec5-42bd-890c-f6f56b8d0c30
28772024-11-20T02:27:39.551ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bc9c41cc-acd9-44d4-93a2-6b2f4b235d83 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28782024-11-20T02:27:39.551ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_bc9c41cc-acd9-44d4-93a2-6b2f4b235d83
28792024-11-20T02:27:39.581ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad4fdfcc-eca4-445d-9c4d-891cf07f57c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28802024-11-20T02:27:39.581ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_ad4fdfcc-eca4-445d-9c4d-891cf07f57c6
28812024-11-20T02:27:39.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 373417 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44386 req_id = a5e38d2f-f658-45c8-b455-9d27f20834ff response_code = 200 uri = /inventory
28822024-11-20T02:27:39.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28832024-11-20T02:27:39.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28842024-11-20T02:27:42.500ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28852024-11-20T02:27:42.500ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28862024-11-20T02:27:42.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28872024-11-20T02:27:42.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28882024-11-20T02:27:42.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28892024-11-20T02:27:42.503ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28902024-11-20T02:27:42.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28912024-11-20T02:27:42.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28922024-11-20T02:27:42.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28932024-11-20T02:27:42.898ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28942024-11-20T02:27:45.470ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28952024-11-20T02:27:45.720ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28962024-11-20T02:27:45.721ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28972024-11-20T02:27:45.721ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
28982024-11-20T02:27:46.704ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33697
28992024-11-20T02:27:46.704ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33697 req_id = 8ddd60be-3864-4a1a-a7c1-dcf8d58e040d response_code = 200 uri = /baseboard
29002024-11-20T02:27:48.298ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29012024-11-20T02:27:48.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29022024-11-20T02:27:49.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29032024-11-20T02:27:49.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29042024-11-20T02:27:52.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29052024-11-20T02:27:52.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29062024-11-20T02:27:52.506ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29072024-11-20T02:27:52.506ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29082024-11-20T02:27:52.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29092024-11-20T02:27:52.508ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29102024-11-20T02:27:52.508ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29112024-11-20T02:27:52.509ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29122024-11-20T02:27:52.510ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29132024-11-20T02:27:52.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29142024-11-20T02:27:55.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29152024-11-20T02:27:55.723ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29162024-11-20T02:27:55.723ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29172024-11-20T02:27:55.724ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29182024-11-20T02:27:58.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29192024-11-20T02:27:58.302ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29202024-11-20T02:27:59.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29212024-11-20T02:27:59.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29222024-11-20T02:28:02.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29232024-11-20T02:28:02.508ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29242024-11-20T02:28:02.509ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29252024-11-20T02:28:02.510ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29262024-11-20T02:28:02.511ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29272024-11-20T02:28:02.511ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29282024-11-20T02:28:02.512ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29292024-11-20T02:28:02.513ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29302024-11-20T02:28:02.513ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29312024-11-20T02:28:02.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29322024-11-20T02:28:05.475ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29332024-11-20T02:28:05.725ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29342024-11-20T02:28:05.726ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29352024-11-20T02:28:05.727ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29362024-11-20T02:28:08.304ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29372024-11-20T02:28:08.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29382024-11-20T02:28:08.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35591
29392024-11-20T02:28:08.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35591 req_id = 67f66a91-5223-46c6-aab5-bce2c69cba91 response_code = 200 uri = /vpc-routes
29402024-11-20T02:28:08.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58542
29412024-11-20T02:28:08.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58542 req_id = 97620a4f-497f-4bdd-bd25-a8164738c595 response_code = 200 uri = /vpc-routes
29422024-11-20T02:28:08.639ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
29432024-11-20T02:28:08.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35591 req_id = d48c9fc7-e1ce-4311-874b-3fba71692426 response_code = 204 uri = /eip-gateways
29442024-11-20T02:28:08.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35591 req_id = 2e1af056-e475-40d8-bab9-c4a816a0fd69 response_code = 204 uri = /vpc-routes
29452024-11-20T02:28:08.658ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
29462024-11-20T02:28:08.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58542 req_id = 4ef0da58-17a4-41ec-b9f6-d6e4e7216b2e response_code = 204 uri = /eip-gateways
29472024-11-20T02:28:08.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58542 req_id = 6c91d4ed-5752-423c-b1ee-fb819dd5475e response_code = 204 uri = /vpc-routes
29482024-11-20T02:28:08.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44854
29492024-11-20T02:28:08.701ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29502024-11-20T02:28:08.751ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29512024-11-20T02:28:08.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116118 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44854 req_id = 071a9476-d15d-4dd7-8e08-421eb2742614 response_code = 204 uri = /switch-ports
29522024-11-20T02:28:08.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61334
29532024-11-20T02:28:08.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41345
29542024-11-20T02:28:08.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45065
29552024-11-20T02:28:08.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45065 req_id = 3531c763-95fc-4f95-937d-eb1ae3308d53 response_code = 200 uri = /v2p
29562024-11-20T02:28:08.817ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29572024-11-20T02:28:08.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61334 req_id = 90b81abd-bdd2-4469-b78d-e0b9f2be789a response_code = 200 uri = /v2p
29582024-11-20T02:28:08.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44854 req_id = 64be733c-df2f-47f0-a425-e07f4c949ecd response_code = 200 uri = /network-bootstore-config
29592024-11-20T02:28:08.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29602024-11-20T02:28:08.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96057 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41345 req_id = c9a69d57-3627-4a8f-b336-a55a53530157 response_code = 204 uri = /switch-ports
29612024-11-20T02:28:08.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41345 req_id = 40b21675-2f6b-421e-9c96-c2cb0a6449d9 response_code = 200 uri = /network-bootstore-config
29622024-11-20T02:28:09.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33817
29632024-11-20T02:28:09.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33817 req_id = bb1976c3-3991-4d04-960e-c16c87766766 response_code = 200 uri = /vpc-routes
29642024-11-20T02:28:09.069ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
29652024-11-20T02:28:09.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33817 req_id = 5aee2bac-05b5-45dd-83cd-3cce3cf2bc5d response_code = 204 uri = /eip-gateways
29662024-11-20T02:28:09.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33817 req_id = 22cb9a27-64f3-4785-aefe-f1e63692f0fb response_code = 204 uri = /vpc-routes
29672024-11-20T02:28:09.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59865
29682024-11-20T02:28:09.087ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29692024-11-20T02:28:09.129ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29702024-11-20T02:28:09.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106149 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59865 req_id = 5b9f6a03-eb5c-4fb2-b3f0-f22b28a387ab response_code = 204 uri = /switch-ports
29712024-11-20T02:28:09.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62846
29722024-11-20T02:28:09.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59865 req_id = 15c2da43-15d5-4eee-9a92-029414a161a2 response_code = 200 uri = /network-bootstore-config
29732024-11-20T02:28:09.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62846 req_id = 29574aa9-c25c-4380-8513-f81d8ac5303d response_code = 200 uri = /v2p
29742024-11-20T02:28:09.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29752024-11-20T02:28:09.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29762024-11-20T02:28:12.511ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29772024-11-20T02:28:12.512ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29782024-11-20T02:28:12.513ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29792024-11-20T02:28:12.514ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29802024-11-20T02:28:12.514ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29812024-11-20T02:28:12.515ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29822024-11-20T02:28:12.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29832024-11-20T02:28:12.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29842024-11-20T02:28:12.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29852024-11-20T02:28:12.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29862024-11-20T02:28:15.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29872024-11-20T02:28:15.727ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29882024-11-20T02:28:15.728ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29892024-11-20T02:28:15.729ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29902024-11-20T02:28:16.737ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35204
29912024-11-20T02:28:16.737ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35204 req_id = ec502d17-5f4a-4592-a48e-c1b2970ad878 response_code = 200 uri = /baseboard
29922024-11-20T02:28:18.308ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29932024-11-20T02:28:18.308ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29942024-11-20T02:28:19.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29952024-11-20T02:28:19.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29962024-11-20T02:28:22.516ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29972024-11-20T02:28:22.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29982024-11-20T02:28:22.517ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
29992024-11-20T02:28:22.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30002024-11-20T02:28:22.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30012024-11-20T02:28:22.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30022024-11-20T02:28:22.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30032024-11-20T02:28:22.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30042024-11-20T02:28:22.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30052024-11-20T02:28:22.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30062024-11-20T02:28:25.480ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30072024-11-20T02:28:25.729ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30082024-11-20T02:28:25.730ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30092024-11-20T02:28:25.731ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30102024-11-20T02:28:28.313ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30112024-11-20T02:28:28.313ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30122024-11-20T02:28:29.951ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30132024-11-20T02:28:29.952ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30142024-11-20T02:28:32.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30152024-11-20T02:28:32.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30162024-11-20T02:28:32.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30172024-11-20T02:28:32.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30182024-11-20T02:28:32.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30192024-11-20T02:28:32.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30202024-11-20T02:28:32.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30212024-11-20T02:28:32.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30222024-11-20T02:28:32.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30232024-11-20T02:28:32.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30242024-11-20T02:28:35.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30252024-11-20T02:28:35.732ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30262024-11-20T02:28:35.732ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30272024-11-20T02:28:35.733ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30282024-11-20T02:28:38.318ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30292024-11-20T02:28:38.319ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30302024-11-20T02:28:38.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44949
30312024-11-20T02:28:38.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44949 req_id = f5d100c7-5e9f-4528-ab14-ee66c72d787a response_code = 200 uri = /vpc-routes
30322024-11-20T02:28:38.748ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
30332024-11-20T02:28:38.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44949 req_id = ac154f1a-2ebc-4961-9a53-67ce0c1b26c5 response_code = 204 uri = /eip-gateways
30342024-11-20T02:28:38.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44949 req_id = 1c9fe25d-52a9-4db2-871a-db6b3166cf05 response_code = 204 uri = /vpc-routes
30352024-11-20T02:28:38.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36626
30362024-11-20T02:28:38.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36626 req_id = 6d6d8b4a-311c-477b-bc8a-0d0f09aba3c0 response_code = 200 uri = /v2p
30372024-11-20T02:28:38.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39906
30382024-11-20T02:28:38.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39906 req_id = d61526d8-9eb0-4ea0-8ed5-eb96b556e16d response_code = 200 uri = /vpc-routes
30392024-11-20T02:28:38.850ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
30402024-11-20T02:28:38.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39906 req_id = 1112ed2c-8261-4a27-bc60-3d9d0916b893 response_code = 204 uri = /eip-gateways
30412024-11-20T02:28:38.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34930
30422024-11-20T02:28:38.857ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
30432024-11-20T02:28:38.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
30442024-11-20T02:28:38.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115394 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34930 req_id = 168e9574-13e8-4287-bf5e-795772a148c8 response_code = 204 uri = /switch-ports
30452024-11-20T02:28:38.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46802
30462024-11-20T02:28:38.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46802 req_id = b440b702-f07d-45ed-bc43-f09636f454ac response_code = 200 uri = /vpc-routes
30472024-11-20T02:28:38.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34930 req_id = 509c5cdf-e4f6-4563-a919-affa9e09d7ed response_code = 200 uri = /network-bootstore-config
30482024-11-20T02:28:38.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 423 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39906 req_id = 9e96ff5c-a7fc-46ec-97c7-bb210f511bf2 response_code = 204 uri = /vpc-routes
30492024-11-20T02:28:39.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35246
30502024-11-20T02:28:39.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35246 req_id = ed2555a7-1971-4a6d-8623-f96810ed2774 response_code = 200 uri = /v2p
30512024-11-20T02:28:39.023ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
30522024-11-20T02:28:39.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46802 req_id = 3860eff4-3ac0-4d34-b297-47a6b2ea813e response_code = 204 uri = /eip-gateways
30532024-11-20T02:28:39.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33135
30542024-11-20T02:28:39.024ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
30552024-11-20T02:28:39.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
30562024-11-20T02:28:39.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103403 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33135 req_id = a17d3eee-e7e7-4d40-8ff4-fcad3cfe02e7 response_code = 204 uri = /switch-ports
30572024-11-20T02:28:39.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46802 req_id = 15871c1a-adaa-4eef-bb46-7724dea44912 response_code = 204 uri = /vpc-routes
30582024-11-20T02:28:39.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33135 req_id = 65a986f7-a65c-4bcb-a243-a20991af70ba response_code = 200 uri = /network-bootstore-config
30592024-11-20T02:28:39.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36275
30602024-11-20T02:28:39.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36275 req_id = 94f43389-5ab7-411d-9eb4-0736d31d75f4 response_code = 200 uri = /v2p
30612024-11-20T02:28:39.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33332
30622024-11-20T02:28:39.247ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
30632024-11-20T02:28:39.288ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
30642024-11-20T02:28:39.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96675 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33332 req_id = c7a5f750-d359-48e3-9149-c3f2504ee1f6 response_code = 204 uri = /switch-ports
30652024-11-20T02:28:39.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33332 req_id = f117c1d7-2d5c-493f-89e3-4bdad0c784d2 response_code = 200 uri = /network-bootstore-config
30662024-11-20T02:28:39.954ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30672024-11-20T02:28:39.954ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30682024-11-20T02:28:42.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30692024-11-20T02:28:42.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30702024-11-20T02:28:42.526ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30712024-11-20T02:28:42.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30722024-11-20T02:28:42.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30732024-11-20T02:28:42.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30742024-11-20T02:28:42.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30752024-11-20T02:28:42.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30762024-11-20T02:28:42.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30772024-11-20T02:28:42.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30782024-11-20T02:28:45.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30792024-11-20T02:28:45.733ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30802024-11-20T02:28:45.734ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30812024-11-20T02:28:45.735ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30822024-11-20T02:28:46.769ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35781
30832024-11-20T02:28:46.769ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35781 req_id = 27a5c3a7-d7b2-4109-bb1e-a702dc7a75a6 response_code = 200 uri = /baseboard
30842024-11-20T02:28:48.322ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30852024-11-20T02:28:48.323ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30862024-11-20T02:28:49.956ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30872024-11-20T02:28:49.957ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30882024-11-20T02:28:52.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30892024-11-20T02:28:52.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30902024-11-20T02:28:52.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30912024-11-20T02:28:52.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30922024-11-20T02:28:52.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30932024-11-20T02:28:52.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30942024-11-20T02:28:52.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30952024-11-20T02:28:52.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30962024-11-20T02:28:52.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30972024-11-20T02:28:52.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30982024-11-20T02:28:55.487ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
30992024-11-20T02:28:55.736ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31002024-11-20T02:28:55.736ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31012024-11-20T02:28:55.737ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31022024-11-20T02:28:58.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31032024-11-20T02:28:58.327ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31042024-11-20T02:28:59.958ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31052024-11-20T02:28:59.959ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31062024-11-20T02:29:02.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31072024-11-20T02:29:02.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31082024-11-20T02:29:02.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31092024-11-20T02:29:02.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31102024-11-20T02:29:02.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31112024-11-20T02:29:02.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31122024-11-20T02:29:02.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31132024-11-20T02:29:02.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31142024-11-20T02:29:02.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31152024-11-20T02:29:02.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31162024-11-20T02:29:05.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31172024-11-20T02:29:05.738ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31182024-11-20T02:29:05.738ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31192024-11-20T02:29:05.739ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31202024-11-20T02:29:08.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31212024-11-20T02:29:08.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31222024-11-20T02:29:08.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64397
31232024-11-20T02:29:08.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64397 req_id = 7d9f3dcd-69ff-4d0f-9f98-4c18125d8024 response_code = 200 uri = /vpc-routes
31242024-11-20T02:29:08.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62131
31252024-11-20T02:29:08.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62131 req_id = 34ea34b2-8c33-4753-bd40-6e2686b6bbed response_code = 200 uri = /vpc-routes
31262024-11-20T02:29:08.607ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
31272024-11-20T02:29:08.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62131 req_id = 796a4a71-37eb-476e-aded-1b802d1dcb26 response_code = 204 uri = /eip-gateways
31282024-11-20T02:29:08.607ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
31292024-11-20T02:29:08.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64397 req_id = ea18f036-93eb-40ca-ad66-70e3c88b19d3 response_code = 204 uri = /eip-gateways
31302024-11-20T02:29:08.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62131 req_id = 81131750-032f-4eb9-b9b3-f024d55296a4 response_code = 204 uri = /vpc-routes
31312024-11-20T02:29:08.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64397 req_id = 4957681c-5fc1-4862-9eff-7668ca7c47d5 response_code = 204 uri = /vpc-routes
31322024-11-20T02:29:08.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49532
31332024-11-20T02:29:08.622ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
31342024-11-20T02:29:08.681ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
31352024-11-20T02:29:08.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131351 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49532 req_id = 7fe0f108-df13-4c59-b838-fa070d4dd9c1 response_code = 204 uri = /switch-ports
31362024-11-20T02:29:08.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62209
31372024-11-20T02:29:08.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53534
31382024-11-20T02:29:08.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53534 req_id = a56ba29d-6609-45eb-8b8c-7cb69208ca2f response_code = 200 uri = /v2p
31392024-11-20T02:29:08.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49532 req_id = 561da9c9-85ae-466a-b66d-379129fe2a25 response_code = 200 uri = /network-bootstore-config
31402024-11-20T02:29:08.754ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
31412024-11-20T02:29:08.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36566
31422024-11-20T02:29:08.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36566 req_id = 167e2d55-82ca-4651-86a1-0c21138545bc response_code = 200 uri = /v2p
31432024-11-20T02:29:08.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51443
31442024-11-20T02:29:08.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51443 req_id = bd462692-1600-4e81-bd30-3fcb31d6d695 response_code = 200 uri = /vpc-routes
31452024-11-20T02:29:08.794ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
31462024-11-20T02:29:08.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
31472024-11-20T02:29:08.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 719 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51443 req_id = 37157aba-e1d6-4cac-9cca-1efeae3112f3 response_code = 204 uri = /eip-gateways
31482024-11-20T02:29:08.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51443 req_id = 77433928-934f-470e-9a07-146feec3c3ad response_code = 204 uri = /vpc-routes
31492024-11-20T02:29:08.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120311 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62209 req_id = 6700f2d3-a61b-48a9-9285-90ea5b32a5e8 response_code = 204 uri = /switch-ports
31502024-11-20T02:29:08.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62209 req_id = fc748c0b-ba0c-4ecb-9c55-6bf23d3f1316 response_code = 200 uri = /network-bootstore-config
31512024-11-20T02:29:08.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46308
31522024-11-20T02:29:08.979ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
31532024-11-20T02:29:09.023ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
31542024-11-20T02:29:09.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107040 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46308 req_id = 8d87e781-b103-4cb1-a231-2302cbfb9568 response_code = 204 uri = /switch-ports
31552024-11-20T02:29:09.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41127
31562024-11-20T02:29:09.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46308 req_id = ddb20a59-91ec-4110-9d14-63814e3ab084 response_code = 200 uri = /network-bootstore-config
31572024-11-20T02:29:09.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41127 req_id = d0daa501-a6cd-49d8-b059-a04a8b51fa55 response_code = 200 uri = /v2p
31582024-11-20T02:29:09.961ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31592024-11-20T02:29:09.962ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31602024-11-20T02:29:12.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31612024-11-20T02:29:12.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31622024-11-20T02:29:12.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31632024-11-20T02:29:12.538ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31642024-11-20T02:29:12.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31652024-11-20T02:29:12.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31662024-11-20T02:29:12.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31672024-11-20T02:29:12.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31682024-11-20T02:29:12.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31692024-11-20T02:29:12.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31702024-11-20T02:29:15.493ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31712024-11-20T02:29:15.740ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31722024-11-20T02:29:15.741ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31732024-11-20T02:29:15.741ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31742024-11-20T02:29:16.801ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39747
31752024-11-20T02:29:16.802ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39747 req_id = 355bc15d-69a6-4608-a6c9-a9e2fa8e00a5 response_code = 200 uri = /baseboard
31762024-11-20T02:29:18.334ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31772024-11-20T02:29:18.335ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31782024-11-20T02:29:19.964ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31792024-11-20T02:29:19.964ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31802024-11-20T02:29:22.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31812024-11-20T02:29:22.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31822024-11-20T02:29:22.542ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31832024-11-20T02:29:22.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31842024-11-20T02:29:22.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31852024-11-20T02:29:22.544ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31862024-11-20T02:29:22.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31872024-11-20T02:29:22.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31882024-11-20T02:29:22.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31892024-11-20T02:29:22.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31902024-11-20T02:29:25.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31912024-11-20T02:29:25.742ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31922024-11-20T02:29:25.743ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31932024-11-20T02:29:25.744ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31942024-11-20T02:29:28.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31952024-11-20T02:29:28.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31962024-11-20T02:29:29.966ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31972024-11-20T02:29:29.966ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31982024-11-20T02:29:32.545ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
31992024-11-20T02:29:32.546ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32002024-11-20T02:29:32.547ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32012024-11-20T02:29:32.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32022024-11-20T02:29:32.548ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32032024-11-20T02:29:32.549ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32042024-11-20T02:29:32.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32052024-11-20T02:29:32.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32062024-11-20T02:29:32.551ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32072024-11-20T02:29:32.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32082024-11-20T02:29:34.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43017
32092024-11-20T02:29:34.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43017 req_id = 90f1c657-870d-4295-a250-8be907ca3383 response_code = 200 uri = /v2p
32102024-11-20T02:29:34.719ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6865208) }
32112024-11-20T02:29:34.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43017 req_id = 74b85a2c-430e-4207-91e2-db08ab756fe7 response_code = 204 uri = /v2p
32122024-11-20T02:29:34.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63125
32132024-11-20T02:29:34.842ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a8722d6f-62ca-4629-9b2d-c6865732534f, kind: Instance { id: d36a31d3-3683-440b-a45f-ff56dbce0fc4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6865208), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a8722d6f-62ca-4629-9b2d-c6865732534f, kind: Instance { id: d36a31d3-3683-440b-a45f-ff56dbce0fc4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6865208), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a8722d6f-62ca-4629-9b2d-c6865732534f, kind: Instance { id: d36a31d3-3683-440b-a45f-ff56dbce0fc4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6865208), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6865208))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a8722d6f-62ca-4629-9b2d-c6865732534f, kind: Instance { id: d36a31d3-3683-440b-a45f-ff56dbce0fc4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6865208), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-aa1b8be0db0", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 7f0f21a7-73bb-47cd-8213-a1497cecfb3e, read_only_parent: Some(Volume { block_size: 512, id: 6f365dbb-95df-4013-9fbf-1eb650e1a66d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: d407ae57-ee89-43f1-a6d0-43d421ed3814, key: Some("m53KQqopxLbLtTZvbYpQEbDmEFwBHBDXOT6M1E5EwEg="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::19]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7f0f21a7-73bb-47cd-8213-a1497cecfb3e, key: Some("WhaKEUwsjDhT96V3LFD/llE4lxfOIwCfOqqp73gXBQc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19003", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::16]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-aa1b8be0db0" }] }), cloud_init_bytes: Some(..) } instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 metadata = InstanceMetadata { silo_id: 006e84ee-6eef-451c-ac77-57423d4cdd4d, project_id: 34558c23-7f50-43f6-b2b7-182a6a7b745c } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-20T02:29:34.827079509Z }
32142024-11-20T02:29:34.842ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 migration_id = None propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32152024-11-20T02:29:34.842ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 migration_id = None propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a8722d6f-62ca-4629-9b2d-c6865732534f, kind: Instance { id: d36a31d3-3683-440b-a45f-ff56dbce0fc4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6865208), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a8722d6f-62ca-4629-9b2d-c6865732534f, kind: Instance { id: d36a31d3-3683-440b-a45f-ff56dbce0fc4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6865208), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a8722d6f-62ca-4629-9b2d-c6865732534f, kind: Instance { id: d36a31d3-3683-440b-a45f-ff56dbce0fc4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6865208), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6865208))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a8722d6f-62ca-4629-9b2d-c6865732534f, kind: Instance { id: d36a31d3-3683-440b-a45f-ff56dbce0fc4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6865208), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-aa1b8be0db0", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 7f0f21a7-73bb-47cd-8213-a1497cecfb3e, read_only_parent: Some(Volume { block_size: 512, id: 6f365dbb-95df-4013-9fbf-1eb650e1a66d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: d407ae57-ee89-43f1-a6d0-43d421ed3814, key: Some("m53KQqopxLbLtTZvbYpQEbDmEFwBHBDXOT6M1E5EwEg="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::19]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7f0f21a7-73bb-47cd-8213-a1497cecfb3e, key: Some("WhaKEUwsjDhT96V3LFD/llE4lxfOIwCfOqqp73gXBQc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19003", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::16]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-aa1b8be0db0" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-20T02:29:34.827079509Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
32162024-11-20T02:29:34.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20781 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63125 req_id = 61fc5df5-6c09-4dc7-aedb-bd7b402c77cc response_code = 200 uri = /vmms/d8b4601e-e1fd-4135-bd59-259e8f151b60
32172024-11-20T02:29:34.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55482
32182024-11-20T02:29:34.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1595 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55482 req_id = dbdf1698-be6e-4b6f-b4c8-9a464af4eaff response_code = 200 uri = /vmms/d8b4601e-e1fd-4135-bd59-259e8f151b60/state
32192024-11-20T02:29:34.976ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 6865208 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
32202024-11-20T02:29:34.976ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
32212024-11-20T02:29:35.021ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60 file = illumos-utils/src/zone.rs:325 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32222024-11-20T02:29:35.045ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60 file = illumos-utils/src/zone.rs:363 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32232024-11-20T02:29:35.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60348
32242024-11-20T02:29:35.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60348 req_id = ad39fa3f-42b4-4c8f-8c56-74a0858dbdf9 response_code = 200 uri = /vpc-routes
32252024-11-20T02:29:35.070ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {a8722d6f-62ca-4629-9b2d-c6865732534f: {10.151.1.176: {b8a1b4ea-69be-4065-b78a-d37956b836e5}, 10.151.1.175: {b8a1b4ea-69be-4065-b78a-d37956b836e5}}} }
32262024-11-20T02:29:35.498ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32272024-11-20T02:29:35.745ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32282024-11-20T02:29:35.746ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32292024-11-20T02:29:35.747ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32302024-11-20T02:29:36.769ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32312024-11-20T02:29:36.769ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60 zone file = illumos-utils/src/running_zone.rs:488 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 zone = oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60
32322024-11-20T02:29:36.952ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 39.851073ms file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 zone = oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60
32332024-11-20T02:29:37.006ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 79.137664ms file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 zone = oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60
32342024-11-20T02:29:37.133ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 177.821154ms file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 zone = oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60
32352024-11-20T02:29:37.330ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 427.463217ms file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 zone = oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60
32362024-11-20T02:29:37.771ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 442.367773ms file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 zone = oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60
32372024-11-20T02:29:38.230ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 1.425029826s file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 zone = oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60
32382024-11-20T02:29:38.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32392024-11-20T02:29:38.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32402024-11-20T02:29:38.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42372
32412024-11-20T02:29:38.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35521
32422024-11-20T02:29:38.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38863
32432024-11-20T02:29:38.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54545
32442024-11-20T02:29:38.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54545 req_id = ec3e819d-5c18-4c40-a7f5-71bb61418a28 response_code = 200 uri = /vpc-routes
32452024-11-20T02:29:38.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {a8722d6f-62ca-4629-9b2d-c6865732534f: {10.151.1.176: {b8a1b4ea-69be-4065-b78a-d37956b836e5}, 10.151.1.175: {b8a1b4ea-69be-4065-b78a-d37956b836e5}}} }
32462024-11-20T02:29:38.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54545 req_id = e4a0123e-7cd9-4074-b1a3-5ccccc2d481c response_code = 204 uri = /eip-gateways
32472024-11-20T02:29:38.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59997
32482024-11-20T02:29:38.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59997 req_id = a03bc8fd-c3fe-4a6e-b5c4-3baf85bef5b6 response_code = 200 uri = /v2p
32492024-11-20T02:29:38.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62462
32502024-11-20T02:29:38.994ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
32512024-11-20T02:29:39.043ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
32522024-11-20T02:29:39.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118092 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62462 req_id = 0977c746-c104-4b66-a3b4-e77c2c748b38 response_code = 204 uri = /switch-ports
32532024-11-20T02:29:39.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58942
32542024-11-20T02:29:39.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61842
32552024-11-20T02:29:39.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61239
32562024-11-20T02:29:39.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63049
32572024-11-20T02:29:39.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62462 req_id = c4fd81b5-d686-4413-a0c2-3d6048e2871d response_code = 200 uri = /network-bootstore-config
32582024-11-20T02:29:39.113ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
32592024-11-20T02:29:39.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 786 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54545 req_id = 25368145-3bd6-48e6-9a0f-5b2ddd9979e1 response_code = 204 uri = /vpc-routes
32602024-11-20T02:29:39.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61239 req_id = 03cbdc5f-751e-455a-beef-0ab0c1b58be5 response_code = 200 uri = /v2p
32612024-11-20T02:29:39.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61842 req_id = 3909e190-9f19-437e-ae48-fee03880c0a0 response_code = 200 uri = /vpc-routes
32622024-11-20T02:29:39.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7491 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63049 req_id = 5be81871-2f3c-4823-b9b6-9fb31a4e0414 response_code = 200 uri = /v2p
32632024-11-20T02:29:39.159ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
32642024-11-20T02:29:39.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63938
32652024-11-20T02:29:39.168ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {a8722d6f-62ca-4629-9b2d-c6865732534f: {10.151.1.176: {b8a1b4ea-69be-4065-b78a-d37956b836e5}, 10.151.1.175: {b8a1b4ea-69be-4065-b78a-d37956b836e5}}} }
32662024-11-20T02:29:39.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61842 req_id = f97d9140-426e-4df1-88a3-5f6348bf3768 response_code = 204 uri = /eip-gateways
32672024-11-20T02:29:39.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 933 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61842 req_id = 0c1fdd17-87a9-40dd-8d9c-9e6c8fd40b06 response_code = 204 uri = /vpc-routes
32682024-11-20T02:29:39.220ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
32692024-11-20T02:29:39.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106827 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58942 req_id = 891b839e-cd46-43a1-87ca-79a42577c6ac response_code = 204 uri = /switch-ports
32702024-11-20T02:29:39.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58942 req_id = 0144604c-ffeb-4d9c-8548-582e02206cf0 response_code = 200 uri = /network-bootstore-config
32712024-11-20T02:29:39.258ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
32722024-11-20T02:29:39.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152874 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63938 req_id = ebd2b0d0-ce8d-44a6-af1d-57a975fb6f02 response_code = 204 uri = /switch-ports
32732024-11-20T02:29:39.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63938 req_id = 029b5e6f-ac52-482c-8eae-1e113e25ead4 response_code = 200 uri = /network-bootstore-config
32742024-11-20T02:29:39.669ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 1.219063429s file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 zone = oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60
32752024-11-20T02:29:39.967ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32762024-11-20T02:29:39.968ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32772024-11-20T02:29:40.900ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 1.488839452s file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 zone = oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60
32782024-11-20T02:29:42.419ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60 file = sled-agent/src/instance.rs:1787 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32792024-11-20T02:29:42.429ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 47.958669ms file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32802024-11-20T02:29:42.487ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 60.027657ms file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32812024-11-20T02:29:42.550ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32822024-11-20T02:29:42.558ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32832024-11-20T02:29:42.559ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32842024-11-20T02:29:42.560ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32852024-11-20T02:29:42.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32862024-11-20T02:29:42.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32872024-11-20T02:29:42.562ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32882024-11-20T02:29:42.563ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32892024-11-20T02:29:42.564ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60") failed: Property not found. retry in 114.325935ms file = illumos-utils/src/svc.rs:36 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32902024-11-20T02:29:42.564ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32912024-11-20T02:29:42.691ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32922024-11-20T02:29:42.727ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32932024-11-20T02:29:42.864ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
32942024-11-20T02:29:42.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4060478 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42372 req_id = 512ffa1c-44d8-404a-88ad-6e09438aa62a response_code = 200 uri = /vmms/d8b4601e-e1fd-4135-bd59-259e8f151b60/state
32952024-11-20T02:29:42.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4023936 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38863 req_id = 2534711e-bba0-4410-9d72-2042c5fc57ac response_code = 200 uri = /vmms/d8b4601e-e1fd-4135-bd59-259e8f151b60/state
32962024-11-20T02:29:42.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4055449 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35521 req_id = ee37746c-6811-465f-9b65-482d388b4c51 response_code = 200 uri = /vmms/d8b4601e-e1fd-4135-bd59-259e8f151b60/state
32972024-11-20T02:29:42.865ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
32982024-11-20T02:29:42.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7795260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60348 req_id = db71a37b-02d6-470c-b801-c45bca43ed46 response_code = 204 uri = /eip-gateways
32992024-11-20T02:29:42.866ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-20T02:29:42.866327103Z } file = sled-agent/src/instance.rs:780 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33002024-11-20T02:29:42.866ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-20T02:29:42.866327103Z } propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33012024-11-20T02:29:42.866ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-20T02:29:42.866327103Z }, migration_in: None, migration_out: None }
33022024-11-20T02:29:42.911ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-20T02:29:42.911370081Z } file = sled-agent/src/instance.rs:780 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33032024-11-20T02:29:42.911ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-20T02:29:42.911370081Z } propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33042024-11-20T02:29:42.911ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-20T02:29:42.911370081Z }, migration_in: None, migration_out: None }
33052024-11-20T02:29:42.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33062024-11-20T02:29:42.944ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 1e67dd2a-09de-4ddf-8d11-b27321d10782, version: 3 } old_vers = RouterVersion { router_id: 1e67dd2a-09de-4ddf-8d11-b27321d10782, version: 3 } subnet = RouterId { vni: Vni(6865208), kind: System }
33072024-11-20T02:29:42.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60348 req_id = 8f21ea01-0904-45eb-9f22-551c50d54f38 response_code = 204 uri = /vpc-routes
33082024-11-20T02:29:42.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41558
33092024-11-20T02:29:42.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41558 req_id = f5d25d38-6238-494d-94fc-780cc91d8470 response_code = 200 uri = /vpc-routes
33102024-11-20T02:29:43.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {a8722d6f-62ca-4629-9b2d-c6865732534f: {10.151.1.176: {b8a1b4ea-69be-4065-b78a-d37956b836e5}, 10.151.1.175: {b8a1b4ea-69be-4065-b78a-d37956b836e5}}} }
33112024-11-20T02:29:43.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41558 req_id = 2b61822b-0a0f-4791-b9f2-694ce50b513d response_code = 204 uri = /eip-gateways
33122024-11-20T02:29:43.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41558 req_id = b5e047dc-01ba-4b95-b807-6c6a0d53de24 response_code = 204 uri = /vpc-routes
33132024-11-20T02:29:45.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33142024-11-20T02:29:45.748ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33152024-11-20T02:29:45.749ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33162024-11-20T02:29:45.749ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33172024-11-20T02:29:46.835ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49580
33182024-11-20T02:29:46.835ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49580 req_id = a02840d1-efcb-411f-b48b-ca28b489b00c response_code = 200 uri = /baseboard
33192024-11-20T02:29:48.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33202024-11-20T02:29:48.348ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33212024-11-20T02:29:49.970ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33222024-11-20T02:29:49.971ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33232024-11-20T02:29:52.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44524
33242024-11-20T02:29:52.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44524 req_id = 7c2dffeb-9438-4246-9b54-fcc02f2b3cd9 response_code = 200 uri = /vmms/d8b4601e-e1fd-4135-bd59-259e8f151b60/state
33252024-11-20T02:29:52.406ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-20T02:29:52.406514175Z } file = sled-agent/src/instance.rs:780 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33262024-11-20T02:29:52.406ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-20T02:29:52.406514175Z } propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33272024-11-20T02:29:52.406ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-20T02:29:52.406514175Z }, migration_in: None, migration_out: None }
33282024-11-20T02:29:52.448ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-20T02:29:52.448622730Z } file = sled-agent/src/instance.rs:780 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33292024-11-20T02:29:52.448ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-20T02:29:52.448622730Z } propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33302024-11-20T02:29:52.448ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33312024-11-20T02:29:52.448ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33322024-11-20T02:29:52.449ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33332024-11-20T02:29:52.449ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/92d1e52d-8bff-46a5-a277-b5f8c72db683/debug/bundle/zone", "/pool/int/9b12c4a3-3a43-462c-be72-f4f6d4f154b1/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/3512857a-ab87-49e5-8a00-5418fbf6ac17/crypt/debug", "/pool/ext/3a2d0809-94fd-45cc-ba0b-a34ecb38eda4/crypt/debug", "/pool/ext/fe891a6c-6bbe-4aa6-b0f7-6d28f9aeb7dc/crypt/debug", "/pool/ext/98cd316b-55e2-4c2d-813f-e4caae970d59/crypt/debug", "/pool/ext/841052f1-d4ff-4743-9006-a66dddb621f3/crypt/debug", "/pool/ext/9529683f-e460-4948-a032-9f2d5e49707f/crypt/debug", "/pool/ext/b905cd08-9ec5-42bd-890c-f6f56b8d0c30/crypt/debug", "/pool/ext/bc9c41cc-acd9-44d4-93a2-6b2f4b235d83/crypt/debug", "/pool/ext/ad4fdfcc-eca4-445d-9c4d-891cf07f57c6/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60
33342024-11-20T02:29:52.554ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33352024-11-20T02:29:52.561ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33362024-11-20T02:29:52.575ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33372024-11-20T02:29:52.578ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33382024-11-20T02:29:52.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33392024-11-20T02:29:52.579ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33402024-11-20T02:29:52.580ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33412024-11-20T02:29:52.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33422024-11-20T02:29:52.581ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33432024-11-20T02:29:52.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33442024-11-20T02:29:53.106ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60", bundle_id: 20e7cf4b-1462-4ff3-8716-3d53adc4de2c }, time_created: 2024-11-20T02:29:52.449627212Z, version: 0, cause: TerminatedInstance }
33452024-11-20T02:29:53.106ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_d8b4601e-e1fd-4135-bd59-259e8f151b60 file = sled-agent/src/instance.rs:1032 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33462024-11-20T02:29:54.870ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33472024-11-20T02:29:54.889ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(6865208), kind: System }
33482024-11-20T02:29:54.889ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(6865208), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
33492024-11-20T02:29:54.889ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-20T02:29:54.889686382Z }, migration_in: None, migration_out: None }
33502024-11-20T02:29:54.917ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-20T02:29:54.889686382Z }, migration_in: None, migration_out: None }
33512024-11-20T02:29:54.921ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = d36a31d3-3683-440b-a45f-ff56dbce0fc4 propolis_id = d8b4601e-e1fd-4135-bd59-259e8f151b60
33522024-11-20T02:29:55.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57036
33532024-11-20T02:29:55.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57036 req_id = 989ec54a-31a6-4a86-aa59-9b99464485d7 response_code = 200 uri = /vpc-routes
33542024-11-20T02:29:55.503ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33552024-11-20T02:29:55.522ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
33562024-11-20T02:29:55.522ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33572024-11-20T02:29:55.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57036 req_id = f3184f59-a66c-43a2-b556-b91a3399615c response_code = 204 uri = /eip-gateways
33582024-11-20T02:29:55.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57036 req_id = ec81e6e4-3f63-43bd-b62c-43f4e4436cf2 response_code = 204 uri = /vpc-routes
33592024-11-20T02:29:55.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41421
33602024-11-20T02:29:55.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41421 req_id = 616a151f-eefc-4557-b08e-e6d518bf1a22 response_code = 200 uri = /v2p
33612024-11-20T02:29:55.750ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33622024-11-20T02:29:55.751ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33632024-11-20T02:29:55.752ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33642024-11-20T02:29:56.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57585
33652024-11-20T02:29:56.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57585 req_id = 42a04ef4-7c05-4f86-8751-7922e4e91911 response_code = 200 uri = /v2p
33662024-11-20T02:29:56.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61185
33672024-11-20T02:29:56.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61185 req_id = 81162dd9-432f-44f4-ad70-ba465a6419a1 response_code = 200 uri = /vpc-routes
33682024-11-20T02:29:56.821ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
33692024-11-20T02:29:56.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61185 req_id = 44249519-bfa1-4b89-9c3d-0dc1932d009f response_code = 204 uri = /eip-gateways
33702024-11-20T02:29:56.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61185 req_id = 31b0d4db-141f-446f-87b3-481eb7e9db0c response_code = 204 uri = /vpc-routes
33712024-11-20T02:29:57.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35568
33722024-11-20T02:29:57.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35568 req_id = 96f4c9d1-b58a-4914-9b96-bbf3aece5d8d response_code = 200 uri = /vpc-routes
33732024-11-20T02:29:57.483ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b values = ExternalIpGatewayMap { mappings: {} }
33742024-11-20T02:29:57.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35568 req_id = d9fea854-0020-4905-8556-b284d8dcc226 response_code = 204 uri = /eip-gateways
33752024-11-20T02:29:57.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35568 req_id = 2d099df2-74ee-450b-a911-11c99e180b2d response_code = 204 uri = /vpc-routes
33762024-11-20T02:29:58.351ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33772024-11-20T02:29:58.352ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33782024-11-20T02:29:59.974ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b
33792024-11-20T02:29:59.976ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 52b4024d-59d8-46f0-844c-2d14ce62d55b