Max level shown:
1 [ Nov 19 02:07:34 Enabled. ]
2 [ Nov 19 02:07:34 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 19 02:07:34 Method "start" exited with status 0. ]
4 [ Nov 19 02:07:34 Rereading configuration. ]
5 [ Nov 19 02:07:34 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-19T02:07:34.464ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-19T02:07:34.464ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-19T02:07:34.517ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-19T02:07:34.517ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-19T02:07:34.634ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-19T02:07:34.643ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-19T02:07:34.651ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-19T02:07:35.253ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-19T02:07:35.393ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-19T02:07:35.393ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-19T02:07:35.393ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-19T02:07:35.393ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
192024-11-19T02:07:35.393ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
202024-11-19T02:07:35.393ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-19T02:07:35.396ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-19T02:07:35.396ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-19T02:07:35.396ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-19T02:07:35.396ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-19T02:07:35.396ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-19T02:07:35.396ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-19T02:07:35.396ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-19T02:07:35.396ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-19T02:07:35.396ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-19T02:07:35.414ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-19T02:07:35.414ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 6761462c-c735-467b-a33c-59444a1ef020 (zpool)
322024-11-19T02:07:35.546ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal }
332024-11-19T02:07:36.155ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-19T02:07:36.155ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-19T02:07:36.155ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-19T02:07:36.155ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-19T02:07:36.155ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-19T02:07:36.155ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-19T02:07:36.155ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-19T02:07:36.163ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-19T02:07:36.163ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool)
422024-11-19T02:07:36.274ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal }
432024-11-19T02:07:36.873ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-19T02:07:36.873ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-19T02:07:36.873ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-19T02:07:36.873ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-19T02:07:36.873ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-19T02:07:36.873ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-19T02:07:36.873ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-19T02:07:36.873ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-19T02:07:36.873ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
522024-11-19T02:07:36.873ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-11-19T02:07:36.873ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-11-19T02:07:36.873ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-11-19T02:07:36.873ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-19T02:07:36.873ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-19T02:07:36.873ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
582024-11-19T02:07:36.873ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
592024-11-19T02:07:36.873ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-19T02:07:36.873ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-19T02:07:36.873ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-19T02:07:36.873ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-19T02:07:36.873ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-11-19T02:07:36.873ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-11-19T02:07:36.873ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-11-19T02:07:36.873ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-11-19T02:07:36.873ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-19T02:07:36.873ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
692024-11-19T02:07:36.873ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702024-11-19T02:07:36.873ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-11-19T02:07:36.874ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-19T02:07:36.874ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
752024-11-19T02:07:36.874ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-11-19T02:07:36.874ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792024-11-19T02:07:36.874ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-19T02:07:36.874ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-11-19T02:07:36.874ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-11-19T02:07:36.874ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-19T02:07:36.874ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-19T02:07:36.874ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-19T02:07:36.874ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882024-11-19T02:07:36.874ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-19T02:07:36.874ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-19T02:07:36.874ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952024-11-19T02:07:36.874ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
962024-11-19T02:07:36.874ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-11-19T02:07:36.874ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-19T02:07:36.874ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-19T02:07:36.874ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-19T02:07:36.874ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-19T02:07:36.874ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-19T02:07:36.874ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-19T02:07:36.874ZINFOSledAgent (bootstore): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1052024-11-19T02:07:36.874ZINFOSledAgent (bootstore): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1062024-11-19T02:07:36.874ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-19T02:07:36.874ZINFOSledAgent (bootstore): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1082024-11-19T02:07:36.874ZINFOSledAgent (bootstore): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1092024-11-19T02:07:36.874ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-19T02:07:36.874ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-19T02:07:36.874ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-19T02:07:36.885ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:743
1132024-11-19T02:07:36.885ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1353, tv_nsec: 805991067 } time_to_next_cleanup = 599.999945409s
1142024-11-19T02:07:36.885ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4004
1152024-11-19T02:07:36.885ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-19T02:07:36.885ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/sled-agent-request.json file = common/src/ledger.rs:189
1172024-11-19T02:07:36.888ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/sled-agent-request.json file = common/src/ledger.rs:189
1182024-11-19T02:07:36.888ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-19T02:07:36.890ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-19T02:07:36.890ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-19T02:07:36.890ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-19T02:07:36.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-19T02:07:36.890ZINFOSledAgent (RSS): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1242024-11-19T02:07:36.890ZINFOSledAgent (RSS): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1252024-11-19T02:07:36.890ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-19T02:07:36.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-19T02:07:36.890ZINFOSledAgent (RSS): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/rss-sled-plan.json file = common/src/ledger.rs:189
1282024-11-19T02:07:36.890ZINFOSledAgent (RSS): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/rss-sled-plan.json file = common/src/ledger.rs:189
1292024-11-19T02:07:36.890ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-19T02:07:36.890ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-19T02:07:36.890ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-19T02:07:36.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-19T02:07:36.891ZINFOSledAgent (RSS): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1342024-11-19T02:07:36.891ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/rss-sled-plan.json"
1352024-11-19T02:07:36.891ZINFOSledAgent (RSS): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1362024-11-19T02:07:36.891ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/rss-sled-plan.json"
1372024-11-19T02:07:36.891ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ffe74824-0c08-48e1-a755-fb123e8dc181 (sled), rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1382024-11-19T02:07:36.891ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1392024-11-19T02:07:36.891ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1402024-11-19T02:07:36.891ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1412024-11-19T02:07:36.891ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1422024-11-19T02:07:36.891ZINFOSledAgent (bootstore): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1432024-11-19T02:07:36.891ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1442024-11-19T02:07:36.891ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1452024-11-19T02:07:36.892ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ffe74824-0c08-48e1-a755-fb123e8dc181 (sled), rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1462024-11-19T02:07:36.892ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4301
1472024-11-19T02:07:36.892ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4701
1482024-11-19T02:07:36.897ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1492024-11-19T02:07:36.902ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1502024-11-19T02:07:36.903ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1512024-11-19T02:07:36.907ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1522024-11-19T02:07:36.907ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1532024-11-19T02:07:36.907ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:38696
1542024-11-19T02:07:36.908ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ffe74824-0c08-48e1-a755-fb123e8dc181 (sled), rack_id: a894e92e-d765-4f15-b6b7-cb9ca46d1860, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1552024-11-19T02:07:36.908ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1562024-11-19T02:07:36.908ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1572024-11-19T02:07:36.908ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1582024-11-19T02:07:36.908ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1592024-11-19T02:07:36.908ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1602024-11-19T02:07:36.908ZINFOSledAgent (StorageManager): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1612024-11-19T02:07:36.908ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1622024-11-19T02:07:36.908ZINFOSledAgent (StorageManager): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1632024-11-19T02:07:36.908ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1642024-11-19T02:07:36.908ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1652024-11-19T02:07:36.908ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1662024-11-19T02:07:36.908ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1672024-11-19T02:07:36.908ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1682024-11-19T02:07:36.925ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-19T02:07:36.946ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1702024-11-19T02:07:36.965ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1712024-11-19T02:07:36.968ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:407 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
1722024-11-19T02:07:36.969ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1732024-11-19T02:07:36.969ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:419 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
1742024-11-19T02:07:36.969ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1752024-11-19T02:07:36.972ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 105.598545ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6c9a4842-046e-4950-8483-dbc1245d11bc", "content-length": "124", "date": "Tue, 19 Nov 2024 02:07:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6c9a4842-046e-4950-8483-dbc1245d11bc" } file = clients/ddm-admin-client/src/lib.rs:177
1762024-11-19T02:07:36.982ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_6761462c-c735-467b-a33c-59444a1ef020/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1772024-11-19T02:07:37.013ZINFOSledAgent: successfully created encrypted zvol: name="oxi_6761462c-c735-467b-a33c-59444a1ef020/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-11-19T02:07:37.013ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_6761462c-c735-467b-a33c-59444a1ef020/swap" file = sled-agent/src/swap_device.rs:96
1792024-11-19T02:07:37.018ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:434 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
1802024-11-19T02:07:37.018ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1812024-11-19T02:07:37.019ZINFOSledAgent (BackingFs): Ensuring dataset oxi_6761462c-c735-467b-a33c-59444a1ef020/backing/fmd file = sled-agent/src/backing_fs.rs:138
1822024-11-19T02:07:37.079ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-11-19T02:07:37.080ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 65.573169ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2dc38f8b-ee63-42ad-b515-741094c20605", "content-length": "124", "date": "Tue, 19 Nov 2024 02:07:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2dc38f8b-ee63-42ad-b515-741094c20605" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-11-19T02:07:37.117ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1852024-11-19T02:07:37.146ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-11-19T02:07:37.147ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 115.334066ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "053a6ac2-9c77-4e12-981e-fa227fbb2346", "content-length": "124", "date": "Tue, 19 Nov 2024 02:07:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "053a6ac2-9c77-4e12-981e-fa227fbb2346" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-11-19T02:07:37.264ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-11-19T02:07:37.264ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 201.899666ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "83c80729-05ab-408c-ab70-4e7c8099f858", "content-length": "124", "date": "Tue, 19 Nov 2024 02:07:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "83c80729-05ab-408c-ab70-4e7c8099f858" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-11-19T02:07:37.336ZINFOSledAgent (BackingFs): Mounting oxi_6761462c-c735-467b-a33c-59444a1ef020/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1902024-11-19T02:07:37.349ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1912024-11-19T02:07:37.349ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1922024-11-19T02:07:37.349ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1932024-11-19T02:07:37.349ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1942024-11-19T02:07:37.467ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-19T02:07:37.468ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 292.080911ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c181e65b-e63c-49b5-9f99-57d5d341e23d", "content-length": "124", "date": "Tue, 19 Nov 2024 02:07:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c181e65b-e63c-49b5-9f99-57d5d341e23d" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-19T02:07:37.761ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1972024-11-19T02:07:37.762ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 335.540826ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bb573608-a413-43d4-b4eb-b943c3d4d830", "content-length": "124", "date": "Tue, 19 Nov 2024 02:07:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bb573608-a413-43d4-b4eb-b943c3d4d830" } file = clients/ddm-admin-client/src/lib.rs:177
1982024-11-19T02:07:38.099ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1992024-11-19T02:07:38.100ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2002024-11-19T02:07:38.106ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:43120 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2012024-11-19T02:07:38.106ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2022024-11-19T02:07:38.106ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:43120 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = ffe74824-0c08-48e1-a755-fb123e8dc181 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2032024-11-19T02:07:38.107ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 332.875702ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2042024-11-19T02:07:38.108ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2052024-11-19T02:07:38.108ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2062024-11-19T02:07:38.108ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:927 underlay_address = fd00:1122:3344:101::1
2072024-11-19T02:07:38.108ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2082024-11-19T02:07:38.441ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 287.363602ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2092024-11-19T02:07:38.730ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.442586238s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2102024-11-19T02:07:40.174ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.984800069s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2112024-11-19T02:07:40.593ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2675
2122024-11-19T02:07:40.593ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2920
2132024-11-19T02:07:40.593ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2545
2142024-11-19T02:07:40.593ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2592
2152024-11-19T02:07:40.593ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3001
2162024-11-19T02:07:40.593ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3046
2172024-11-19T02:07:40.595ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2845
2182024-11-19T02:07:40.596ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2586
2192024-11-19T02:07:40.596ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='4531e85d-d56a-4e09-b4e5-16020bc21701'/> <propval type="astring" name="rack_id" value='a894e92e-d765-4f15-b6b7-cb9ca46d1860'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe34:9191'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='a894e92e-d765-4f15-b6b7-cb9ca46d1860'/> <propval type="astring" name="sled_id" value='ffe74824-0c08-48e1-a755-fb123e8dc181'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='ffe74824-0c08-48e1-a755-fb123e8dc181'/> <propval type="astring" name="rack_uuid" value='a894e92e-d765-4f15-b6b7-cb9ca46d1860'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='ffe74824-0c08-48e1-a755-fb123e8dc181'/> <propval type="astring" name="rack_uuid" value='a894e92e-d765-4f15-b6b7-cb9ca46d1860'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2202024-11-19T02:07:40.596ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2212024-11-19T02:07:40.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 51.201173ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-19T02:07:41.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 54.410959ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-19T02:07:41.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 290.099501ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-19T02:07:41.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 408.414337ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-19T02:07:42.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 765.825692ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-19T02:07:42.273ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.545190729s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2272024-11-19T02:07:43.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 963.181676ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-19T02:07:44.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 932.907451ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-19T02:07:45.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 734.581158ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302024-11-19T02:07:46.725ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/nexus.rs:527 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2312024-11-19T02:07:46.754ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2322024-11-19T02:07:46.754ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2332024-11-19T02:07:46.755ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2342024-11-19T02:07:46.755ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2352024-11-19T02:07:46.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2362024-11-19T02:07:46.755ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2372024-11-19T02:07:46.756ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/sled-agent-request.json"
2382024-11-19T02:07:46.756ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2392024-11-19T02:07:46.756ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/sled-agent-request.json"
2402024-11-19T02:07:46.756ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2412024-11-19T02:07:46.756ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2422024-11-19T02:07:46.756ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4004
2432024-11-19T02:07:46.756ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:38696
2442024-11-19T02:07:46.954ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2452024-11-19T02:07:46.954ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2462024-11-19T02:07:46.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-19T02:07:46.954ZINFOSledAgent (RSS): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2482024-11-19T02:07:46.954ZINFOSledAgent (RSS): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2492024-11-19T02:07:46.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-19T02:07:46.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-19T02:07:46.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2522024-11-19T02:07:46.954ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2532024-11-19T02:07:46.956ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.287436038s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2542024-11-19T02:07:46.959ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4325 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2552024-11-19T02:07:46.959ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4341
2562024-11-19T02:07:46.959ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2572024-11-19T02:07:47.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65244
2582024-11-19T02:07:47.219ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2592024-11-19T02:07:47.219ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2602024-11-19T02:07:47.219ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json file = common/src/ledger.rs:189
2612024-11-19T02:07:47.219ZINFOSledAgent (ServiceManager): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json file = common/src/ledger.rs:189
2622024-11-19T02:07:47.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65244 req_id = 55d24f7d-21ed-4698-8c66-c22934050d70 response_code = 200 uri = /inventory
2632024-11-19T02:07:47.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53355
2642024-11-19T02:07:47.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53355 req_id = 0daa6335-37ee-45bc-a89f-d940df1ee4e5 response_code = 200 uri = /sled-role
2652024-11-19T02:07:47.250ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2662024-11-19T02:07:47.250ZINFOSledAgent (RSS): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2672024-11-19T02:07:47.250ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/rss-service-plan-v5.json"
2682024-11-19T02:07:47.250ZINFOSledAgent (RSS): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2692024-11-19T02:07:47.251ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/rss-service-plan-v5.json"
2702024-11-19T02:07:47.251ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2712024-11-19T02:07:47.282ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: e124b4c3-d7ad-4732-879a-38adb29a5a50, pool_id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: d79af5c5-7a77-4d4c-af1e-9e769e5b87d0, pool_id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 5b3b91e3-1db4-4cd8-9a59-bda29239e6fb, pool_id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: cb27315e-3fc6-4b78-8c62-e5a4983d6180, pool_id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 7af3431b-71a7-4fba-b30a-294feea9e240, pool_id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: b72a761b-5368-4617-8b93-826204489d00, pool_id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6b63c9a5-de00-4430-b5dd-219c4b8c2771, pool_id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 5c1102d3-e44b-4f0a-ae65-d5c448b84c34, pool_id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 9ff6fd0b-fb32-4ff7-ac22-02a61a3ca2d1, pool_id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2722024-11-19T02:07:47.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48719
2732024-11-19T02:07:47.283ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:883 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2742024-11-19T02:07:47.283ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: e124b4c3-d7ad-4732-879a-38adb29a5a50, pool_id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: d79af5c5-7a77-4d4c-af1e-9e769e5b87d0, pool_id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 5b3b91e3-1db4-4cd8-9a59-bda29239e6fb, pool_id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: cb27315e-3fc6-4b78-8c62-e5a4983d6180, pool_id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 7af3431b-71a7-4fba-b30a-294feea9e240, pool_id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: b72a761b-5368-4617-8b93-826204489d00, pool_id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6b63c9a5-de00-4430-b5dd-219c4b8c2771, pool_id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 5c1102d3-e44b-4f0a-ae65-d5c448b84c34, pool_id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 9ff6fd0b-fb32-4ff7-ac22-02a61a3ca2d1, pool_id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2752024-11-19T02:07:47.283ZINFOSledAgent (StorageManager): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2762024-11-19T02:07:47.283ZINFOSledAgent (StorageManager): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2772024-11-19T02:07:47.283ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1175 request = omicron_physical_disks_ensure
2782024-11-19T02:07:47.283ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2792024-11-19T02:07:47.283ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2802024-11-19T02:07:47.283ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2812024-11-19T02:07:47.283ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2822024-11-19T02:07:47.455ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2832024-11-19T02:07:47.455ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool)
2842024-11-19T02:07:47.893ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2852024-11-19T02:07:48.132ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17955863001468384397 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2862024-11-19T02:07:48.132ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16944226832985866918 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2872024-11-19T02:07:48.375ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
2882024-11-19T02:07:48.409ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }
2892024-11-19T02:07:48.418ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2902024-11-19T02:07:48.418ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2912024-11-19T02:07:48.418ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2922024-11-19T02:07:48.418ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2932024-11-19T02:07:48.418ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-11-19T02:07:48.418ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2952024-11-19T02:07:48.418ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2962024-11-19T02:07:48.463ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2972024-11-19T02:07:48.471ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone file = sled-storage/src/dataset.rs:303
2982024-11-19T02:07:48.694ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a file = sled-storage/src/dataset.rs:389
2992024-11-19T02:07:48.701ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
3002024-11-19T02:07:48.701ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
3012024-11-19T02:07:48.701ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
3022024-11-19T02:07:48.701ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3032024-11-19T02:07:48.701ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
3042024-11-19T02:07:48.711ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3052024-11-19T02:07:48.711ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool)
3062024-11-19T02:07:48.822ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }
3072024-11-19T02:07:48.830ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3082024-11-19T02:07:48.830ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3092024-11-19T02:07:48.830ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3102024-11-19T02:07:48.830ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3112024-11-19T02:07:48.830ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-11-19T02:07:48.830ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3132024-11-19T02:07:48.830ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3142024-11-19T02:07:48.874ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3152024-11-19T02:07:48.882ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone file = sled-storage/src/dataset.rs:303
3162024-11-19T02:07:48.895ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
3172024-11-19T02:07:49.100ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730 file = sled-storage/src/dataset.rs:389
3182024-11-19T02:07:49.108ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3192024-11-19T02:07:49.108ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3202024-11-19T02:07:49.108ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3212024-11-19T02:07:49.108ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3222024-11-19T02:07:49.108ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3232024-11-19T02:07:49.119ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3242024-11-19T02:07:49.119ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool)
3252024-11-19T02:07:49.233ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }
3262024-11-19T02:07:49.242ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3272024-11-19T02:07:49.242ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3282024-11-19T02:07:49.242ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3292024-11-19T02:07:49.242ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3302024-11-19T02:07:49.242ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-11-19T02:07:49.242ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3322024-11-19T02:07:49.242ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3332024-11-19T02:07:49.289ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3342024-11-19T02:07:49.297ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/zone file = sled-storage/src/dataset.rs:303
3352024-11-19T02:07:49.519ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f file = sled-storage/src/dataset.rs:389
3362024-11-19T02:07:49.527ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3372024-11-19T02:07:49.527ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3382024-11-19T02:07:49.527ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3392024-11-19T02:07:49.527ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402024-11-19T02:07:49.527ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3412024-11-19T02:07:49.538ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3422024-11-19T02:07:49.538ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool)
3432024-11-19T02:07:49.658ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }
3442024-11-19T02:07:49.665ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3452024-11-19T02:07:49.665ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3462024-11-19T02:07:49.665ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3472024-11-19T02:07:49.666ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3482024-11-19T02:07:49.666ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-11-19T02:07:49.666ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3502024-11-19T02:07:49.666ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3512024-11-19T02:07:49.713ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522024-11-19T02:07:49.721ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/zone file = sled-storage/src/dataset.rs:303
3532024-11-19T02:07:49.896ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
3542024-11-19T02:07:49.939ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2354be7c-bc71-4b15-9f57-06b09b66253b file = sled-storage/src/dataset.rs:389
3552024-11-19T02:07:49.947ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3562024-11-19T02:07:49.947ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3572024-11-19T02:07:49.947ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3582024-11-19T02:07:49.947ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3592024-11-19T02:07:49.947ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3602024-11-19T02:07:49.956ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3612024-11-19T02:07:49.957ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool)
3622024-11-19T02:07:50.079ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }
3632024-11-19T02:07:50.087ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3642024-11-19T02:07:50.087ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3652024-11-19T02:07:50.087ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3662024-11-19T02:07:50.087ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3672024-11-19T02:07:50.087ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3682024-11-19T02:07:50.087ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3692024-11-19T02:07:50.087ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3702024-11-19T02:07:50.136ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3712024-11-19T02:07:50.143ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/zone file = sled-storage/src/dataset.rs:303
3722024-11-19T02:07:50.362ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882 file = sled-storage/src/dataset.rs:389
3732024-11-19T02:07:50.370ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3742024-11-19T02:07:50.370ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3752024-11-19T02:07:50.370ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3762024-11-19T02:07:50.370ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3772024-11-19T02:07:50.370ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3782024-11-19T02:07:50.379ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3792024-11-19T02:07:50.379ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool)
3802024-11-19T02:07:50.512ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }
3812024-11-19T02:07:50.521ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3822024-11-19T02:07:50.521ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3832024-11-19T02:07:50.521ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3842024-11-19T02:07:50.521ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3852024-11-19T02:07:50.521ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-11-19T02:07:50.521ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3872024-11-19T02:07:50.521ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3882024-11-19T02:07:50.571ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892024-11-19T02:07:50.580ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/zone file = sled-storage/src/dataset.rs:303
3902024-11-19T02:07:50.805ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56 file = sled-storage/src/dataset.rs:389
3912024-11-19T02:07:50.813ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3922024-11-19T02:07:50.814ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3932024-11-19T02:07:50.814ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3942024-11-19T02:07:50.814ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952024-11-19T02:07:50.814ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3962024-11-19T02:07:50.824ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3972024-11-19T02:07:50.824ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool)
3982024-11-19T02:07:50.948ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }
3992024-11-19T02:07:50.956ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
4002024-11-19T02:07:50.956ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
4012024-11-19T02:07:50.956ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
4022024-11-19T02:07:50.956ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
4032024-11-19T02:07:50.956ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-11-19T02:07:50.956ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-11-19T02:07:50.956ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4062024-11-19T02:07:50.960ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4072024-11-19T02:07:51.004ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4082024-11-19T02:07:51.013ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/zone file = sled-storage/src/dataset.rs:303
4092024-11-19T02:07:51.241ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e7d17670-49d1-4296-b44f-e53bcd272b84 file = sled-storage/src/dataset.rs:389
4102024-11-19T02:07:51.245ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 12.065329031s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4112024-11-19T02:07:51.249ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4122024-11-19T02:07:51.249ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4132024-11-19T02:07:51.249ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4142024-11-19T02:07:51.249ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4152024-11-19T02:07:51.249ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4162024-11-19T02:07:51.260ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4172024-11-19T02:07:51.260ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool)
4182024-11-19T02:07:51.378ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }
4192024-11-19T02:07:51.386ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4202024-11-19T02:07:51.386ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4212024-11-19T02:07:51.386ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4222024-11-19T02:07:51.386ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4232024-11-19T02:07:51.386ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4242024-11-19T02:07:51.386ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4252024-11-19T02:07:51.386ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4262024-11-19T02:07:51.432ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4272024-11-19T02:07:51.439ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crypt/zone file = sled-storage/src/dataset.rs:303
4282024-11-19T02:07:51.646ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490 file = sled-storage/src/dataset.rs:389
4292024-11-19T02:07:51.653ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4302024-11-19T02:07:51.653ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4312024-11-19T02:07:51.653ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4322024-11-19T02:07:51.653ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4332024-11-19T02:07:51.653ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4342024-11-19T02:07:51.662ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4352024-11-19T02:07:51.663ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool)
4362024-11-19T02:07:51.780ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }
4372024-11-19T02:07:51.787ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4382024-11-19T02:07:51.787ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4392024-11-19T02:07:51.787ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4402024-11-19T02:07:51.787ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4412024-11-19T02:07:51.787ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4422024-11-19T02:07:51.787ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4432024-11-19T02:07:51.787ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4442024-11-19T02:07:51.831ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4452024-11-19T02:07:51.840ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8d92ce26-c543-4771-ad32-a160a4f547aa/crypt/zone file = sled-storage/src/dataset.rs:303
4462024-11-19T02:07:51.965ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4472024-11-19T02:07:52.058ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8d92ce26-c543-4771-ad32-a160a4f547aa file = sled-storage/src/dataset.rs:389
4482024-11-19T02:07:52.066ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4492024-11-19T02:07:52.066ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4502024-11-19T02:07:52.066ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4512024-11-19T02:07:52.066ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6761462c-c735-467b-a33c-59444a1ef020 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd1eb215-4755-4f5a-a1d1-eee3d03545e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4522024-11-19T02:07:52.066ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4532024-11-19T02:07:52.066ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4542024-11-19T02:07:52.066ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4552024-11-19T02:07:52.066ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4562024-11-19T02:07:52.067ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4572024-11-19T02:07:52.067ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:887 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4582024-11-19T02:07:52.067ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4592024-11-19T02:07:52.067ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:913 generation = Generation(1) sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4602024-11-19T02:07:52.067ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:918 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4612024-11-19T02:07:52.067ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:923 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4622024-11-19T02:07:52.067ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4632024-11-19T02:07:52.067ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:929 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4642024-11-19T02:07:52.067ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4652024-11-19T02:07:52.067ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:934 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4662024-11-19T02:07:52.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4784239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48719 req_id = b6e9d31d-6584-4671-b891-4ba51649b2b4 response_code = 200 uri = /omicron-physical-disks
4672024-11-19T02:07:52.098ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {08a95211-28b2-46da-8fc8-aa5e1ca5a734 (dataset): DatasetConfig { id: 08a95211-28b2-46da-8fc8-aa5e1ca5a734 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a763a05-8994-4fb0-82a5-8d0f4ed0840a (dataset): DatasetConfig { id: 0a763a05-8994-4fb0-82a5-8d0f4ed0840a (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b062598-4859-4243-929d-e61dc5d85b13 (dataset): DatasetConfig { id: 0b062598-4859-4243-929d-e61dc5d85b13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14fb5371-a6ed-40b5-a781-23a58a33be01 (dataset): DatasetConfig { id: 14fb5371-a6ed-40b5-a781-23a58a33be01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1c0f54c9-cef4-441b-a2ad-3e4379d3464e (dataset): DatasetConfig { id: 1c0f54c9-cef4-441b-a2ad-3e4379d3464e (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f06a9f6-c082-447b-bcc9-ec76bd27e838 (dataset): DatasetConfig { id: 2f06a9f6-c082-447b-bcc9-ec76bd27e838 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fbce99a-b5f4-4af7-a9d8-4222e15747b1 (dataset): DatasetConfig { id: 2fbce99a-b5f4-4af7-a9d8-4222e15747b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32188ebf-9059-48b2-b4c8-180c3426ef22 (dataset): DatasetConfig { id: 32188ebf-9059-48b2-b4c8-180c3426ef22 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32276d98-42a1-4dcb-b3a3-25d4b4bae05d (dataset): DatasetConfig { id: 32276d98-42a1-4dcb-b3a3-25d4b4bae05d (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35803c8f-400a-498e-a74e-5a0cebda796f (dataset): DatasetConfig { id: 35803c8f-400a-498e-a74e-5a0cebda796f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 371fced9-a7ac-43a8-ad68-2e8ef9ef1883 (dataset): DatasetConfig { id: 371fced9-a7ac-43a8-ad68-2e8ef9ef1883 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 481245ac-24f7-40e4-926a-3f730204c97e (dataset): DatasetConfig { id: 481245ac-24f7-40e4-926a-3f730204c97e (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 492ee917-f722-4b5f-b378-9d15d416ec41 (dataset): DatasetConfig { id: 492ee917-f722-4b5f-b378-9d15d416ec41 (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4af39f0f-3d08-4ce1-addd-73eebf6445b1 (dataset): DatasetConfig { id: 4af39f0f-3d08-4ce1-addd-73eebf6445b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b1357c4-af85-4c73-8d0b-e81056df8e84 (dataset): DatasetConfig { id: 4b1357c4-af85-4c73-8d0b-e81056df8e84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4cf1f530-cfc1-4f4d-a124-5067870aa502 (dataset): DatasetConfig { id: 4cf1f530-cfc1-4f4d-a124-5067870aa502 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f539a7e-8cb3-4e67-abf8-994dd798c421 (dataset): DatasetConfig { id: 4f539a7e-8cb3-4e67-abf8-994dd798c421 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f69c402-ba7f-4e3c-9109-cad93be57777 (dataset): DatasetConfig { id: 4f69c402-ba7f-4e3c-9109-cad93be57777 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52f117f7-ad62-48d0-b100-756725145954 (dataset): DatasetConfig { id: 52f117f7-ad62-48d0-b100-756725145954 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56e24830-609d-40d8-9402-8e164d03cb0d (dataset): DatasetConfig { id: 56e24830-609d-40d8-9402-8e164d03cb0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 570de6b5-f8ed-4184-96ae-7a39f98ecae3 (dataset): DatasetConfig { id: 570de6b5-f8ed-4184-96ae-7a39f98ecae3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a0dd971-b39f-4024-ace2-3537b724f0d4 (dataset): DatasetConfig { id: 5a0dd971-b39f-4024-ace2-3537b724f0d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f02be878-8b16-4056-a261-089d083d36be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5aa27ba2-6648-41ff-83a9-1ae4c935d666 (dataset): DatasetConfig { id: 5aa27ba2-6648-41ff-83a9-1ae4c935d666 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 62bb8557-4917-4a56-943c-985cecd5ee1d (dataset): DatasetConfig { id: 62bb8557-4917-4a56-943c-985cecd5ee1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63ad88a9-279b-4fd7-86cc-07179b7f04b8 (dataset): DatasetConfig { id: 63ad88a9-279b-4fd7-86cc-07179b7f04b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68040fc2-873c-419e-9609-4995537e7e1f (dataset): DatasetConfig { id: 68040fc2-873c-419e-9609-4995537e7e1f (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6965b8f5-d518-4fb3-be5d-a91746adc28a (dataset): DatasetConfig { id: 6965b8f5-d518-4fb3-be5d-a91746adc28a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b7dcdd4-9839-4ebb-8488-dd565d1e2c59 (dataset): DatasetConfig { id: 6b7dcdd4-9839-4ebb-8488-dd565d1e2c59 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cd22a24-2984-4d0b-b52f-d8ee6f633d6f (dataset): DatasetConfig { id: 6cd22a24-2984-4d0b-b52f-d8ee6f633d6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cffc575-005b-4239-b5f8-47de64a2155a (dataset): DatasetConfig { id: 6cffc575-005b-4239-b5f8-47de64a2155a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 72ab05ea-2890-4f8a-b656-c480e88153e9 (dataset): DatasetConfig { id: 72ab05ea-2890-4f8a-b656-c480e88153e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f3062649-679a-4873-848a-e73bb370d040" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72ecfa86-3f2c-43c4-9678-f19edc8be88d (dataset): DatasetConfig { id: 72ecfa86-3f2c-43c4-9678-f19edc8be88d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 75ed8ec5-ba3b-441b-b4a2-9fc83139a145 (dataset): DatasetConfig { id: 75ed8ec5-ba3b-441b-b4a2-9fc83139a145 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7784841b-e49d-458c-9221-fca3cc5f0a94 (dataset): DatasetConfig { id: 7784841b-e49d-458c-9221-fca3cc5f0a94 (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78754d80-883f-426e-847a-2b0847ff2332 (dataset): DatasetConfig { id: 78754d80-883f-426e-847a-2b0847ff2332 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_04239608-8df7-4953-8231-9f707a26673e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7baa6888-5a43-4414-a809-d195c547629e (dataset): DatasetConfig { id: 7baa6888-5a43-4414-a809-d195c547629e (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e895243-2db3-46c3-88fd-541e930cd771 (dataset): DatasetConfig { id: 7e895243-2db3-46c3-88fd-541e930cd771 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80190faa-da7b-419f-b3d6-6bc99bedb0e5 (dataset): DatasetConfig { id: 80190faa-da7b-419f-b3d6-6bc99bedb0e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b426d24-b2e9-4902-b650-15b40c616e7c (dataset): DatasetConfig { id: 8b426d24-b2e9-4902-b650-15b40c616e7c (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f442234-cf0f-4262-a4c7-94994a327714 (dataset): DatasetConfig { id: 8f442234-cf0f-4262-a4c7-94994a327714 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 90aa4db4-df4f-4f67-bf9d-31d337517b16 (dataset): DatasetConfig { id: 90aa4db4-df4f-4f67-bf9d-31d337517b16 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c198b01-eb82-4fac-8d82-41049a21ded5 (dataset): DatasetConfig { id: 9c198b01-eb82-4fac-8d82-41049a21ded5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e99ccb8-3e2e-4575-a867-6f3e244efd9a (dataset): DatasetConfig { id: 9e99ccb8-3e2e-4575-a867-6f3e244efd9a (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af20e09e-e7ae-4d9e-8fb0-ea40e0056af8 (dataset): DatasetConfig { id: af20e09e-e7ae-4d9e-8fb0-ea40e0056af8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1bbc305-091f-42af-95da-1e7f9000d818 (dataset): DatasetConfig { id: b1bbc305-091f-42af-95da-1e7f9000d818 (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b4c14760-75c3-479c-bb46-125b80da8118 (dataset): DatasetConfig { id: b4c14760-75c3-479c-bb46-125b80da8118 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6a5473f-120b-4259-80ff-485c24e1a5ba (dataset): DatasetConfig { id: b6a5473f-120b-4259-80ff-485c24e1a5ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7488f50-95ef-44f2-bf72-e5bda585e164 (dataset): DatasetConfig { id: b7488f50-95ef-44f2-bf72-e5bda585e164 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb048f9b-6e03-48a7-9f42-cdfd041ef29b (dataset): DatasetConfig { id: bb048f9b-6e03-48a7-9f42-cdfd041ef29b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1de71d3-fc24-4bc2-b8ce-dd96bd969966 (dataset): DatasetConfig { id: c1de71d3-fc24-4bc2-b8ce-dd96bd969966 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c26d730c-f84f-49bc-b7ad-7ca9be040439 (dataset): DatasetConfig { id: c26d730c-f84f-49bc-b7ad-7ca9be040439 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2a01b07-5450-4621-b482-0f31613e9051 (dataset): DatasetConfig { id: c2a01b07-5450-4621-b482-0f31613e9051 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5ed2060-039e-4772-832f-52bac3fe6215 (dataset): DatasetConfig { id: c5ed2060-039e-4772-832f-52bac3fe6215 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c737a7e6-f440-44f9-a6fd-ae004b7488ef (dataset): DatasetConfig { id: c737a7e6-f440-44f9-a6fd-ae004b7488ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7d4b3d9-816c-4a78-9e9c-91b376ee1ce3 (dataset): DatasetConfig { id: c7d4b3d9-816c-4a78-9e9c-91b376ee1ce3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca3ba8c0-3f52-42d6-b841-f020591c5d60 (dataset): DatasetConfig { id: ca3ba8c0-3f52-42d6-b841-f020591c5d60 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb8f766a-6bd2-4f83-92ff-ee9ad72f58a1 (dataset): DatasetConfig { id: cb8f766a-6bd2-4f83-92ff-ee9ad72f58a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb90a35d-095d-455f-a14e-7e78f8237dd5 (dataset): DatasetConfig { id: cb90a35d-095d-455f-a14e-7e78f8237dd5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cbc41423-889e-4ea8-94cd-3caf421e9e26 (dataset): DatasetConfig { id: cbc41423-889e-4ea8-94cd-3caf421e9e26 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d689bc5d-48f9-4a98-b503-fc2e7af8c004 (dataset): DatasetConfig { id: d689bc5d-48f9-4a98-b503-fc2e7af8c004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d98054ef-bc79-4086-912d-1743a549141d (dataset): DatasetConfig { id: d98054ef-bc79-4086-912d-1743a549141d (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e2ddf379-79e5-45ab-8977-8b79037ef631 (dataset): DatasetConfig { id: e2ddf379-79e5-45ab-8977-8b79037ef631 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e673b4c7-0256-4992-8ce2-afe6e042682f (dataset): DatasetConfig { id: e673b4c7-0256-4992-8ce2-afe6e042682f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e7a4f8ae-ebaa-4258-af54-1e2659467e85 (dataset): DatasetConfig { id: e7a4f8ae-ebaa-4258-af54-1e2659467e85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f560da1e-9533-4268-8550-05b21d58648c (dataset): DatasetConfig { id: f560da1e-9533-4268-8550-05b21d58648c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7c11094-a130-401a-a4f3-2a2ee9311bf7 (dataset): DatasetConfig { id: f7c11094-a130-401a-a4f3-2a2ee9311bf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4682024-11-19T02:07:52.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59162
4692024-11-19T02:07:52.098ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:849 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4702024-11-19T02:07:52.098ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {08a95211-28b2-46da-8fc8-aa5e1ca5a734 (dataset): DatasetConfig { id: 08a95211-28b2-46da-8fc8-aa5e1ca5a734 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a763a05-8994-4fb0-82a5-8d0f4ed0840a (dataset): DatasetConfig { id: 0a763a05-8994-4fb0-82a5-8d0f4ed0840a (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b062598-4859-4243-929d-e61dc5d85b13 (dataset): DatasetConfig { id: 0b062598-4859-4243-929d-e61dc5d85b13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14fb5371-a6ed-40b5-a781-23a58a33be01 (dataset): DatasetConfig { id: 14fb5371-a6ed-40b5-a781-23a58a33be01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1c0f54c9-cef4-441b-a2ad-3e4379d3464e (dataset): DatasetConfig { id: 1c0f54c9-cef4-441b-a2ad-3e4379d3464e (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f06a9f6-c082-447b-bcc9-ec76bd27e838 (dataset): DatasetConfig { id: 2f06a9f6-c082-447b-bcc9-ec76bd27e838 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fbce99a-b5f4-4af7-a9d8-4222e15747b1 (dataset): DatasetConfig { id: 2fbce99a-b5f4-4af7-a9d8-4222e15747b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32188ebf-9059-48b2-b4c8-180c3426ef22 (dataset): DatasetConfig { id: 32188ebf-9059-48b2-b4c8-180c3426ef22 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32276d98-42a1-4dcb-b3a3-25d4b4bae05d (dataset): DatasetConfig { id: 32276d98-42a1-4dcb-b3a3-25d4b4bae05d (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35803c8f-400a-498e-a74e-5a0cebda796f (dataset): DatasetConfig { id: 35803c8f-400a-498e-a74e-5a0cebda796f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 371fced9-a7ac-43a8-ad68-2e8ef9ef1883 (dataset): DatasetConfig { id: 371fced9-a7ac-43a8-ad68-2e8ef9ef1883 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 481245ac-24f7-40e4-926a-3f730204c97e (dataset): DatasetConfig { id: 481245ac-24f7-40e4-926a-3f730204c97e (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 492ee917-f722-4b5f-b378-9d15d416ec41 (dataset): DatasetConfig { id: 492ee917-f722-4b5f-b378-9d15d416ec41 (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4af39f0f-3d08-4ce1-addd-73eebf6445b1 (dataset): DatasetConfig { id: 4af39f0f-3d08-4ce1-addd-73eebf6445b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b1357c4-af85-4c73-8d0b-e81056df8e84 (dataset): DatasetConfig { id: 4b1357c4-af85-4c73-8d0b-e81056df8e84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4cf1f530-cfc1-4f4d-a124-5067870aa502 (dataset): DatasetConfig { id: 4cf1f530-cfc1-4f4d-a124-5067870aa502 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f539a7e-8cb3-4e67-abf8-994dd798c421 (dataset): DatasetConfig { id: 4f539a7e-8cb3-4e67-abf8-994dd798c421 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f69c402-ba7f-4e3c-9109-cad93be57777 (dataset): DatasetConfig { id: 4f69c402-ba7f-4e3c-9109-cad93be57777 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52f117f7-ad62-48d0-b100-756725145954 (dataset): DatasetConfig { id: 52f117f7-ad62-48d0-b100-756725145954 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56e24830-609d-40d8-9402-8e164d03cb0d (dataset): DatasetConfig { id: 56e24830-609d-40d8-9402-8e164d03cb0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 570de6b5-f8ed-4184-96ae-7a39f98ecae3 (dataset): DatasetConfig { id: 570de6b5-f8ed-4184-96ae-7a39f98ecae3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a0dd971-b39f-4024-ace2-3537b724f0d4 (dataset): DatasetConfig { id: 5a0dd971-b39f-4024-ace2-3537b724f0d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f02be878-8b16-4056-a261-089d083d36be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5aa27ba2-6648-41ff-83a9-1ae4c935d666 (dataset): DatasetConfig { id: 5aa27ba2-6648-41ff-83a9-1ae4c935d666 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 62bb8557-4917-4a56-943c-985cecd5ee1d (dataset): DatasetConfig { id: 62bb8557-4917-4a56-943c-985cecd5ee1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63ad88a9-279b-4fd7-86cc-07179b7f04b8 (dataset): DatasetConfig { id: 63ad88a9-279b-4fd7-86cc-07179b7f04b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68040fc2-873c-419e-9609-4995537e7e1f (dataset): DatasetConfig { id: 68040fc2-873c-419e-9609-4995537e7e1f (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6965b8f5-d518-4fb3-be5d-a91746adc28a (dataset): DatasetConfig { id: 6965b8f5-d518-4fb3-be5d-a91746adc28a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b7dcdd4-9839-4ebb-8488-dd565d1e2c59 (dataset): DatasetConfig { id: 6b7dcdd4-9839-4ebb-8488-dd565d1e2c59 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cd22a24-2984-4d0b-b52f-d8ee6f633d6f (dataset): DatasetConfig { id: 6cd22a24-2984-4d0b-b52f-d8ee6f633d6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cffc575-005b-4239-b5f8-47de64a2155a (dataset): DatasetConfig { id: 6cffc575-005b-4239-b5f8-47de64a2155a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 72ab05ea-2890-4f8a-b656-c480e88153e9 (dataset): DatasetConfig { id: 72ab05ea-2890-4f8a-b656-c480e88153e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f3062649-679a-4873-848a-e73bb370d040" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72ecfa86-3f2c-43c4-9678-f19edc8be88d (dataset): DatasetConfig { id: 72ecfa86-3f2c-43c4-9678-f19edc8be88d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 75ed8ec5-ba3b-441b-b4a2-9fc83139a145 (dataset): DatasetConfig { id: 75ed8ec5-ba3b-441b-b4a2-9fc83139a145 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7784841b-e49d-458c-9221-fca3cc5f0a94 (dataset): DatasetConfig { id: 7784841b-e49d-458c-9221-fca3cc5f0a94 (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78754d80-883f-426e-847a-2b0847ff2332 (dataset): DatasetConfig { id: 78754d80-883f-426e-847a-2b0847ff2332 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_04239608-8df7-4953-8231-9f707a26673e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7baa6888-5a43-4414-a809-d195c547629e (dataset): DatasetConfig { id: 7baa6888-5a43-4414-a809-d195c547629e (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e895243-2db3-46c3-88fd-541e930cd771 (dataset): DatasetConfig { id: 7e895243-2db3-46c3-88fd-541e930cd771 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80190faa-da7b-419f-b3d6-6bc99bedb0e5 (dataset): DatasetConfig { id: 80190faa-da7b-419f-b3d6-6bc99bedb0e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b426d24-b2e9-4902-b650-15b40c616e7c (dataset): DatasetConfig { id: 8b426d24-b2e9-4902-b650-15b40c616e7c (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f442234-cf0f-4262-a4c7-94994a327714 (dataset): DatasetConfig { id: 8f442234-cf0f-4262-a4c7-94994a327714 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 90aa4db4-df4f-4f67-bf9d-31d337517b16 (dataset): DatasetConfig { id: 90aa4db4-df4f-4f67-bf9d-31d337517b16 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c198b01-eb82-4fac-8d82-41049a21ded5 (dataset): DatasetConfig { id: 9c198b01-eb82-4fac-8d82-41049a21ded5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e99ccb8-3e2e-4575-a867-6f3e244efd9a (dataset): DatasetConfig { id: 9e99ccb8-3e2e-4575-a867-6f3e244efd9a (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af20e09e-e7ae-4d9e-8fb0-ea40e0056af8 (dataset): DatasetConfig { id: af20e09e-e7ae-4d9e-8fb0-ea40e0056af8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1bbc305-091f-42af-95da-1e7f9000d818 (dataset): DatasetConfig { id: b1bbc305-091f-42af-95da-1e7f9000d818 (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b4c14760-75c3-479c-bb46-125b80da8118 (dataset): DatasetConfig { id: b4c14760-75c3-479c-bb46-125b80da8118 (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6a5473f-120b-4259-80ff-485c24e1a5ba (dataset): DatasetConfig { id: b6a5473f-120b-4259-80ff-485c24e1a5ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7488f50-95ef-44f2-bf72-e5bda585e164 (dataset): DatasetConfig { id: b7488f50-95ef-44f2-bf72-e5bda585e164 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb048f9b-6e03-48a7-9f42-cdfd041ef29b (dataset): DatasetConfig { id: bb048f9b-6e03-48a7-9f42-cdfd041ef29b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1de71d3-fc24-4bc2-b8ce-dd96bd969966 (dataset): DatasetConfig { id: c1de71d3-fc24-4bc2-b8ce-dd96bd969966 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c26d730c-f84f-49bc-b7ad-7ca9be040439 (dataset): DatasetConfig { id: c26d730c-f84f-49bc-b7ad-7ca9be040439 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2a01b07-5450-4621-b482-0f31613e9051 (dataset): DatasetConfig { id: c2a01b07-5450-4621-b482-0f31613e9051 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5ed2060-039e-4772-832f-52bac3fe6215 (dataset): DatasetConfig { id: c5ed2060-039e-4772-832f-52bac3fe6215 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c737a7e6-f440-44f9-a6fd-ae004b7488ef (dataset): DatasetConfig { id: c737a7e6-f440-44f9-a6fd-ae004b7488ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7d4b3d9-816c-4a78-9e9c-91b376ee1ce3 (dataset): DatasetConfig { id: c7d4b3d9-816c-4a78-9e9c-91b376ee1ce3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca3ba8c0-3f52-42d6-b841-f020591c5d60 (dataset): DatasetConfig { id: ca3ba8c0-3f52-42d6-b841-f020591c5d60 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb8f766a-6bd2-4f83-92ff-ee9ad72f58a1 (dataset): DatasetConfig { id: cb8f766a-6bd2-4f83-92ff-ee9ad72f58a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb90a35d-095d-455f-a14e-7e78f8237dd5 (dataset): DatasetConfig { id: cb90a35d-095d-455f-a14e-7e78f8237dd5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cbc41423-889e-4ea8-94cd-3caf421e9e26 (dataset): DatasetConfig { id: cbc41423-889e-4ea8-94cd-3caf421e9e26 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d689bc5d-48f9-4a98-b503-fc2e7af8c004 (dataset): DatasetConfig { id: d689bc5d-48f9-4a98-b503-fc2e7af8c004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d98054ef-bc79-4086-912d-1743a549141d (dataset): DatasetConfig { id: d98054ef-bc79-4086-912d-1743a549141d (dataset), name: DatasetName { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e2ddf379-79e5-45ab-8977-8b79037ef631 (dataset): DatasetConfig { id: e2ddf379-79e5-45ab-8977-8b79037ef631 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e673b4c7-0256-4992-8ce2-afe6e042682f (dataset): DatasetConfig { id: e673b4c7-0256-4992-8ce2-afe6e042682f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e7a4f8ae-ebaa-4258-af54-1e2659467e85 (dataset): DatasetConfig { id: e7a4f8ae-ebaa-4258-af54-1e2659467e85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f560da1e-9533-4268-8550-05b21d58648c (dataset): DatasetConfig { id: f560da1e-9533-4268-8550-05b21d58648c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7c11094-a130-401a-a4f3-2a2ee9311bf7 (dataset): DatasetConfig { id: f7c11094-a130-401a-a4f3-2a2ee9311bf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4712024-11-19T02:07:52.098ZINFOSledAgent (StorageManager): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4722024-11-19T02:07:52.098ZINFOSledAgent (StorageManager): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4732024-11-19T02:07:52.098ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:906 request = datasets_ensure
4742024-11-19T02:07:52.098ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4752024-11-19T02:07:52.098ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone" } file = sled-storage/src/manager.rs:1338
4762024-11-19T02:07:52.184ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4772024-11-19T02:07:52.184ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/zone/oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed"), full_name: "oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/zone/oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed" } file = sled-storage/src/manager.rs:1338
4782024-11-19T02:07:52.308ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4792024-11-19T02:07:52.308ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/zone/oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234"), full_name: "oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/zone/oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234" } file = sled-storage/src/manager.rs:1338
4802024-11-19T02:07:52.432ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4812024-11-19T02:07:52.432ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/debug"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/debug" } file = sled-storage/src/manager.rs:1338
4822024-11-19T02:07:52.512ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4832024-11-19T02:07:52.512ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/zone/oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785"), full_name: "oxp_e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/zone/oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785" } file = sled-storage/src/manager.rs:1338
4842024-11-19T02:07:52.636ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4852024-11-19T02:07:52.636ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone/oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone/oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981" } file = sled-storage/src/manager.rs:1338
4862024-11-19T02:07:52.758ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4872024-11-19T02:07:52.758ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/zone/oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217"), full_name: "oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/zone/oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217" } file = sled-storage/src/manager.rs:1338
4882024-11-19T02:07:52.879ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4892024-11-19T02:07:52.879ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crucible" } file = sled-storage/src/manager.rs:1338
4902024-11-19T02:07:52.967ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
4912024-11-19T02:07:52.994ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4922024-11-19T02:07:52.995ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/zone"), full_name: "oxp_e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/zone" } file = sled-storage/src/manager.rs:1338
4932024-11-19T02:07:53.081ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4942024-11-19T02:07:53.081ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
4952024-11-19T02:07:53.195ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4962024-11-19T02:07:53.195ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/zone"), full_name: "oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/zone" } file = sled-storage/src/manager.rs:1338
4972024-11-19T02:07:53.279ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4982024-11-19T02:07:53.279ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
4992024-11-19T02:07:53.392ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5002024-11-19T02:07:53.392ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/debug"), full_name: "oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/debug" } file = sled-storage/src/manager.rs:1338
5012024-11-19T02:07:53.475ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5022024-11-19T02:07:53.475ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8d92ce26-c543-4771-ad32-a160a4f547aa/crucible" } file = sled-storage/src/manager.rs:1338
5032024-11-19T02:07:53.585ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5042024-11-19T02:07:53.585ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/debug"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/debug" } file = sled-storage/src/manager.rs:1338
5052024-11-19T02:07:53.669ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5062024-11-19T02:07:53.669ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/zone/oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a"), full_name: "oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/zone/oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a" } file = sled-storage/src/manager.rs:1338
5072024-11-19T02:07:53.790ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5082024-11-19T02:07:53.790ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5092024-11-19T02:07:53.907ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5102024-11-19T02:07:53.907ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/clickhouse" } file = sled-storage/src/manager.rs:1338
5112024-11-19T02:07:53.968ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
5122024-11-19T02:07:54.023ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5132024-11-19T02:07:54.023ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e7d17670-49d1-4296-b44f-e53bcd272b84/crucible" } file = sled-storage/src/manager.rs:1338
5142024-11-19T02:07:54.145ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5152024-11-19T02:07:54.145ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crucible" } file = sled-storage/src/manager.rs:1338
5162024-11-19T02:07:54.263ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5172024-11-19T02:07:54.263ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/zone"), full_name: "oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/zone" } file = sled-storage/src/manager.rs:1338
5182024-11-19T02:07:54.350ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5192024-11-19T02:07:54.350ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crypt/zone/oxz_nexus_f02be878-8b16-4056-a261-089d083d36be"), full_name: "oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crypt/zone/oxz_nexus_f02be878-8b16-4056-a261-089d083d36be" } file = sled-storage/src/manager.rs:1338
5202024-11-19T02:07:54.478ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5212024-11-19T02:07:54.478ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5222024-11-19T02:07:54.592ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5232024-11-19T02:07:54.592ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638" } file = sled-storage/src/manager.rs:1338
5242024-11-19T02:07:54.718ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5252024-11-19T02:07:54.718ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crypt/zone/oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732"), full_name: "oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crypt/zone/oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732" } file = sled-storage/src/manager.rs:1338
5262024-11-19T02:07:54.841ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5272024-11-19T02:07:54.841ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/debug"), full_name: "oxp_e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/debug" } file = sled-storage/src/manager.rs:1338
5282024-11-19T02:07:54.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5292024-11-19T02:07:54.926ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/zone"), full_name: "oxp_2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/zone" } file = sled-storage/src/manager.rs:1338
5302024-11-19T02:07:54.973ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
5312024-11-19T02:07:55.012ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5322024-11-19T02:07:55.012ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2354be7c-bc71-4b15-9f57-06b09b66253b/crucible" } file = sled-storage/src/manager.rs:1338
5332024-11-19T02:07:55.130ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5342024-11-19T02:07:55.130ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/zone/oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c"), full_name: "oxp_2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/zone/oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c" } file = sled-storage/src/manager.rs:1338
5352024-11-19T02:07:55.252ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5362024-11-19T02:07:55.252ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crypt/debug"), full_name: "oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crypt/debug" } file = sled-storage/src/manager.rs:1338
5372024-11-19T02:07:55.338ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5382024-11-19T02:07:55.338ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/zone/oxz_crucible_f3062649-679a-4873-848a-e73bb370d040"), full_name: "oxp_e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/zone/oxz_crucible_f3062649-679a-4873-848a-e73bb370d040" } file = sled-storage/src/manager.rs:1338
5392024-11-19T02:07:55.508ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5402024-11-19T02:07:55.508ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/debug"), full_name: "oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/debug" } file = sled-storage/src/manager.rs:1338
5412024-11-19T02:07:55.606ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5422024-11-19T02:07:55.606ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/zone/oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1"), full_name: "oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/zone/oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1" } file = sled-storage/src/manager.rs:1338
5432024-11-19T02:07:55.719ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5442024-11-19T02:07:55.719ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crucible" } file = sled-storage/src/manager.rs:1338
5452024-11-19T02:07:55.834ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5462024-11-19T02:07:55.835ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone/oxz_crucible_04239608-8df7-4953-8231-9f707a26673e"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone/oxz_crucible_04239608-8df7-4953-8231-9f707a26673e" } file = sled-storage/src/manager.rs:1338
5472024-11-19T02:07:55.967ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5482024-11-19T02:07:55.967ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5492024-11-19T02:07:55.978ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
5502024-11-19T02:07:56.072ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5512024-11-19T02:07:56.072ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5522024-11-19T02:07:56.187ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5532024-11-19T02:07:56.188ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/zone/oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a"), full_name: "oxp_e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/zone/oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a" } file = sled-storage/src/manager.rs:1338
5542024-11-19T02:07:56.317ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5552024-11-19T02:07:56.317ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0" } file = sled-storage/src/manager.rs:1338
5562024-11-19T02:07:56.442ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5572024-11-19T02:07:56.442ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8d92ce26-c543-4771-ad32-a160a4f547aa/crypt/debug"), full_name: "oxp_8d92ce26-c543-4771-ad32-a160a4f547aa/crypt/debug" } file = sled-storage/src/manager.rs:1338
5582024-11-19T02:07:56.536ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5592024-11-19T02:07:56.536ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30" } file = sled-storage/src/manager.rs:1338
5602024-11-19T02:07:56.664ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5612024-11-19T02:07:56.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/zone/oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f"), full_name: "oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/zone/oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f" } file = sled-storage/src/manager.rs:1338
5622024-11-19T02:07:56.726ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6497585924144357794 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
5632024-11-19T02:07:56.726ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13805736984373425424 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
5642024-11-19T02:07:56.792ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5652024-11-19T02:07:56.792ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5662024-11-19T02:07:56.910ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5672024-11-19T02:07:56.910ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5682024-11-19T02:07:56.946ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4349
5692024-11-19T02:07:56.946ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4359 gateway = fd00:1122:3344:101::1
5702024-11-19T02:07:56.954ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4373 gateway = fd00:1122:3344:101::1
5712024-11-19T02:07:56.954ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4438
5722024-11-19T02:07:56.979ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
5732024-11-19T02:07:57.039ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5742024-11-19T02:07:57.039ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/zone/oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), full_name: "oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/zone/oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6" } file = sled-storage/src/manager.rs:1338
5752024-11-19T02:07:57.107ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4504
5762024-11-19T02:07:57.107ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4531
5772024-11-19T02:07:57.152ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4544
5782024-11-19T02:07:57.152ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4390
5792024-11-19T02:07:57.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5802024-11-19T02:07:57.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f/crucible" } file = sled-storage/src/manager.rs:1338
5812024-11-19T02:07:57.204ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4432
5822024-11-19T02:07:57.204ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4511 rack_subnet = fd00:1122:3344::
5832024-11-19T02:07:57.227ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4522
5842024-11-19T02:07:57.227ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4564
5852024-11-19T02:07:57.300ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4596
5862024-11-19T02:07:57.300ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4602
5872024-11-19T02:07:57.304ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5882024-11-19T02:07:57.304ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone/oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone/oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870" } file = sled-storage/src/manager.rs:1338
5892024-11-19T02:07:57.392ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4643
5902024-11-19T02:07:57.392ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5912024-11-19T02:07:57.434ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5922024-11-19T02:07:57.435ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/nexus.rs:527 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
5932024-11-19T02:07:57.441ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5942024-11-19T02:07:57.441ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/zone/oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9"), full_name: "oxp_2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/zone/oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9" } file = sled-storage/src/manager.rs:1338
5952024-11-19T02:07:57.473ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5962024-11-19T02:07:57.473ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
5972024-11-19T02:07:57.474ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
5982024-11-19T02:07:57.474ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5992024-11-19T02:07:57.520ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
6002024-11-19T02:07:57.576ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6012024-11-19T02:07:57.576ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone/oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone/oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b" } file = sled-storage/src/manager.rs:1338
6022024-11-19T02:07:57.701ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6032024-11-19T02:07:57.701ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8d92ce26-c543-4771-ad32-a160a4f547aa/crypt/zone/oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688"), full_name: "oxp_8d92ce26-c543-4771-ad32-a160a4f547aa/crypt/zone/oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688" } file = sled-storage/src/manager.rs:1338
6042024-11-19T02:07:57.819ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6052024-11-19T02:07:57.819ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd" } file = sled-storage/src/manager.rs:1338
6062024-11-19T02:07:57.937ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6072024-11-19T02:07:57.937ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone/oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/zone/oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401" } file = sled-storage/src/manager.rs:1338
6082024-11-19T02:07:57.982ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
6092024-11-19T02:07:58.060ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6102024-11-19T02:07:58.060ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/zone/oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c"), full_name: "oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/zone/oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c" } file = sled-storage/src/manager.rs:1338
6112024-11-19T02:07:58.135ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17955863001468384397 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
6122024-11-19T02:07:58.135ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16944226832985866918 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
6132024-11-19T02:07:58.181ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6142024-11-19T02:07:58.181ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/zone"), full_name: "oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/zone" } file = sled-storage/src/manager.rs:1338
6152024-11-19T02:07:58.259ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6162024-11-19T02:07:58.260ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/zone/oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc"), full_name: "oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/zone/oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc" } file = sled-storage/src/manager.rs:1338
6172024-11-19T02:07:58.375ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6182024-11-19T02:07:58.375ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b" } file = sled-storage/src/manager.rs:1338
6192024-11-19T02:07:58.495ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6202024-11-19T02:07:58.495ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone" } file = sled-storage/src/manager.rs:1338
6212024-11-19T02:07:58.580ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6222024-11-19T02:07:58.580ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/zone/oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154" } file = sled-storage/src/manager.rs:1338
6232024-11-19T02:07:58.700ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6242024-11-19T02:07:58.700ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crucible" } file = sled-storage/src/manager.rs:1338
6252024-11-19T02:07:58.808ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6262024-11-19T02:07:58.808ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crypt/zone"), full_name: "oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crypt/zone" } file = sled-storage/src/manager.rs:1338
6272024-11-19T02:07:58.888ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6282024-11-19T02:07:58.888ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/debug"), full_name: "oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/debug" } file = sled-storage/src/manager.rs:1338
6292024-11-19T02:07:58.966ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6302024-11-19T02:07:58.966ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
6312024-11-19T02:07:58.983ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
6322024-11-19T02:07:59.075ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6332024-11-19T02:07:59.075ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/debug"), full_name: "oxp_2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/debug" } file = sled-storage/src/manager.rs:1338
6342024-11-19T02:07:59.152ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6352024-11-19T02:07:59.152ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crucible" } file = sled-storage/src/manager.rs:1338
6362024-11-19T02:07:59.264ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6372024-11-19T02:07:59.264ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8d92ce26-c543-4771-ad32-a160a4f547aa/crypt/zone"), full_name: "oxp_8d92ce26-c543-4771-ad32-a160a4f547aa/crypt/zone" } file = sled-storage/src/manager.rs:1338
6382024-11-19T02:07:59.346ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6392024-11-19T02:07:59.346ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
6402024-11-19T02:07:59.437ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/nexus.rs:527 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
6412024-11-19T02:07:59.461ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6422024-11-19T02:07:59.461ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-datasets.json" request = datasets_ensure
6432024-11-19T02:07:59.461ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6442024-11-19T02:07:59.462ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-datasets.json" request = datasets_ensure
6452024-11-19T02:07:59.462ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6462024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6472024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6482024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6492024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6502024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6512024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6522024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6532024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6542024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6552024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6562024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6572024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6582024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6592024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6602024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6612024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6622024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6632024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6642024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6652024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6662024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6672024-11-19T02:07:59.462ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6682024-11-19T02:07:59.462ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:851 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
6692024-11-19T02:07:59.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7364242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59162 req_id = 51e8d236-50f8-424f-862d-78c7fbc1a401 response_code = 200 uri = /datasets
6702024-11-19T02:07:59.494ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: a949a8d8-46c7-4423-b760-c03f98ccf638 (service), filesystem_pool: Some(ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b190a9bf-d8b7-43c3-add4-e113c9b89870 (service), filesystem_pool: Some(ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2d59cdb7-e3b1-4e94-afa3-f64f69928234 (service), filesystem_pool: Some(ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6712024-11-19T02:07:59.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35001
6722024-11-19T02:07:59.494ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6732024-11-19T02:07:59.494ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json file = common/src/ledger.rs:189
6742024-11-19T02:07:59.494ZINFOSledAgent (ServiceManager): No ledger in /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json file = common/src/ledger.rs:189
6752024-11-19T02:07:59.494ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
6762024-11-19T02:07:59.494ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6772024-11-19T02:07:59.495ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6782024-11-19T02:07:59.495ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
6792024-11-19T02:07:59.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6802024-11-19T02:07:59.541ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6812024-11-19T02:07:59.541ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6822024-11-19T02:07:59.541ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6832024-11-19T02:07:59.597ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870 file = illumos-utils/src/zone.rs:325
6842024-11-19T02:07:59.601ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234 file = illumos-utils/src/zone.rs:325
6852024-11-19T02:07:59.605ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638 file = illumos-utils/src/zone.rs:325
6862024-11-19T02:07:59.617ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870 file = illumos-utils/src/zone.rs:363
6872024-11-19T02:07:59.622ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234 file = illumos-utils/src/zone.rs:363
6882024-11-19T02:07:59.626ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638 file = illumos-utils/src/zone.rs:363
6892024-11-19T02:07:59.985ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ffe74824-0c08-48e1-a755-fb123e8dc181) file = sled-agent/src/probe_manager.rs:231 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
6902024-11-19T02:08:01.251ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6912024-11-19T02:08:01.251ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6922024-11-19T02:08:01.730ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6932024-11-19T02:08:01.730ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
6942024-11-19T02:08:01.734ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6952024-11-19T02:08:02.217ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6962024-11-19T02:08:02.217ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
6972024-11-19T02:08:02.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234") failed: Property not found. retry in 66.435789ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
6982024-11-19T02:08:02.231ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6992024-11-19T02:08:02.231ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638
7002024-11-19T02:08:02.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234") failed: Property not found. retry in 128.430169ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
7012024-11-19T02:08:02.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870") failed: Property not found. retry in 36.408893ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
7022024-11-19T02:08:02.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638") failed: Property not found. retry in 55.037699ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638
7032024-11-19T02:08:02.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870") failed: Property not found. retry in 122.22515ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
7042024-11-19T02:08:02.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638") failed: Property not found. retry in 149.723793ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638
7052024-11-19T02:08:02.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234") failed: Property not found. retry in 157.491001ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
7062024-11-19T02:08:02.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870") failed: Property not found. retry in 141.016923ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
7072024-11-19T02:08:02.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638") failed: Property not found. retry in 105.227108ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638
7082024-11-19T02:08:02.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234") failed: Property not found. retry in 427.571185ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
7092024-11-19T02:08:02.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870") failed: Property not found. retry in 454.401885ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
7102024-11-19T02:08:02.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638") failed: Property not found. retry in 223.138575ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638
7112024-11-19T02:08:03.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638") failed: Property not found. retry in 977.293782ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638
7122024-11-19T02:08:03.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234") failed: Property not found. retry in 630.199804ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
7132024-11-19T02:08:03.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870") failed: Property not found. retry in 679.472444ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
7142024-11-19T02:08:03.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234") failed: Property not found. retry in 1.377375796s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
7152024-11-19T02:08:03.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870") failed: Property not found. retry in 887.824853ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
7162024-11-19T02:08:04.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638") failed: Property not found. retry in 1.477947859s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638
7172024-11-19T02:08:04.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870") failed: Property not found. retry in 1.49197729s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
7182024-11-19T02:08:05.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234") failed: Property not found. retry in 773.135382ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
7192024-11-19T02:08:05.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638") failed: Property not found. retry in 698.928518ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638
7202024-11-19T02:08:05.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234") failed: Property not found. retry in 537.554767ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
7212024-11-19T02:08:06.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638") failed: Property not found. retry in 1.267379189s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638
7222024-11-19T02:08:06.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870") failed: Property not found. retry in 509.019175ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
7232024-11-19T02:08:06.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234") failed: Property not found. retry in 1.375533909s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
7242024-11-19T02:08:06.727ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6497585924144357794 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
7252024-11-19T02:08:06.727ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13805736984373425424 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
7262024-11-19T02:08:06.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870") failed: Property not found. retry in 596.294966ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
7272024-11-19T02:08:07.883ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_internal_dns_a949a8d8-46c7-4423-b760-c03f98ccf638
7282024-11-19T02:08:07.883ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_internal_dns_b190a9bf-d8b7-43c3-add4-e113c9b89870
7292024-11-19T02:08:07.883ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_internal_dns_2d59cdb7-e3b1-4e94-afa3-f64f69928234
7302024-11-19T02:08:07.883ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7312024-11-19T02:08:07.883ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json"
7322024-11-19T02:08:07.883ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7332024-11-19T02:08:07.883ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json"
7342024-11-19T02:08:07.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8389423 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35001 req_id = 24197528-379b-4c36-8e24-4a42d9595b34 response_code = 204 uri = /omicron-zones
7352024-11-19T02:08:07.886ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7362024-11-19T02:08:08.137ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17955863001468384397 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
7372024-11-19T02:08:08.137ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16944226832985866918 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
7382024-11-19T02:08:08.593ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 116.734271ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7392024-11-19T02:08:08.738ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7402024-11-19T02:08:08.790ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7412024-11-19T02:08:08.844ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7422024-11-19T02:08:08.844ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7432024-11-19T02:08:08.876ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7442024-11-19T02:08:08.877ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7452024-11-19T02:08:08.877ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7462024-11-19T02:08:08.906ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: a949a8d8-46c7-4423-b760-c03f98ccf638 (service), filesystem_pool: Some(ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b190a9bf-d8b7-43c3-add4-e113c9b89870 (service), filesystem_pool: Some(ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2d59cdb7-e3b1-4e94-afa3-f64f69928234 (service), filesystem_pool: Some(ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc (service), filesystem_pool: Some(ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eafd3e7f-0467-44a5-92fc-f3d4f54dbcff, kind: Service { id: f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc }, name: Name("ntp-f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 166])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7472024-11-19T02:08:08.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43966
7482024-11-19T02:08:08.906ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7492024-11-19T02:08:08.906ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json file = common/src/ledger.rs:178
7502024-11-19T02:08:08.907ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json file = common/src/ledger.rs:178
7512024-11-19T02:08:08.907ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
7522024-11-19T02:08:08.907ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7532024-11-19T02:08:08.907ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7542024-11-19T02:08:08.907ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
7552024-11-19T02:08:08.907ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7562024-11-19T02:08:08.920ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7572024-11-19T02:08:08.953ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7582024-11-19T02:08:08.953ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7592024-11-19T02:08:08.953ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7602024-11-19T02:08:08.983ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 143, 166]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7612024-11-19T02:08:08.983ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = boundary_ntp
7622024-11-19T02:08:08.983ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7632024-11-19T02:08:08.983ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7642024-11-19T02:08:08.984ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7652024-11-19T02:08:08.984ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7662024-11-19T02:08:09.013ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc file = illumos-utils/src/zone.rs:325
7672024-11-19T02:08:09.031ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc file = illumos-utils/src/zone.rs:363
7682024-11-19T02:08:09.652ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7692024-11-19T02:08:09.653ZINFOSledAgent (ServiceManager): Booting oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7702024-11-19T02:08:09.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc") failed: Property not found. retry in 26.987319ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7712024-11-19T02:08:09.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc") failed: Property not found. retry in 63.277973ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7722024-11-19T02:08:09.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc") failed: Property not found. retry in 156.237471ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7732024-11-19T02:08:10.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc") failed: Property not found. retry in 411.165033ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7742024-11-19T02:08:10.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc") failed: Property not found. retry in 681.782969ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7752024-11-19T02:08:11.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc") failed: Property not found. retry in 926.616602ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7762024-11-19T02:08:12.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc") failed: Property not found. retry in 1.055890783s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7772024-11-19T02:08:13.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc") failed: Property not found. retry in 663.53033ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7782024-11-19T02:08:13.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc") failed: Property not found. retry in 692.076742ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7792024-11-19T02:08:14.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc") failed: Property not found. retry in 598.420697ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7802024-11-19T02:08:15.177ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc
7812024-11-19T02:08:15.177ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7822024-11-19T02:08:15.178ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json"
7832024-11-19T02:08:15.178ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7842024-11-19T02:08:15.178ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json"
7852024-11-19T02:08:15.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6271815 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43966 req_id = bd92cd81-8af0-4cdb-8441-b12604458093 response_code = 204 uri = /omicron-zones
7862024-11-19T02:08:15.181ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7872024-11-19T02:08:15.211ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7882024-11-19T02:08:15.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33776
7892024-11-19T02:08:15.220ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3957
7902024-11-19T02:08:15.220ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8831 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33776 req_id = 827ec9ed-0a44-4dbe-89b7-bca582f2c76e response_code = 500 uri = /timesync
7912024-11-19T02:08:15.223ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7922024-11-19T02:08:15.349ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7932024-11-19T02:08:15.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39204
7942024-11-19T02:08:16.730ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6497585924144357794 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
7952024-11-19T02:08:16.730ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13805736984373425424 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
7962024-11-19T02:08:17.502ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10312260822335198997 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
7972024-11-19T02:08:17.541ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1203125376359548628 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
7982024-11-19T02:08:17.886ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2961916095166559809 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
7992024-11-19T02:08:18.139ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17955863001468384397 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8002024-11-19T02:08:18.139ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16944226832985866918 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8012024-11-19T02:08:19.358ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3957
8022024-11-19T02:08:19.358ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008815 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39204 req_id = 9c5ac828-c366-4480-b4b3-7539475c0aaf response_code = 500 uri = /timesync
8032024-11-19T02:08:19.362ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8042024-11-19T02:08:19.556ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8052024-11-19T02:08:19.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39223
8062024-11-19T02:08:19.565ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3957
8072024-11-19T02:08:19.566ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9549 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39223 req_id = a890bb2f-69a4-40d8-ae5c-97333f5dec28 response_code = 500 uri = /timesync
8082024-11-19T02:08:19.568ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8092024-11-19T02:08:19.709ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8102024-11-19T02:08:19.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39363
8112024-11-19T02:08:22.795ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3957
8122024-11-19T02:08:22.795ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39363 req_id = 05539409-e060-4ab5-bf19-d683a0a57aca response_code = 500 uri = /timesync
8132024-11-19T02:08:22.798ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8142024-11-19T02:08:23.055ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8152024-11-19T02:08:23.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45498
8162024-11-19T02:08:23.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9092 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45498 req_id = efb9ff92-119b-4277-80f5-3939a3022a2e response_code = 200 uri = /timesync
8172024-11-19T02:08:23.067ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.039260358 } file = sled-agent/src/rack_setup/service.rs:740
8182024-11-19T02:08:23.067ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8192024-11-19T02:08:23.380ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8202024-11-19T02:08:23.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53126
8212024-11-19T02:08:23.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8040 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53126 req_id = 4dc1c527-f5b0-4c78-9666-4eb483eccf35 response_code = 200 uri = /timesync
8222024-11-19T02:08:23.392ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731982103.1272416, correction: 0.052412216 } file = sled-agent/src/rack_setup/service.rs:740
8232024-11-19T02:08:23.392ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8242024-11-19T02:08:23.637ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8252024-11-19T02:08:23.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64443
8262024-11-19T02:08:23.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8985 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64443 req_id = ef2839c3-e909-46a9-a9b0-852310c923d4 response_code = 200 uri = /timesync
8272024-11-19T02:08:23.648ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731982102.5287938, correction: 0.051715977 } file = sled-agent/src/rack_setup/service.rs:740
8282024-11-19T02:08:23.648ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8292024-11-19T02:08:24.016ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8302024-11-19T02:08:24.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65111
8312024-11-19T02:08:24.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65111 req_id = 830ed24a-7959-476d-99c1-985edeaff229 response_code = 200 uri = /timesync
8322024-11-19T02:08:24.027ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731982102.5287938, correction: 0.050694164 } file = sled-agent/src/rack_setup/service.rs:740
8332024-11-19T02:08:24.027ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8342024-11-19T02:08:24.262ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5046994840937997394 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8352024-11-19T02:08:24.262ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2254157094343873257 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8362024-11-19T02:08:24.528ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8372024-11-19T02:08:24.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41906
8382024-11-19T02:08:24.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9617 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41906 req_id = 8a59aaa0-e2e6-4e33-806e-e03d5f13a8e3 response_code = 200 uri = /timesync
8392024-11-19T02:08:24.541ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731982102.5287938, correction: 0.049319018 } file = sled-agent/src/rack_setup/service.rs:740
8402024-11-19T02:08:24.541ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8412024-11-19T02:08:24.975ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8422024-11-19T02:08:24.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38331
8432024-11-19T02:08:24.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8885 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38331 req_id = 3ff16408-0baa-4038-9878-9f1c8fecd96e response_code = 200 uri = /timesync
8442024-11-19T02:08:24.986ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731982102.5287938, correction: 0.048112784 } file = sled-agent/src/rack_setup/service.rs:740
8452024-11-19T02:08:24.986ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8462024-11-19T02:08:25.648ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8472024-11-19T02:08:25.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49545
8482024-11-19T02:08:25.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8903 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49545 req_id = f85f5bfb-fc39-459a-a1d0-cb1233559ace response_code = 200 uri = /timesync
8492024-11-19T02:08:25.659ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731982102.5287938, correction: 0.046263382 } file = sled-agent/src/rack_setup/service.rs:740
8502024-11-19T02:08:25.659ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8512024-11-19T02:08:25.818ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6497585924144357794 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8522024-11-19T02:08:25.818ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13805736984373425424 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8532024-11-19T02:08:26.060ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8542024-11-19T02:08:26.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50962
8552024-11-19T02:08:26.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8058 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50962 req_id = 6d0dac6b-bb82-4ff4-9ec5-2ff926fd0ca0 response_code = 200 uri = /timesync
8562024-11-19T02:08:26.071ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731982102.5287938, correction: 0.045150109 } file = sled-agent/src/rack_setup/service.rs:740
8572024-11-19T02:08:26.071ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8582024-11-19T02:08:26.239ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53345
8592024-11-19T02:08:26.239ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53345 req_id = beb64d3d-29a1-4193-8a3a-f41cef694023 response_code = 200 uri = /baseboard
8602024-11-19T02:08:26.590ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10312260822335198997 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8612024-11-19T02:08:26.630ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1203125376359548628 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8622024-11-19T02:08:26.976ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2961916095166559809 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8632024-11-19T02:08:27.176ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8642024-11-19T02:08:27.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60411
8652024-11-19T02:08:27.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60411 req_id = f23d40c6-132a-4f4c-8c4a-34e06efbe511 response_code = 200 uri = /timesync
8662024-11-19T02:08:27.188ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731982102.5287938, correction: 0.042133421 } file = sled-agent/src/rack_setup/service.rs:740
8672024-11-19T02:08:27.188ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8682024-11-19T02:08:27.229ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17955863001468384397 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8692024-11-19T02:08:27.230ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16944226832985866918 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8702024-11-19T02:08:27.438ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 143.616165ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
8712024-11-19T02:08:28.154ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8722024-11-19T02:08:28.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36673
8732024-11-19T02:08:28.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36673 req_id = 03767fd5-6b8f-4362-9e14-935f685b2a29 response_code = 200 uri = /timesync
8742024-11-19T02:08:28.179ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731982106.528177, correction: 0.039519936 } file = sled-agent/src/rack_setup/service.rs:740
8752024-11-19T02:08:28.179ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
8762024-11-19T02:08:28.209ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: a949a8d8-46c7-4423-b760-c03f98ccf638 (service), filesystem_pool: Some(ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b190a9bf-d8b7-43c3-add4-e113c9b89870 (service), filesystem_pool: Some(ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2d59cdb7-e3b1-4e94-afa3-f64f69928234 (service), filesystem_pool: Some(ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc (service), filesystem_pool: Some(ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eafd3e7f-0467-44a5-92fc-f3d4f54dbcff, kind: Service { id: f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc }, name: Name("ntp-f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 166])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: bc5f4ecd-6162-4e72-943f-af3020fda9cd (service), filesystem_pool: Some(ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External } } } }, OmicronZoneConfig { id: ffcffd7e-1068-49ed-aab5-7474c7f31981 (service), filesystem_pool: Some(ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External } } } }, OmicronZoneConfig { id: 077d2af4-9ff0-4928-829a-aedaa36bd77a (service), filesystem_pool: Some(ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External } } } }, OmicronZoneConfig { id: 03b1827a-6711-4c7f-8de5-3704d1ff91f9 (service), filesystem_pool: Some(ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External } } } }, OmicronZoneConfig { id: cda226a6-c6f6-4d44-86d7-a0521c865217 (service), filesystem_pool: Some(ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
8772024-11-19T02:08:28.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49661
8782024-11-19T02:08:28.209ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8792024-11-19T02:08:28.209ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json file = common/src/ledger.rs:178
8802024-11-19T02:08:28.209ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json file = common/src/ledger.rs:178
8812024-11-19T02:08:28.209ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
8822024-11-19T02:08:28.210ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
8832024-11-19T02:08:28.210ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
8842024-11-19T02:08:28.210ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
8852024-11-19T02:08:28.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8862024-11-19T02:08:28.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8872024-11-19T02:08:28.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8882024-11-19T02:08:28.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8892024-11-19T02:08:28.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8902024-11-19T02:08:28.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8912024-11-19T02:08:28.387ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217 file = illumos-utils/src/zone.rs:325
8922024-11-19T02:08:28.391ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd file = illumos-utils/src/zone.rs:325
8932024-11-19T02:08:28.396ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a file = illumos-utils/src/zone.rs:325
8942024-11-19T02:08:28.401ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9 file = illumos-utils/src/zone.rs:325
8952024-11-19T02:08:28.406ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981 file = illumos-utils/src/zone.rs:325
8962024-11-19T02:08:28.410ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217 file = illumos-utils/src/zone.rs:363
8972024-11-19T02:08:28.416ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd file = illumos-utils/src/zone.rs:363
8982024-11-19T02:08:28.420ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a file = illumos-utils/src/zone.rs:363
8992024-11-19T02:08:28.424ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9 file = illumos-utils/src/zone.rs:363
9002024-11-19T02:08:28.428ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981 file = illumos-utils/src/zone.rs:363
9012024-11-19T02:08:31.266ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ffcffd7e-1068-49ed-aab5-7474c7f31981'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9022024-11-19T02:08:31.266ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9032024-11-19T02:08:31.302ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='03b1827a-6711-4c7f-8de5-3704d1ff91f9'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9042024-11-19T02:08:31.302ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9052024-11-19T02:08:31.308ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='bc5f4ecd-6162-4e72-943f-af3020fda9cd'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9062024-11-19T02:08:31.308ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9072024-11-19T02:08:31.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 71.216183ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9082024-11-19T02:08:31.420ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='077d2af4-9ff0-4928-829a-aedaa36bd77a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9092024-11-19T02:08:31.420ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9102024-11-19T02:08:31.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 66.160545ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9112024-11-19T02:08:31.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 56.529524ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9122024-11-19T02:08:31.459ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cda226a6-c6f6-4d44-86d7-a0521c865217'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9132024-11-19T02:08:31.459ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9142024-11-19T02:08:31.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 75.723911ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9152024-11-19T02:08:31.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 51.084846ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9162024-11-19T02:08:31.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 145.190276ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9172024-11-19T02:08:32.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 170.986463ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9182024-11-19T02:08:32.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 101.903065ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9192024-11-19T02:08:32.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 218.129698ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9202024-11-19T02:08:32.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 69.342452ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9212024-11-19T02:08:32.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 33.528454ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9222024-11-19T02:08:32.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 89.492693ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9232024-11-19T02:08:32.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 568.997879ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9242024-11-19T02:08:32.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 72.294165ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9252024-11-19T02:08:32.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 438.070603ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9262024-11-19T02:08:32.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 150.065801ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9272024-11-19T02:08:32.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 232.81025ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9282024-11-19T02:08:32.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 210.509873ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9292024-11-19T02:08:32.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 441.006373ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9302024-11-19T02:08:33.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 680.099067ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9312024-11-19T02:08:33.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 285.062741ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9322024-11-19T02:08:33.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 1.173772113s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9332024-11-19T02:08:33.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 1.113453507s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9342024-11-19T02:08:33.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 473.519251ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9352024-11-19T02:08:33.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 755.414693ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9362024-11-19T02:08:33.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 539.703361ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9372024-11-19T02:08:33.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 1.293417939s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9382024-11-19T02:08:34.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 616.527321ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9392024-11-19T02:08:34.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 1.182328454s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9402024-11-19T02:08:34.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 1.430055806s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9412024-11-19T02:08:34.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 543.413457ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9422024-11-19T02:08:34.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 1.437023341s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9432024-11-19T02:08:34.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 1.301615195s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9442024-11-19T02:08:35.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 837.427712ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9452024-11-19T02:08:35.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 1.345245174s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9462024-11-19T02:08:35.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 1.140850123s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9472024-11-19T02:08:35.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 793.44925ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9482024-11-19T02:08:36.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 1.226793789s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9492024-11-19T02:08:36.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 573.536911ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9502024-11-19T02:08:36.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 1.238510028s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9512024-11-19T02:08:36.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 644.321691ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9522024-11-19T02:08:36.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 610.729402ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9532024-11-19T02:08:36.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 828.676113ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9542024-11-19T02:08:37.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 527.702864ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9552024-11-19T02:08:37.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 1.447284709s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9562024-11-19T02:08:37.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 1.083890604s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9572024-11-19T02:08:37.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 735.746814ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9582024-11-19T02:08:37.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 1.012420694s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9592024-11-19T02:08:38.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 1.397347855s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9602024-11-19T02:08:38.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 1.004986974s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9612024-11-19T02:08:38.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 1.074640564s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9622024-11-19T02:08:38.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 1.23902703s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9632024-11-19T02:08:38.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 1.40992708s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9642024-11-19T02:08:39.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 736.468177ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9652024-11-19T02:08:39.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 1.262910707s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9662024-11-19T02:08:39.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 1.381634473s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9672024-11-19T02:08:40.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 1.085198713s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9682024-11-19T02:08:40.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 1.166260566s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9692024-11-19T02:08:40.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 878.668078ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9702024-11-19T02:08:40.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 576.885712ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9712024-11-19T02:08:41.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 800.490197ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9722024-11-19T02:08:41.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 953.164599ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9732024-11-19T02:08:41.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 771.328786ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9742024-11-19T02:08:41.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd") failed: Property not found. retry in 894.885175ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9752024-11-19T02:08:41.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 631.281362ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9762024-11-19T02:08:41.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981") failed: Property not found. retry in 790.875478ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9772024-11-19T02:08:42.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217") failed: Property not found. retry in 778.033241ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9782024-11-19T02:08:42.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a") failed: Property not found. retry in 554.652835ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9792024-11-19T02:08:42.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 1.011042047s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9802024-11-19T02:08:42.657ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 633.64125ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
9812024-11-19T02:08:43.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 818.937553ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9822024-11-19T02:08:44.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 1.177189621s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9832024-11-19T02:08:45.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 927.234242ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9842024-11-19T02:08:46.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 1.394133152s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9852024-11-19T02:08:47.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 1.014603901s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9862024-11-19T02:08:49.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 504.187883ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9872024-11-19T02:08:49.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 862.537256ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9882024-11-19T02:08:50.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 869.541323ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9892024-11-19T02:08:51.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9") failed: Property not found. retry in 1.341144289s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9902024-11-19T02:08:52.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_cockroachdb_cda226a6-c6f6-4d44-86d7-a0521c865217
9912024-11-19T02:08:52.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_cockroachdb_bc5f4ecd-6162-4e72-943f-af3020fda9cd
9922024-11-19T02:08:52.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_cockroachdb_077d2af4-9ff0-4928-829a-aedaa36bd77a
9932024-11-19T02:08:52.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9
9942024-11-19T02:08:52.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_cockroachdb_ffcffd7e-1068-49ed-aab5-7474c7f31981
9952024-11-19T02:08:52.886ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
9962024-11-19T02:08:52.901ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json"
9972024-11-19T02:08:52.901ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
9982024-11-19T02:08:52.930ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json"
9992024-11-19T02:08:52.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24680502 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49661 req_id = 873c5cf4-1fe6-4ea6-9694-4f3d2a105462 response_code = 204 uri = /omicron-zones
10002024-11-19T02:08:52.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36702
10012024-11-19T02:08:53.021ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 41878 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36702 req_id = 5d54e4c8-79db-4571-87fc-2b401fffd4b9 response_code = 500 uri = /cockroachdb
10022024-11-19T02:08:53.021ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5d54e4c8-79db-4571-87fc-2b401fffd4b9", "content-length": "124", "date": "Tue, 19 Nov 2024 02:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5d54e4c8-79db-4571-87fc-2b401fffd4b9" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 143.829228ms
10032024-11-19T02:08:53.193ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26929 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36702 req_id = b0c1b7d2-bf4c-4cb2-be0d-48a301640f0a response_code = 500 uri = /cockroachdb
10042024-11-19T02:08:53.193ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b0c1b7d2-bf4c-4cb2-be0d-48a301640f0a", "content-length": "124", "date": "Tue, 19 Nov 2024 02:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b0c1b7d2-bf4c-4cb2-be0d-48a301640f0a" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 88.219964ms
10052024-11-19T02:08:53.308ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36702 req_id = 42e6a8c8-d734-41ba-8dd8-5a1eb7f270f7 response_code = 500 uri = /cockroachdb
10062024-11-19T02:08:53.308ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "42e6a8c8-d734-41ba-8dd8-5a1eb7f270f7", "content-length": "124", "date": "Tue, 19 Nov 2024 02:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "42e6a8c8-d734-41ba-8dd8-5a1eb7f270f7" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 194.263309ms
10072024-11-19T02:08:53.532ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29283 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36702 req_id = dddaead9-24eb-442b-9fe4-08675d8c8196 response_code = 500 uri = /cockroachdb
10082024-11-19T02:08:53.533ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dddaead9-24eb-442b-9fe4-08675d8c8196", "content-length": "124", "date": "Tue, 19 Nov 2024 02:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dddaead9-24eb-442b-9fe4-08675d8c8196" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 165.106949ms
10092024-11-19T02:08:53.728ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28889 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36702 req_id = 56cbb18c-baa2-4cbc-b6a7-7347a1ab878c response_code = 500 uri = /cockroachdb
10102024-11-19T02:08:53.728ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "56cbb18c-baa2-4cbc-b6a7-7347a1ab878c", "content-length": "124", "date": "Tue, 19 Nov 2024 02:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "56cbb18c-baa2-4cbc-b6a7-7347a1ab878c" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 242.840632ms
10112024-11-19T02:08:53.998ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25534 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36702 req_id = 9a7a6cd6-7e30-4845-ab13-fe44195fd7e8 response_code = 500 uri = /cockroachdb
10122024-11-19T02:08:53.998ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9a7a6cd6-7e30-4845-ab13-fe44195fd7e8", "content-length": "124", "date": "Tue, 19 Nov 2024 02:08:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9a7a6cd6-7e30-4845-ab13-fe44195fd7e8" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 360.789122ms
10132024-11-19T02:08:54.387ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_03b1827a-6711-4c7f-8de5-3704d1ff91f9 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26918 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36702 req_id = 10e598eb-36df-4fd6-a52f-7cd23a1d83cc response_code = 500 uri = /cockroachdb
10142024-11-19T02:08:54.387ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "10e598eb-36df-4fd6-a52f-7cd23a1d83cc", "content-length": "124", "date": "Tue, 19 Nov 2024 02:08:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "10e598eb-36df-4fd6-a52f-7cd23a1d83cc" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 169.91346ms
10152024-11-19T02:08:54.584ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3800
10162024-11-19T02:08:57.247ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3818
10172024-11-19T02:08:59.769ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3841
10182024-11-19T02:08:59.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5210960 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36702 req_id = 9128cc51-4e0c-4338-af40-31d740a9d9c8 response_code = 204 uri = /cockroachdb
10192024-11-19T02:08:59.769ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64749
10202024-11-19T02:08:59.770ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64749 req_id = 83a558a6-d7d5-42be-93e6-5566b376ca73 response_code = 200 uri = /baseboard
10212024-11-19T02:08:59.774ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.448005601s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
10222024-11-19T02:08:59.805ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: a949a8d8-46c7-4423-b760-c03f98ccf638 (service), filesystem_pool: Some(ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b190a9bf-d8b7-43c3-add4-e113c9b89870 (service), filesystem_pool: Some(ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 2d59cdb7-e3b1-4e94-afa3-f64f69928234 (service), filesystem_pool: Some(ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc (service), filesystem_pool: Some(ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: eafd3e7f-0467-44a5-92fc-f3d4f54dbcff, kind: Service { id: f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc }, name: Name("ntp-f60c9ffc-31d8-4ec4-9e95-9ae78f5c8afc"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 166])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: bc5f4ecd-6162-4e72-943f-af3020fda9cd (service), filesystem_pool: Some(ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External } } } }, OmicronZoneConfig { id: ffcffd7e-1068-49ed-aab5-7474c7f31981 (service), filesystem_pool: Some(ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External } } } }, OmicronZoneConfig { id: 077d2af4-9ff0-4928-829a-aedaa36bd77a (service), filesystem_pool: Some(ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External } } } }, OmicronZoneConfig { id: 03b1827a-6711-4c7f-8de5-3704d1ff91f9 (service), filesystem_pool: Some(ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External } } } }, OmicronZoneConfig { id: cda226a6-c6f6-4d44-86d7-a0521c865217 (service), filesystem_pool: Some(ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External } } } }, OmicronZoneConfig { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 (service), filesystem_pool: Some(ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b (service), filesystem_pool: Some(ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 (service), filesystem_pool: Some(ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: f02be878-8b16-4056-a261-089d083d36be (service), filesystem_pool: Some(ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 (service), filesystem_pool: Some(ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3980dd20-a3be-40d3-b9e5-094b8ed4b785 (service), filesystem_pool: Some(ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b (service), filesystem_pool: Some(ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External } } } }, OmicronZoneConfig { id: a4ddddbe-ea8a-409e-8d9a-b8f9f873132a (service), filesystem_pool: Some(ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 6fec4bd4-abae-46b2-a507-115c698e8d5c (service), filesystem_pool: Some(ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 6a02500f-82bd-4c6c-99d2-7bb9d3b0d401 (service), filesystem_pool: Some(ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 084a25f6-4801-4b44-b631-2f827073d154 (service), filesystem_pool: Some(ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External } } } }, OmicronZoneConfig { id: 04239608-8df7-4953-8231-9f707a26673e (service), filesystem_pool: Some(ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External } } } }, OmicronZoneConfig { id: bfcdd2e0-969b-457f-977b-af1fe74cc9ed (service), filesystem_pool: Some(ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External } } } }, OmicronZoneConfig { id: f5cf8587-6819-4369-b97f-184f0d6af06c (service), filesystem_pool: Some(ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External } } } }, OmicronZoneConfig { id: 0632e7ec-4407-414f-9b23-4e6a0dcc5a9f (service), filesystem_pool: Some(ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External } } } }, OmicronZoneConfig { id: 92019d54-3d1f-4ee6-b1f9-ef0abd144fc1 (service), filesystem_pool: Some(ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External } } } }, OmicronZoneConfig { id: f3062649-679a-4873-848a-e73bb370d040 (service), filesystem_pool: Some(ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9386ef68-a6d3-49fe-b610-70909ac5e732 (service), filesystem_pool: Some(ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External } } } }, OmicronZoneConfig { id: eaaa04df-c2c4-4fc9-883b-6a4897932688 (service), filesystem_pool: Some(ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10232024-11-19T02:08:59.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48818
10242024-11-19T02:08:59.805ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10252024-11-19T02:08:59.805ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json file = common/src/ledger.rs:178
10262024-11-19T02:08:59.806ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json file = common/src/ledger.rs:178
10272024-11-19T02:08:59.806ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
10282024-11-19T02:08:59.806ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10292024-11-19T02:08:59.819ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10302024-11-19T02:08:59.819ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
10312024-11-19T02:08:59.819ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10322024-11-19T02:08:59.981ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10332024-11-19T02:08:59.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10342024-11-19T02:08:59.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10352024-11-19T02:08:59.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10362024-11-19T02:08:59.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10372024-11-19T02:09:00.041ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10382024-11-19T02:09:00.041ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10392024-11-19T02:09:00.041ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10402024-11-19T02:09:00.041ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10412024-11-19T02:09:00.041ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10422024-11-19T02:09:00.198ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10432024-11-19T02:09:00.212ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10442024-11-19T02:09:00.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10452024-11-19T02:09:00.215ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10462024-11-19T02:09:00.215ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10472024-11-19T02:09:00.253ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10482024-11-19T02:09:00.253ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10492024-11-19T02:09:00.253ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10502024-11-19T02:09:00.253ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10512024-11-19T02:09:00.253ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f3062649-679a-4873-848a-e73bb370d040 file = illumos-utils/src/zone.rs:325
10522024-11-19T02:09:00.258ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b file = illumos-utils/src/zone.rs:325
10532024-11-19T02:09:00.262ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c file = illumos-utils/src/zone.rs:325
10542024-11-19T02:09:00.267ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688 file = illumos-utils/src/zone.rs:325
10552024-11-19T02:09:00.272ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_04239608-8df7-4953-8231-9f707a26673e file = illumos-utils/src/zone.rs:325
10562024-11-19T02:09:00.277ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732 file = illumos-utils/src/zone.rs:325
10572024-11-19T02:09:00.281ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed file = illumos-utils/src/zone.rs:325
10582024-11-19T02:09:00.286ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c file = illumos-utils/src/zone.rs:325
10592024-11-19T02:09:00.401ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f3062649-679a-4873-848a-e73bb370d040 file = illumos-utils/src/zone.rs:363
10602024-11-19T02:09:00.405ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b file = illumos-utils/src/zone.rs:363
10612024-11-19T02:09:00.410ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c file = illumos-utils/src/zone.rs:363
10622024-11-19T02:09:00.414ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688 file = illumos-utils/src/zone.rs:363
10632024-11-19T02:09:00.419ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_04239608-8df7-4953-8231-9f707a26673e file = illumos-utils/src/zone.rs:363
10642024-11-19T02:09:00.424ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732 file = illumos-utils/src/zone.rs:363
10652024-11-19T02:09:00.429ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed file = illumos-utils/src/zone.rs:363
10662024-11-19T02:09:00.434ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c file = illumos-utils/src/zone.rs:363
10672024-11-19T02:09:00.439ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a file = illumos-utils/src/zone.rs:325
10682024-11-19T02:09:00.444ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401 file = illumos-utils/src/zone.rs:325
10692024-11-19T02:09:00.450ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = illumos-utils/src/zone.rs:325
10702024-11-19T02:09:00.455ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154 file = illumos-utils/src/zone.rs:325
10712024-11-19T02:09:00.461ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f file = illumos-utils/src/zone.rs:325
10722024-11-19T02:09:00.466ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1 file = illumos-utils/src/zone.rs:325
10732024-11-19T02:09:00.525ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10742024-11-19T02:09:00.585ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10752024-11-19T02:09:00.586ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a file = illumos-utils/src/zone.rs:363
10762024-11-19T02:09:00.606ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401 file = illumos-utils/src/zone.rs:363
10772024-11-19T02:09:00.625ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785 file = illumos-utils/src/zone.rs:363
10782024-11-19T02:09:00.634ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154 file = illumos-utils/src/zone.rs:363
10792024-11-19T02:09:00.642ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f file = illumos-utils/src/zone.rs:363
10802024-11-19T02:09:00.651ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1 file = illumos-utils/src/zone.rs:363
10812024-11-19T02:09:00.720ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10822024-11-19T02:09:00.778ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10832024-11-19T02:09:00.836ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10842024-11-19T02:09:00.840ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10852024-11-19T02:09:00.840ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10862024-11-19T02:09:00.895ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 144, 194]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10872024-11-19T02:09:00.895ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
10882024-11-19T02:09:00.897ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10892024-11-19T02:09:00.897ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10902024-11-19T02:09:00.952ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 179, 175]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10912024-11-19T02:09:00.952ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
10922024-11-19T02:09:00.964ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10932024-11-19T02:09:00.964ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10942024-11-19T02:09:01.053ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 214, 251]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10952024-11-19T02:09:01.053ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
10962024-11-19T02:09:01.054ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10972024-11-19T02:09:01.054ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10982024-11-19T02:09:01.111ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 153, 230]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10992024-11-19T02:09:01.111ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
11002024-11-19T02:09:01.111ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11012024-11-19T02:09:01.111ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11022024-11-19T02:09:01.111ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11032024-11-19T02:09:01.111ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11042024-11-19T02:09:01.113ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11052024-11-19T02:09:01.113ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11062024-11-19T02:09:01.177ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 212, 62]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11072024-11-19T02:09:01.177ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
11082024-11-19T02:09:01.177ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11092024-11-19T02:09:01.180ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11102024-11-19T02:09:01.183ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11112024-11-19T02:09:01.183ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11122024-11-19T02:09:01.294ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11132024-11-19T02:09:01.294ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11142024-11-19T02:09:01.295ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11152024-11-19T02:09:01.295ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11162024-11-19T02:09:01.296ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 file = illumos-utils/src/zone.rs:325
11172024-11-19T02:09:01.309ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11182024-11-19T02:09:01.309ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11192024-11-19T02:09:01.309ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11202024-11-19T02:09:01.313ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11212024-11-19T02:09:01.317ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11222024-11-19T02:09:01.317ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11232024-11-19T02:09:01.317ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11242024-11-19T02:09:01.443ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11252024-11-19T02:09:01.444ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 file = illumos-utils/src/zone.rs:363
11262024-11-19T02:09:01.455ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b file = illumos-utils/src/zone.rs:325
11272024-11-19T02:09:01.537ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0 file = illumos-utils/src/zone.rs:325
11282024-11-19T02:09:01.565ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30 file = illumos-utils/src/zone.rs:325
11292024-11-19T02:09:01.575ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b file = illumos-utils/src/zone.rs:363
11302024-11-19T02:09:01.602ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_f02be878-8b16-4056-a261-089d083d36be file = illumos-utils/src/zone.rs:325
11312024-11-19T02:09:01.626ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0 file = illumos-utils/src/zone.rs:363
11322024-11-19T02:09:01.643ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30 file = illumos-utils/src/zone.rs:363
11332024-11-19T02:09:01.653ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_f02be878-8b16-4056-a261-089d083d36be file = illumos-utils/src/zone.rs:363
11342024-11-19T02:09:04.862ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2354be7c-bc71-4b15-9f57-06b09b66253b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='941fb83d-977b-4ce0-9358-31a9195378e2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11352024-11-19T02:09:04.864ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
11362024-11-19T02:09:04.917ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11372024-11-19T02:09:04.919ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
11382024-11-19T02:09:04.984ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3b2bdbab-9b82-4f46-97d8-bbac1d154f58'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11392024-11-19T02:09:04.984ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
11402024-11-19T02:09:05.138ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_04239608-8df7-4953-8231-9f707a26673e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='45e5ea17-29a0-4e26-bb43-48f8b3257b7a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11412024-11-19T02:09:05.138ZINFOSledAgent (ServiceManager): Booting oxz_crucible_04239608-8df7-4953-8231-9f707a26673e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
11422024-11-19T02:09:08.474ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8d92ce26-c543-4771-ad32-a160a4f547aa/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ae77eb5a-f48e-4281-839b-d08bf69cca5e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11432024-11-19T02:09:08.475ZINFOSledAgent (ServiceManager): Booting oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
11442024-11-19T02:09:08.893ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d8152ecd-2ee6-4309-bada-a18bd5df1cc7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11452024-11-19T02:09:08.893ZINFOSledAgent (ServiceManager): Booting oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
11462024-11-19T02:09:08.937ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11472024-11-19T02:09:08.946ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
11482024-11-19T02:09:09.009ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0806dddd-1e86-4bd8-9015-afe82f0b9d18'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11492024-11-19T02:09:09.010ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
11502024-11-19T02:09:09.058ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='76b53bef-7c6f-428e-813b-c4a0a1cdd7d2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11512024-11-19T02:09:09.063ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
11522024-11-19T02:09:09.271ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='aa5321a0-a68f-462d-b5e0-670cbdedf684'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11532024-11-19T02:09:09.271ZINFOSledAgent (ServiceManager): Booting oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
11542024-11-19T02:09:10.017ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11552024-11-19T02:09:10.017ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
11562024-11-19T02:09:10.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 58.113899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
11572024-11-19T02:09:10.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 43.342362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
11582024-11-19T02:09:10.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 64.169724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
11592024-11-19T02:09:10.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 53.777153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
11602024-11-19T02:09:10.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 28.372512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
11612024-11-19T02:09:10.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 39.879175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
11622024-11-19T02:09:10.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 51.288576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
11632024-11-19T02:09:10.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 62.02807ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
11642024-11-19T02:09:10.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 62.868432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
11652024-11-19T02:09:10.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 61.41936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
11662024-11-19T02:09:10.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 145.688954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
11672024-11-19T02:09:10.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 74.216965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
11682024-11-19T02:09:10.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 89.429065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
11692024-11-19T02:09:10.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 285.761671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
11702024-11-19T02:09:10.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 45.041296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
11712024-11-19T02:09:10.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 104.679662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
11722024-11-19T02:09:10.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 85.971083ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
11732024-11-19T02:09:10.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 277.851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
11742024-11-19T02:09:10.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 128.027925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
11752024-11-19T02:09:10.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 227.110177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
11762024-11-19T02:09:10.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 37.979422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
11772024-11-19T02:09:10.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 278.384145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
11782024-11-19T02:09:10.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 228.066783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
11792024-11-19T02:09:10.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 147.364781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
11802024-11-19T02:09:10.740ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11812024-11-19T02:09:10.740ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
11822024-11-19T02:09:10.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 162.719965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
11832024-11-19T02:09:10.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 57.937169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
11842024-11-19T02:09:10.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 274.882476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
11852024-11-19T02:09:10.798ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_f02be878-8b16-4056-a261-089d083d36be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11862024-11-19T02:09:10.798ZINFOSledAgent (ServiceManager): Booting oxz_nexus_f02be878-8b16-4056-a261-089d083d36be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
11872024-11-19T02:09:10.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 150.686142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
11882024-11-19T02:09:10.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 145.566762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
11892024-11-19T02:09:10.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 241.225719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
11902024-11-19T02:09:10.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 550.369319ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
11912024-11-19T02:09:10.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 411.112232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
11922024-11-19T02:09:10.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 302.643902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
11932024-11-19T02:09:11.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 215.711968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
11942024-11-19T02:09:11.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 494.615214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
11952024-11-19T02:09:11.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 227.673331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
11962024-11-19T02:09:11.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 384.377043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
11972024-11-19T02:09:11.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 25.900114ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
11982024-11-19T02:09:11.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 592.381797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
11992024-11-19T02:09:11.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 568.432119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
12002024-11-19T02:09:11.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 228.693672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
12012024-11-19T02:09:11.378ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12022024-11-19T02:09:11.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 27.303623ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
12032024-11-19T02:09:11.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 732.634403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
12042024-11-19T02:09:11.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 491.353069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
12052024-11-19T02:09:11.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 611.24282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
12062024-11-19T02:09:11.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 145.108022ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
12072024-11-19T02:09:11.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 781.78636ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
12082024-11-19T02:09:11.443ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
12092024-11-19T02:09:11.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 89.554916ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
12102024-11-19T02:09:11.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 876.197731ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
12112024-11-19T02:09:11.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 847.411472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
12122024-11-19T02:09:11.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 273.327435ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
12132024-11-19T02:09:11.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 168.6226ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
12142024-11-19T02:09:11.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 630.721167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
12152024-11-19T02:09:11.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.108674219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
12162024-11-19T02:09:11.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 64.910572ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
12172024-11-19T02:09:11.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 1.02141746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
12182024-11-19T02:09:11.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 272.839034ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
12192024-11-19T02:09:11.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 92.109711ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
12202024-11-19T02:09:11.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 344.358258ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
12212024-11-19T02:09:11.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.118157707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
12222024-11-19T02:09:11.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 160.93947ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
12232024-11-19T02:09:11.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 946.818761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
12242024-11-19T02:09:12.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 687.693693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
12252024-11-19T02:09:12.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 940.89421ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
12262024-11-19T02:09:12.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 483.715353ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
12272024-11-19T02:09:12.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 507.134405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
12282024-11-19T02:09:12.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 802.804301ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
12292024-11-19T02:09:12.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 927.703861ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
12302024-11-19T02:09:12.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 717.843366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
12312024-11-19T02:09:12.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 966.467345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
12322024-11-19T02:09:12.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.235098536s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
12332024-11-19T02:09:12.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 652.360532ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
12342024-11-19T02:09:12.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.274677715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
12352024-11-19T02:09:12.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 521.026057ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
12362024-11-19T02:09:12.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.04721484s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
12372024-11-19T02:09:12.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 1.024171233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
12382024-11-19T02:09:12.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 1.499666468s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
12392024-11-19T02:09:12.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.45289351s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
12402024-11-19T02:09:13.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 506.120202ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
12412024-11-19T02:09:13.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 1.327085493s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
12422024-11-19T02:09:13.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 640.35538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
12432024-11-19T02:09:13.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 891.557266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
12442024-11-19T02:09:13.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 1.225988756s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
12452024-11-19T02:09:13.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 772.676854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
12462024-11-19T02:09:13.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 1.183608659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
12472024-11-19T02:09:13.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 872.981783ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
12482024-11-19T02:09:13.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.193543072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
12492024-11-19T02:09:13.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 734.622722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
12502024-11-19T02:09:13.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.337348979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
12512024-11-19T02:09:13.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 684.58183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
12522024-11-19T02:09:13.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.473983688s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
12532024-11-19T02:09:14.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.483156528s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
12542024-11-19T02:09:14.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 1.162440218s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
12552024-11-19T02:09:14.092ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f3062649-679a-4873-848a-e73bb370d040: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e7d17670-49d1-4296-b44f-e53bcd272b84/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0070a7bb-105b-40cc-975f-5892824253f5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12562024-11-19T02:09:14.093ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f3062649-679a-4873-848a-e73bb370d040 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
12572024-11-19T02:09:14.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 865.776244ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
12582024-11-19T02:09:14.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 1.359030259s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
12592024-11-19T02:09:14.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 555.487138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
12602024-11-19T02:09:14.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 937.305661ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
12612024-11-19T02:09:14.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.061064631s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
12622024-11-19T02:09:14.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 593.326244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
12632024-11-19T02:09:14.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 1.372027944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
12642024-11-19T02:09:14.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 748.005492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
12652024-11-19T02:09:14.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 46.950377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
12662024-11-19T02:09:14.730ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12672024-11-19T02:09:14.730ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
12682024-11-19T02:09:14.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 83.781385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
12692024-11-19T02:09:14.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.211178882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
12702024-11-19T02:09:14.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 115.981076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
12712024-11-19T02:09:14.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 70.431325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
12722024-11-19T02:09:15.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 485.343152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
12732024-11-19T02:09:15.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 77.238741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
12742024-11-19T02:09:15.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 1.375700858s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
12752024-11-19T02:09:15.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 150.878721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
12762024-11-19T02:09:15.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.133130413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
12772024-11-19T02:09:15.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.39085495s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
12782024-11-19T02:09:15.188ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='3980dd20-a3be-40d3-b9e5-094b8ed4b785'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12792024-11-19T02:09:15.189ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
12802024-11-19T02:09:15.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 958.87406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
12812024-11-19T02:09:15.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 495.372307ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
12822024-11-19T02:09:15.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 964.462464ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
12832024-11-19T02:09:15.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 815.704603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
12842024-11-19T02:09:15.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 72.971451ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
12852024-11-19T02:09:15.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.461288784s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
12862024-11-19T02:09:15.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 685.211098ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
12872024-11-19T02:09:15.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 512.085919ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
12882024-11-19T02:09:15.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 127.75129ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
12892024-11-19T02:09:15.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 514.738726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
12902024-11-19T02:09:15.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 572.74323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
12912024-11-19T02:09:15.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 245.448478ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
12922024-11-19T02:09:15.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 585.661264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
12932024-11-19T02:09:15.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 829.041754ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
12942024-11-19T02:09:15.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 396.502488ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
12952024-11-19T02:09:15.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 994.662201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
12962024-11-19T02:09:16.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 679.917055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
12972024-11-19T02:09:16.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 546.113103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
12982024-11-19T02:09:16.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.185224482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
12992024-11-19T02:09:16.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 629.271395ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
13002024-11-19T02:09:16.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 1.362448006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
13012024-11-19T02:09:16.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.398862103s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
13022024-11-19T02:09:16.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 1.288375354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
13032024-11-19T02:09:16.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.162531984s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
13042024-11-19T02:09:16.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 1.159351126s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
13052024-11-19T02:09:16.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 567.069683ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
13062024-11-19T02:09:16.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 1.307036707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
13072024-11-19T02:09:16.429ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.960474661s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
13082024-11-19T02:09:16.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 1.232474206s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
13092024-11-19T02:09:16.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.049374586s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
13102024-11-19T02:09:16.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.338436342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
13112024-11-19T02:09:16.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 591.664245ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
13122024-11-19T02:09:16.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 531.595358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
13132024-11-19T02:09:16.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 843.926019ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
13142024-11-19T02:09:16.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 1.38324306s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
13152024-11-19T02:09:16.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 631.203832ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
13162024-11-19T02:09:16.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 1.442696322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
13172024-11-19T02:09:17.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 676.55972ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
13182024-11-19T02:09:17.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 776.21289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
13192024-11-19T02:09:17.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 707.657168ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
13202024-11-19T02:09:17.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.346810486s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
13212024-11-19T02:09:17.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 765.600499ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
13222024-11-19T02:09:17.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 678.873391ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
13232024-11-19T02:09:17.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 961.162816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
13242024-11-19T02:09:17.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.264534736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
13252024-11-19T02:09:17.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.021473517s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
13262024-11-19T02:09:17.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.472955373s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
13272024-11-19T02:09:17.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 727.240848ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
13282024-11-19T02:09:17.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 753.784093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
13292024-11-19T02:09:17.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 881.462376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
13302024-11-19T02:09:17.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 1.20242899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
13312024-11-19T02:09:17.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.007650013s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
13322024-11-19T02:09:18.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 1.168204933s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
13332024-11-19T02:09:18.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.359626357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
13342024-11-19T02:09:18.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 743.347869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
13352024-11-19T02:09:18.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 1.389640835s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
13362024-11-19T02:09:18.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 1.297118815s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
13372024-11-19T02:09:18.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 914.051078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
13382024-11-19T02:09:18.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 785.139819ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
13392024-11-19T02:09:18.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 1.432416751s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
13402024-11-19T02:09:18.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 1.24845227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
13412024-11-19T02:09:18.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 1.455133611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
13422024-11-19T02:09:18.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.296183721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
13432024-11-19T02:09:18.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 56.712774ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
13442024-11-19T02:09:18.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 74.640352ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
13452024-11-19T02:09:18.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 151.612114ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
13462024-11-19T02:09:18.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 850.306968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
13472024-11-19T02:09:18.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.186208923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
13482024-11-19T02:09:18.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 507.682885ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
13492024-11-19T02:09:18.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 1.262562802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
13502024-11-19T02:09:19.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.323433507s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
13512024-11-19T02:09:19.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.406194241s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
13522024-11-19T02:09:19.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 990.732771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
13532024-11-19T02:09:19.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 1.09241134s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
13542024-11-19T02:09:19.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 726.027422ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
13552024-11-19T02:09:19.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 1.284975925s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
13562024-11-19T02:09:19.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.4013261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
13572024-11-19T02:09:19.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 601.523921ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
13582024-11-19T02:09:19.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 1.285919989s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
13592024-11-19T02:09:19.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 975.268168ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
13602024-11-19T02:09:19.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.415008768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
13612024-11-19T02:09:19.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 889.218737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
13622024-11-19T02:09:19.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 781.895234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
13632024-11-19T02:09:19.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.042338339s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
13642024-11-19T02:09:20.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 1.228797395s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
13652024-11-19T02:09:20.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.211636363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
13662024-11-19T02:09:20.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 670.10976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
13672024-11-19T02:09:20.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 918.733248ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
13682024-11-19T02:09:20.128ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13692024-11-19T02:09:20.128ZINFOSledAgent (ServiceManager): Booting oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
13702024-11-19T02:09:20.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 1.166962203s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
13712024-11-19T02:09:20.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 517.572718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
13722024-11-19T02:09:20.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 1.145536541s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
13732024-11-19T02:09:20.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 68.899883ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
13742024-11-19T02:09:20.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.1859475s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
13752024-11-19T02:09:20.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 114.894785ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
13762024-11-19T02:09:20.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 208.426028ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
13772024-11-19T02:09:20.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 661.148723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
13782024-11-19T02:09:20.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 708.964596ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
13792024-11-19T02:09:20.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 857.588608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
13802024-11-19T02:09:20.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 624.450782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
13812024-11-19T02:09:20.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 881.492411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
13822024-11-19T02:09:20.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 403.28001ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
13832024-11-19T02:09:20.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 1.014228787s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
13842024-11-19T02:09:20.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 931.716366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
13852024-11-19T02:09:20.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.321352268s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
13862024-11-19T02:09:20.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 1.011129167s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
13872024-11-19T02:09:21.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.237931639s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
13882024-11-19T02:09:21.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 574.112281ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
13892024-11-19T02:09:21.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.195519303s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
13902024-11-19T02:09:21.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 493.386282ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
13912024-11-19T02:09:21.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.096814595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
13922024-11-19T02:09:21.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 1.152330951s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
13932024-11-19T02:09:21.254ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13942024-11-19T02:09:21.255ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
13952024-11-19T02:09:21.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.238052762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
13962024-11-19T02:09:21.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 642.273203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
13972024-11-19T02:09:21.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 867.147857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
13982024-11-19T02:09:21.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 742.409286ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
13992024-11-19T02:09:21.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 770.67478ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
14002024-11-19T02:09:21.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 43.185621ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
14012024-11-19T02:09:21.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.054377916s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
14022024-11-19T02:09:21.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 847.35917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
14032024-11-19T02:09:21.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 124.218671ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
14042024-11-19T02:09:21.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 1.09887556s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
14052024-11-19T02:09:21.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 1.005719599s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
14062024-11-19T02:09:21.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 668.307223ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
14072024-11-19T02:09:21.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 219.993228ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
14082024-11-19T02:09:21.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 1.34999407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
14092024-11-19T02:09:21.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 959.865735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
14102024-11-19T02:09:21.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 1.303331612s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
14112024-11-19T02:09:21.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 449.33063ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
14122024-11-19T02:09:21.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 1.39310257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
14132024-11-19T02:09:22.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 1.21274076s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
14142024-11-19T02:09:22.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.167431025s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
14152024-11-19T02:09:22.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 1.015140352s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
14162024-11-19T02:09:22.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 658.210841ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
14172024-11-19T02:09:22.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.149286661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
14182024-11-19T02:09:22.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.060225176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
14192024-11-19T02:09:22.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 1.370188396s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
14202024-11-19T02:09:22.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 542.210318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
14212024-11-19T02:09:22.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 1.140370891s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
14222024-11-19T02:09:22.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 525.043235ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
14232024-11-19T02:09:22.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 1.230323328s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
14242024-11-19T02:09:22.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 546.681277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
14252024-11-19T02:09:22.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.207691521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
14262024-11-19T02:09:22.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 1.398317857s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
14272024-11-19T02:09:22.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 1.292353375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
14282024-11-19T02:09:22.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 619.359071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
14292024-11-19T02:09:22.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 984.677768ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
14302024-11-19T02:09:22.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.114997304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
14312024-11-19T02:09:22.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 728.228488ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
14322024-11-19T02:09:23.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.359546757s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
14332024-11-19T02:09:23.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 528.02894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
14342024-11-19T02:09:23.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 917.966693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
14352024-11-19T02:09:23.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 883.314552ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
14362024-11-19T02:09:23.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 514.922977ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
14372024-11-19T02:09:23.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 801.12323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
14382024-11-19T02:09:23.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 1.398992593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
14392024-11-19T02:09:23.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 856.963366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
14402024-11-19T02:09:23.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.157160737s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
14412024-11-19T02:09:23.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 857.214216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
14422024-11-19T02:09:23.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 1.254036629s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
14432024-11-19T02:09:23.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 637.306341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
14442024-11-19T02:09:23.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 1.022641255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
14452024-11-19T02:09:23.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 779.414854ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
14462024-11-19T02:09:23.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 501.941861ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
14472024-11-19T02:09:23.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.144594732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
14482024-11-19T02:09:23.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 1.022831863s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
14492024-11-19T02:09:23.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 1.099963761s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
14502024-11-19T02:09:24.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 824.195473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
14512024-11-19T02:09:24.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 1.341170089s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
14522024-11-19T02:09:24.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.094714148s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
14532024-11-19T02:09:24.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 583.113192ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
14542024-11-19T02:09:24.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 503.057623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
14552024-11-19T02:09:24.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.444836512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
14562024-11-19T02:09:24.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 944.621729ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
14572024-11-19T02:09:24.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 746.810797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
14582024-11-19T02:09:24.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 526.814133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
14592024-11-19T02:09:24.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 1.199778796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
14602024-11-19T02:09:24.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 773.231899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
14612024-11-19T02:09:24.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 1.434636317s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
14622024-11-19T02:09:24.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 848.00561ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
14632024-11-19T02:09:24.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 1.26949841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
14642024-11-19T02:09:24.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 576.46372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
14652024-11-19T02:09:24.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 576.857738ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
14662024-11-19T02:09:24.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 1.267664844s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
14672024-11-19T02:09:24.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 901.97048ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
14682024-11-19T02:09:24.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 584.333062ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
14692024-11-19T02:09:24.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 753.005587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
14702024-11-19T02:09:24.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 961.000553ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
14712024-11-19T02:09:24.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 887.285684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
14722024-11-19T02:09:25.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 1.244973998s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
14732024-11-19T02:09:25.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.256585813s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
14742024-11-19T02:09:25.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 932.455436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
14752024-11-19T02:09:25.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 1.073580804s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
14762024-11-19T02:09:25.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.260577591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
14772024-11-19T02:09:25.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 966.363194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
14782024-11-19T02:09:25.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 741.891252ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
14792024-11-19T02:09:25.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 1.47586618s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
14802024-11-19T02:09:25.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 779.092012ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
14812024-11-19T02:09:25.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.307819598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
14822024-11-19T02:09:25.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 1.117463963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
14832024-11-19T02:09:25.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 1.072974219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
14842024-11-19T02:09:25.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 794.920405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
14852024-11-19T02:09:25.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 845.646701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
14862024-11-19T02:09:25.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 525.665048ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
14872024-11-19T02:09:25.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 554.409897ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
14882024-11-19T02:09:25.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 924.524522ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
14892024-11-19T02:09:25.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 1.203366391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
14902024-11-19T02:09:26.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 956.679335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
14912024-11-19T02:09:26.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 1.271733291s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
14922024-11-19T02:09:26.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.465095795s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
14932024-11-19T02:09:26.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 908.369116ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
14942024-11-19T02:09:26.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 925.489971ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
14952024-11-19T02:09:26.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 966.931512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
14962024-11-19T02:09:26.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 830.813065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
14972024-11-19T02:09:26.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 943.128912ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
14982024-11-19T02:09:26.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.409329702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
14992024-11-19T02:09:26.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.352939261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
15002024-11-19T02:09:26.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 1.498436735s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
15012024-11-19T02:09:26.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.354834805s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
15022024-11-19T02:09:26.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 1.438929289s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
15032024-11-19T02:09:26.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 963.251758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
15042024-11-19T02:09:26.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 600.513521ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
15052024-11-19T02:09:26.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.302324172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
15062024-11-19T02:09:26.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 503.022792ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
15072024-11-19T02:09:26.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 1.236390822s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
15082024-11-19T02:09:27.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 800.316795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
15092024-11-19T02:09:27.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 1.297384419s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
15102024-11-19T02:09:27.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.027627896s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
15112024-11-19T02:09:27.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 962.13866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
15122024-11-19T02:09:27.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 793.522748ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
15132024-11-19T02:09:27.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 509.094969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
15142024-11-19T02:09:27.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 1.187145114s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
15152024-11-19T02:09:27.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 698.605438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
15162024-11-19T02:09:27.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 909.157456ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
15172024-11-19T02:09:27.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 1.192351389s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
15182024-11-19T02:09:27.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.449321232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
15192024-11-19T02:09:27.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 1.456300436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
15202024-11-19T02:09:27.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 1.059623086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
15212024-11-19T02:09:27.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.446736265s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
15222024-11-19T02:09:27.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.38606043s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
15232024-11-19T02:09:27.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 589.646569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
15242024-11-19T02:09:27.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 959.361578ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
15252024-11-19T02:09:28.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 593.474967ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
15262024-11-19T02:09:28.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 1.094423793s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
15272024-11-19T02:09:28.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 1.193686364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
15282024-11-19T02:09:28.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 972.24512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
15292024-11-19T02:09:28.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 661.302295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
15302024-11-19T02:09:28.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 1.005990187s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
15312024-11-19T02:09:28.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 1.387526961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
15322024-11-19T02:09:28.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.26877707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
15332024-11-19T02:09:28.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 920.153607ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
15342024-11-19T02:09:28.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 705.708079ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
15352024-11-19T02:09:28.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 1.157207381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
15362024-11-19T02:09:28.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 1.225301839s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
15372024-11-19T02:09:28.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 598.681637ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
15382024-11-19T02:09:28.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 757.630976ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
15392024-11-19T02:09:28.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 770.467732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
15402024-11-19T02:09:28.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 542.331728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
15412024-11-19T02:09:28.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 1.403079143s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
15422024-11-19T02:09:29.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 1.243752626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
15432024-11-19T02:09:29.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 893.715545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
15442024-11-19T02:09:29.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 1.21461234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
15452024-11-19T02:09:29.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 877.713355ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
15462024-11-19T02:09:29.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 671.92095ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
15472024-11-19T02:09:29.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 1.438754128s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
15482024-11-19T02:09:29.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 1.053112092s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
15492024-11-19T02:09:29.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 1.396831305s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
15502024-11-19T02:09:29.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 897.261015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
15512024-11-19T02:09:29.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 934.93977ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
15522024-11-19T02:09:29.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.002627949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
15532024-11-19T02:09:29.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 934.502083ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
15542024-11-19T02:09:29.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 1.34167638s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
15552024-11-19T02:09:29.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 759.779862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
15562024-11-19T02:09:29.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 760.230171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
15572024-11-19T02:09:29.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 1.096771329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
15582024-11-19T02:09:29.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 891.423917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
15592024-11-19T02:09:29.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 676.803213ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
15602024-11-19T02:09:29.812ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51959
15612024-11-19T02:09:29.815ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51959 req_id = 879df92e-a7fb-4e6a-a642-db1aee01afd4 response_code = 200 uri = /baseboard
15622024-11-19T02:09:29.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 1.347371883s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
15632024-11-19T02:09:29.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 1.011048667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
15642024-11-19T02:09:30.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 1.192242828s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
15652024-11-19T02:09:30.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 927.876221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
15662024-11-19T02:09:30.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 889.982313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
15672024-11-19T02:09:30.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.428700147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
15682024-11-19T02:09:30.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 804.651999ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
15692024-11-19T02:09:30.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 687.620309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
15702024-11-19T02:09:30.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 664.125402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
15712024-11-19T02:09:30.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c") failed: Property not found. retry in 1.474255906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
15722024-11-19T02:09:30.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 845.33579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
15732024-11-19T02:09:30.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 690.727ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
15742024-11-19T02:09:30.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a") failed: Property not found. retry in 1.457346028s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
15752024-11-19T02:09:30.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30") failed: Property not found. retry in 1.16633377s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
15762024-11-19T02:09:30.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04239608-8df7-4953-8231-9f707a26673e") failed: Property not found. retry in 951.363774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
15772024-11-19T02:09:30.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b") failed: Property not found. retry in 1.356621677s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
15782024-11-19T02:09:30.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785") failed: Property not found. retry in 900.329387ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
15792024-11-19T02:09:30.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 815.674926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
15802024-11-19T02:09:30.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1") failed: Property not found. retry in 945.248176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
15812024-11-19T02:09:30.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732") failed: Property not found. retry in 578.476332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
15822024-11-19T02:09:30.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688") failed: Property not found. retry in 1.08064867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
15832024-11-19T02:09:30.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f") failed: Property not found. retry in 659.724238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
15842024-11-19T02:09:31.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 1.176596592s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
15852024-11-19T02:09:31.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f02be878-8b16-4056-a261-089d083d36be") failed: Property not found. retry in 1.330997791s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
15862024-11-19T02:09:31.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c") failed: Property not found. retry in 1.235324612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
15872024-11-19T02:09:31.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed") failed: Property not found. retry in 700.383577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
15882024-11-19T02:09:31.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154") failed: Property not found. retry in 1.023525123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
15892024-11-19T02:09:31.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0") failed: Property not found. retry in 1.033271789s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
15902024-11-19T02:09:31.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6") failed: Property not found. retry in 1.113755636s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
15912024-11-19T02:09:31.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f3062649-679a-4873-848a-e73bb370d040") failed: Property not found. retry in 1.409373714s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
15922024-11-19T02:09:31.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401") failed: Property not found. retry in 1.464042968s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
15932024-11-19T02:09:32.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 517.865239ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
15942024-11-19T02:09:32.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 895.046033ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
15952024-11-19T02:09:33.454ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.085497533s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
15962024-11-19T02:09:33.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b") failed: Property not found. retry in 1.112570994s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
15972024-11-19T02:09:34.828ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_f3062649-679a-4873-848a-e73bb370d040
15982024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_clickhouse_8fa8c0c2-7c5e-4542-9a5d-f8367dc2c69b
15992024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_f5cf8587-6819-4369-b97f-184f0d6af06c
16002024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_eaaa04df-c2c4-4fc9-883b-6a4897932688
16012024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_nexus_d90c9eb7-7c7e-4675-94ca-7779e9afc6c6
16022024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_04239608-8df7-4953-8231-9f707a26673e
16032024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_9386ef68-a6d3-49fe-b610-70909ac5e732
16042024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_bfcdd2e0-969b-457f-977b-af1fe74cc9ed
16052024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_pantry_6fec4bd4-abae-46b2-a507-115c698e8d5c
16062024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_external_dns_91bdcbd0-987b-49c4-8200-fc3e8f332b6b
16072024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_nexus_f02be878-8b16-4056-a261-089d083d36be
16082024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_pantry_a4ddddbe-ea8a-409e-8d9a-b8f9f873132a
16092024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_external_dns_27d1a6ca-1b76-4956-aefa-e234c7d60cd0
16102024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_pantry_6a02500f-82bd-4c6c-99d2-7bb9d3b0d401
16112024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_nexus_9f0b435f-0000-451e-9dbc-dcec71543c30
16122024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_oximeter_3980dd20-a3be-40d3-b9e5-094b8ed4b785
16132024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_084a25f6-4801-4b44-b631-2f827073d154
16142024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_0632e7ec-4407-414f-9b23-4e6a0dcc5a9f
16152024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3317 zone = oxz_crucible_92019d54-3d1f-4ee6-b1f9-ef0abd144fc1
16162024-11-19T02:09:34.829ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
16172024-11-19T02:09:34.831ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json"
16182024-11-19T02:09:34.831ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
16192024-11-19T02:09:34.832ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json"
16202024-11-19T02:09:34.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35028837 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48818 req_id = 095b4285-3594-4254-b3b8-59b21fd2b960 response_code = 204 uri = /omicron-zones
16212024-11-19T02:09:34.845ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
16222024-11-19T02:09:34.845ZINFOSledAgent (RSS): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
16232024-11-19T02:09:34.845ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/rss-plan-completed.marker"
16242024-11-19T02:09:34.845ZINFOSledAgent (RSS): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
16252024-11-19T02:09:34.845ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/rss-plan-completed.marker"
16262024-11-19T02:09:35.028ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
16272024-11-19T02:09:35.029ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:799
16282024-11-19T02:09:35.079ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
16292024-11-19T02:09:37.565ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.342662294s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
16302024-11-19T02:09:38.470ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16312024-11-19T02:09:38.548ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16322024-11-19T02:09:38.636ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16332024-11-19T02:09:38.746ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16342024-11-19T02:09:38.971ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16352024-11-19T02:09:39.244ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16362024-11-19T02:09:39.606ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16372024-11-19T02:09:39.884ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16382024-11-19T02:09:40.214ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16392024-11-19T02:09:40.839ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16402024-11-19T02:09:41.529ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/a894e92e-d765-4f15-b6b7-cb9ca46d1860/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16412024-11-19T02:09:42.616ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "44aba9f8-40b1-4fa6-93d2-ec277d2b54f4", "content-length": "173", "date": "Tue, 19 Nov 2024 02:09:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"a894e92e-d765-4f15-b6b7-cb9ca46d1860\"", request_id: "44aba9f8-40b1-4fa6-93d2-ec277d2b54f4" } file = sled-agent/src/rack_setup/service.rs:1075
16422024-11-19T02:09:43.464ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "146335b7-5870-4104-8905-0449d73a08e1", "content-length": "173", "date": "Tue, 19 Nov 2024 02:09:43 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"a894e92e-d765-4f15-b6b7-cb9ca46d1860\"", request_id: "146335b7-5870-4104-8905-0449d73a08e1" } file = sled-agent/src/rack_setup/service.rs:1075
16432024-11-19T02:09:44.480ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4e2f4a83-8cc9-4ce3-846b-513df934c652", "content-length": "173", "date": "Tue, 19 Nov 2024 02:09:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"a894e92e-d765-4f15-b6b7-cb9ca46d1860\"", request_id: "4e2f4a83-8cc9-4ce3-846b-513df934c652" } file = sled-agent/src/rack_setup/service.rs:1075
16442024-11-19T02:09:46.970ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "86f9d0b0-0162-4e01-b328-08b02cd209d1", "content-length": "173", "date": "Tue, 19 Nov 2024 02:09:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ffe74824-0c08-48e1-a755-fb123e8dc181\"", request_id: "86f9d0b0-0162-4e01-b328-08b02cd209d1" } file = sled-agent/src/rack_setup/service.rs:1075
16452024-11-19T02:09:48.773ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cb09f87b-451f-44fc-97f8-6f22c564635b", "content-length": "173", "date": "Tue, 19 Nov 2024 02:09:47 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ffe74824-0c08-48e1-a755-fb123e8dc181\"", request_id: "cb09f87b-451f-44fc-97f8-6f22c564635b" } file = sled-agent/src/rack_setup/service.rs:1075
16462024-11-19T02:09:51.447ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3889ac4e-0b7a-471b-ba08-d087c9e6b344", "content-length": "173", "date": "Tue, 19 Nov 2024 02:09:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ffe74824-0c08-48e1-a755-fb123e8dc181\"", request_id: "3889ac4e-0b7a-471b-ba08-d087c9e6b344" } file = sled-agent/src/rack_setup/service.rs:1075
16472024-11-19T02:09:54.252ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "835d98c7-cff5-41a3-9dc1-fe3884937802", "content-length": "173", "date": "Tue, 19 Nov 2024 02:09:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ffe74824-0c08-48e1-a755-fb123e8dc181\"", request_id: "835d98c7-cff5-41a3-9dc1-fe3884937802" } file = sled-agent/src/rack_setup/service.rs:1075
16482024-11-19T02:09:55.894ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9eb11cf3-d6a8-418c-b821-916e9c29e9d0", "content-length": "173", "date": "Tue, 19 Nov 2024 02:09:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ffe74824-0c08-48e1-a755-fb123e8dc181\"", request_id: "9eb11cf3-d6a8-418c-b821-916e9c29e9d0" } file = sled-agent/src/rack_setup/service.rs:1075
16492024-11-19T02:09:57.309ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:43120 remote_addr = [fd00:1122:3344:101::d]:41610 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
16502024-11-19T02:09:57.323ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13769 local_addr = [fd00:1122:3344:101::1]:43120 method = GET remote_addr = [fd00:1122:3344:101::d]:41610 req_id = d884f652-550c-4fe1-8ecb-d6726cd62ee4 response_code = 200 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 uri = /ffe74824-0c08-48e1-a755-fb123e8dc181
16512024-11-19T02:09:59.316ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4b7bc1cf-581a-49f6-bf50-b8aa534a7f06", "content-length": "173", "date": "Tue, 19 Nov 2024 02:09:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ffe74824-0c08-48e1-a755-fb123e8dc181\"", request_id: "4b7bc1cf-581a-49f6-bf50-b8aa534a7f06" } file = sled-agent/src/rack_setup/service.rs:1075
16522024-11-19T02:09:59.841ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35088
16532024-11-19T02:09:59.841ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35088 req_id = 32b6949a-fdfe-401b-bad5-380ead2269fd response_code = 200 uri = /baseboard
16542024-11-19T02:10:02.316ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "aabe0bdf-f2b5-4251-89fd-1510692eed50", "content-length": "173", "date": "Tue, 19 Nov 2024 02:10:01 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ffe74824-0c08-48e1-a755-fb123e8dc181\"", request_id: "aabe0bdf-f2b5-4251-89fd-1510692eed50" } file = sled-agent/src/rack_setup/service.rs:1075
16552024-11-19T02:10:06.269ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "877a868c-e91e-471a-b364-0e2f8fd1c5cf", "content-length": "173", "date": "Tue, 19 Nov 2024 02:10:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ffe74824-0c08-48e1-a755-fb123e8dc181\"", request_id: "877a868c-e91e-471a-b364-0e2f8fd1c5cf" } file = sled-agent/src/rack_setup/service.rs:1075
16562024-11-19T02:10:11.427ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5d41b124-284e-494f-b87e-eb88871ec18d", "content-length": "173", "date": "Tue, 19 Nov 2024 02:10:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ffe74824-0c08-48e1-a755-fb123e8dc181\"", request_id: "5d41b124-284e-494f-b87e-eb88871ec18d" } file = sled-agent/src/rack_setup/service.rs:1075
16572024-11-19T02:10:19.916ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7159967c-bed4-4c81-b3a6-c13e1bc66684", "content-length": "173", "date": "Tue, 19 Nov 2024 02:10:19 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ffe74824-0c08-48e1-a755-fb123e8dc181\"", request_id: "7159967c-bed4-4c81-b3a6-c13e1bc66684" } file = sled-agent/src/rack_setup/service.rs:1075
16582024-11-19T02:10:26.121ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
16592024-11-19T02:10:26.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33753
16602024-11-19T02:10:26.214ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16612024-11-19T02:10:26.214ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16622024-11-19T02:10:26.214ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json file = common/src/ledger.rs:178
16632024-11-19T02:10:26.215ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json file = common/src/ledger.rs:178
16642024-11-19T02:10:26.228ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16652024-11-19T02:10:26.228ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a
16662024-11-19T02:10:26.252ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16672024-11-19T02:10:26.252ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730
16682024-11-19T02:10:26.274ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16692024-11-19T02:10:26.274ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f
16702024-11-19T02:10:26.294ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16712024-11-19T02:10:26.294ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2354be7c-bc71-4b15-9f57-06b09b66253b
16722024-11-19T02:10:26.313ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16732024-11-19T02:10:26.313ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882
16742024-11-19T02:10:26.333ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16752024-11-19T02:10:26.333ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56
16762024-11-19T02:10:26.354ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16772024-11-19T02:10:26.354ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e7d17670-49d1-4296-b44f-e53bcd272b84
16782024-11-19T02:10:26.373ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16792024-11-19T02:10:26.374ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490
16802024-11-19T02:10:26.392ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16812024-11-19T02:10:26.392ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8d92ce26-c543-4771-ad32-a160a4f547aa
16822024-11-19T02:10:26.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33753 req_id = 9c69ee50-e8a5-494c-ac4d-0db1b374df9c response_code = 200 uri = /inventory
16832024-11-19T02:10:29.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33768
16842024-11-19T02:10:29.386ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16852024-11-19T02:10:29.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16862024-11-19T02:10:29.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16872024-11-19T02:10:29.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16882024-11-19T02:10:29.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16892024-11-19T02:10:29.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16902024-11-19T02:10:29.387ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16912024-11-19T02:10:29.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1537 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33768 req_id = 30a84766-dfd5-47ce-90cb-6094d96986e2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16922024-11-19T02:10:29.387ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
16932024-11-19T02:10:29.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34838
16942024-11-19T02:10:29.668ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16952024-11-19T02:10:29.668ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16962024-11-19T02:10:29.668ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json file = common/src/ledger.rs:178
16972024-11-19T02:10:29.668ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json file = common/src/ledger.rs:178
16982024-11-19T02:10:29.681ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16992024-11-19T02:10:29.681ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a
17002024-11-19T02:10:29.707ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17012024-11-19T02:10:29.707ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730
17022024-11-19T02:10:29.733ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17032024-11-19T02:10:29.733ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f
17042024-11-19T02:10:29.756ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17052024-11-19T02:10:29.756ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2354be7c-bc71-4b15-9f57-06b09b66253b
17062024-11-19T02:10:29.776ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17072024-11-19T02:10:29.776ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882
17082024-11-19T02:10:29.798ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17092024-11-19T02:10:29.798ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56
17102024-11-19T02:10:29.821ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17112024-11-19T02:10:29.821ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e7d17670-49d1-4296-b44f-e53bcd272b84
17122024-11-19T02:10:29.846ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17132024-11-19T02:10:29.846ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490
17142024-11-19T02:10:29.867ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17152024-11-19T02:10:29.868ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8d92ce26-c543-4771-ad32-a160a4f547aa
17162024-11-19T02:10:29.875ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62271
17172024-11-19T02:10:29.875ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62271 req_id = 4ee3b2db-5cfd-47de-a65a-a5975d8e6efd response_code = 200 uri = /baseboard
17182024-11-19T02:10:29.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34838 req_id = 2e29363f-19b8-4f31-adc9-09ef5200ca07 response_code = 200 uri = /inventory
17192024-11-19T02:10:30.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37087
17202024-11-19T02:10:30.034ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17212024-11-19T02:10:30.034ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17222024-11-19T02:10:30.034ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17232024-11-19T02:10:30.034ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17242024-11-19T02:10:30.034ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17252024-11-19T02:10:30.034ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17262024-11-19T02:10:30.034ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17272024-11-19T02:10:30.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37087 req_id = 31403769-9501-4126-8a8d-4161212d7ac8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17282024-11-19T02:10:30.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62722
17292024-11-19T02:10:30.104ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17302024-11-19T02:10:30.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17312024-11-19T02:10:30.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17322024-11-19T02:10:30.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17332024-11-19T02:10:30.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17342024-11-19T02:10:30.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17352024-11-19T02:10:30.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17362024-11-19T02:10:30.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62722 req_id = bdd43616-4cb1-4421-9a80-80624f65ef96 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17372024-11-19T02:10:30.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50776
17382024-11-19T02:10:30.207ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17392024-11-19T02:10:30.207ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17402024-11-19T02:10:30.207ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17412024-11-19T02:10:30.207ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17422024-11-19T02:10:30.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17432024-11-19T02:10:30.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17442024-11-19T02:10:30.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17452024-11-19T02:10:30.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50776 req_id = 24bab254-3d27-4d37-8dc3-cb5d2bb5d405 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17462024-11-19T02:10:37.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32867
17472024-11-19T02:10:37.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32867 req_id = c1133bc8-8956-49c4-8ca4-623669ed361d response_code = 200 uri = /vpc-routes
17482024-11-19T02:10:37.809ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
17492024-11-19T02:10:37.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32867 req_id = 33ea2f81-1a6b-4868-b781-4b3511c6986a response_code = 204 uri = /eip-gateways
17502024-11-19T02:10:37.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32867 req_id = 89e20783-df30-41bc-b469-457f9256801b response_code = 204 uri = /vpc-routes
17512024-11-19T02:10:46.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50773
17522024-11-19T02:10:46.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50773 req_id = f05146ad-a1b8-462d-b263-97e6c610591e response_code = 200 uri = /v2p
17532024-11-19T02:10:46.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47081
17542024-11-19T02:10:46.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47081 req_id = 4610531f-851b-4ca5-9a75-d6709ab74ac4 response_code = 200 uri = /vpc-routes
17552024-11-19T02:10:46.124ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
17562024-11-19T02:10:46.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47081 req_id = 33273b9d-f385-4468-958b-147e3c13372b response_code = 204 uri = /eip-gateways
17572024-11-19T02:10:46.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47081 req_id = 8c8d9c64-2fa3-41ea-8748-4a9ba797bd49 response_code = 204 uri = /vpc-routes
17582024-11-19T02:10:46.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40552
17592024-11-19T02:10:46.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40552 req_id = 81c06e60-1e0e-4e58-9a1f-b70e80f9ecea response_code = 200 uri = /vpc-routes
17602024-11-19T02:10:46.305ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
17612024-11-19T02:10:46.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40552 req_id = d989a8bf-dd42-41f0-909b-d2cc309e03ab response_code = 204 uri = /eip-gateways
17622024-11-19T02:10:46.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40552 req_id = 655e142b-9fff-465b-9c68-29c8a6a5ab28 response_code = 204 uri = /vpc-routes
17632024-11-19T02:10:46.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42190
17642024-11-19T02:10:46.336ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
17652024-11-19T02:10:46.406ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
17662024-11-19T02:10:46.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42190 req_id = e1efe635-27dc-43ec-8d37-3db4865c6987 response_code = 204 uri = /switch-ports
17672024-11-19T02:10:46.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58170
17682024-11-19T02:10:46.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64894
17692024-11-19T02:10:46.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45629
17702024-11-19T02:10:46.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53816
17712024-11-19T02:10:46.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64894 req_id = d02ce492-85c9-486f-8764-13868f845c44 response_code = 200 uri = /vpc-routes
17722024-11-19T02:10:46.473ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
17732024-11-19T02:10:46.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45629 req_id = 2509903f-5354-492a-9cce-976138f758eb response_code = 200 uri = /v2p
17742024-11-19T02:10:46.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53816 req_id = fbb8209e-9ea1-453c-82e5-c50494ad116d response_code = 200 uri = /v2p
17752024-11-19T02:10:46.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5358 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42190 req_id = 82ddb09a-ea3c-4296-ba29-47c8f5387583 response_code = 200 uri = /network-bootstore-config
17762024-11-19T02:10:46.508ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17772024-11-19T02:10:46.508ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6761462c-c735-467b-a33c-59444a1ef020/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
17782024-11-19T02:10:46.510ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/6761462c-c735-467b-a33c-59444a1ef020/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
17792024-11-19T02:10:46.510ZINFOSledAgent (bootstore): Writing ledger to /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
17802024-11-19T02:10:46.511ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
17812024-11-19T02:10:46.511ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17822024-11-19T02:10:46.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3704 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42190 req_id = 17f91771-35a3-48d8-809c-e82bf434aca4 response_code = 204 uri = /network-bootstore-config
17832024-11-19T02:10:46.517ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
17842024-11-19T02:10:46.523ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
17852024-11-19T02:10:46.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64894 req_id = 4376ff6f-d179-4b19-b540-dc3603f39549 response_code = 204 uri = /eip-gateways
17862024-11-19T02:10:46.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64894 req_id = 1d872def-4c52-41bb-9b28-efa882bdb9e7 response_code = 204 uri = /vpc-routes
17872024-11-19T02:10:46.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102166 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58170 req_id = 29642b71-4cfd-4fc7-9d97-e9413783377e response_code = 204 uri = /switch-ports
17882024-11-19T02:10:46.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58170 req_id = b1c76f6c-0c53-4428-a560-ff676dbb94cb response_code = 200 uri = /network-bootstore-config
17892024-11-19T02:10:46.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43493
17902024-11-19T02:10:46.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
17912024-11-19T02:10:46.635ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
17922024-11-19T02:10:46.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88580 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43493 req_id = cec89a5e-6ae5-49ac-8a1f-111fbefab2da response_code = 204 uri = /switch-ports
17932024-11-19T02:10:46.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43493 req_id = 082c70d8-cf42-4d9c-a04a-b8cbbb80f6b4 response_code = 200 uri = /network-bootstore-config
17942024-11-19T02:10:59.907ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48357
17952024-11-19T02:10:59.907ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48357 req_id = b6a51c0a-ca47-4c5a-a1ae-87414e25bd5c response_code = 200 uri = /baseboard
17962024-11-19T02:11:15.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52762
17972024-11-19T02:11:15.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52762 req_id = ac0bbf8e-c979-4cb2-99ba-1c2c94cb35e1 response_code = 200 uri = /vpc-routes
17982024-11-19T02:11:16.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53638
17992024-11-19T02:11:16.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53638 req_id = 37a4fc27-9351-49b9-9018-e9a02b9b21ea response_code = 200 uri = /vpc-routes
18002024-11-19T02:11:16.044ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
18012024-11-19T02:11:16.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52762 req_id = d5124089-45ec-46d2-a852-0753360aad19 response_code = 204 uri = /eip-gateways
18022024-11-19T02:11:16.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52762 req_id = e34895b6-bd99-4073-8f84-0e3d2dc28381 response_code = 204 uri = /vpc-routes
18032024-11-19T02:11:16.089ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
18042024-11-19T02:11:16.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53638 req_id = b3b342a0-5209-4914-b65b-c6fb74aeba63 response_code = 204 uri = /eip-gateways
18052024-11-19T02:11:16.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53638 req_id = 65954b37-1c01-4c06-8666-7c9a3e7a6d25 response_code = 204 uri = /vpc-routes
18062024-11-19T02:11:16.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49472
18072024-11-19T02:11:16.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
18082024-11-19T02:11:16.193ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
18092024-11-19T02:11:16.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100293 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49472 req_id = 19a00c19-ba99-4d8b-9fc9-db0cb3623fd8 response_code = 204 uri = /switch-ports
18102024-11-19T02:11:16.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43965
18112024-11-19T02:11:16.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40319
18122024-11-19T02:11:16.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49472 req_id = a40487b3-f79a-48fe-9b0b-2989e3b1bc93 response_code = 200 uri = /network-bootstore-config
18132024-11-19T02:11:16.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43965 req_id = 2fcf25d7-044b-4b20-a18b-4909c726533e response_code = 200 uri = /v2p
18142024-11-19T02:11:16.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40319 req_id = 783cc5f1-a24b-46f1-8a48-c73020e5840b response_code = 200 uri = /v2p
18152024-11-19T02:11:16.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59956
18162024-11-19T02:11:16.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59956 req_id = 36968615-a41b-4bfc-8db7-363f27d080d1 response_code = 200 uri = /vpc-routes
18172024-11-19T02:11:16.277ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
18182024-11-19T02:11:16.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59956 req_id = 238685f1-2654-4236-b6e2-825386c0ab3d response_code = 204 uri = /eip-gateways
18192024-11-19T02:11:16.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38928
18202024-11-19T02:11:16.281ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
18212024-11-19T02:11:16.319ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
18222024-11-19T02:11:16.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93151 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38928 req_id = 3e10686b-64c5-4bae-a818-bbc72583673c response_code = 204 uri = /switch-ports
18232024-11-19T02:11:16.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57313
18242024-11-19T02:11:16.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62852
18252024-11-19T02:11:16.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 380 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59956 req_id = 3934fc34-63fb-48b7-95e3-fe3377939608 response_code = 204 uri = /vpc-routes
18262024-11-19T02:11:16.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38928 req_id = 00136031-4fe3-4dca-bcc2-e7c5ef138b9b response_code = 200 uri = /network-bootstore-config
18272024-11-19T02:11:16.375ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
18282024-11-19T02:11:16.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62852 req_id = efc5a8a1-1d01-4be9-b18c-c20fa6249d46 response_code = 200 uri = /v2p
18292024-11-19T02:11:16.409ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
18302024-11-19T02:11:16.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83771 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57313 req_id = 391b3e9d-c83f-4124-8f46-2b73a4a1b89c response_code = 204 uri = /switch-ports
18312024-11-19T02:11:16.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57313 req_id = cfe97a1e-350e-4187-87e0-4648326c84bf response_code = 200 uri = /network-bootstore-config
18322024-11-19T02:11:29.941ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53011
18332024-11-19T02:11:29.942ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53011 req_id = cd6137de-dd61-46b1-9f27-ab2829b00cdf response_code = 200 uri = /baseboard
18342024-11-19T02:11:46.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41832
18352024-11-19T02:11:46.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41832 req_id = 792c09bc-1078-42b0-bf21-e73ec837eb6e response_code = 200 uri = /vpc-routes
18362024-11-19T02:11:46.134ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
18372024-11-19T02:11:46.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41832 req_id = 6ff75cea-9a85-44c5-b21d-4ef0255a46aa response_code = 204 uri = /eip-gateways
18382024-11-19T02:11:46.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43698
18392024-11-19T02:11:46.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43698 req_id = 60d0fe70-ae79-4c46-8aa1-4796373f5069 response_code = 200 uri = /v2p
18402024-11-19T02:11:46.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41832 req_id = 241fbf87-2b09-4f36-a952-d13431ad658f response_code = 204 uri = /vpc-routes
18412024-11-19T02:11:46.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63891
18422024-11-19T02:11:46.226ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
18432024-11-19T02:11:46.267ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
18442024-11-19T02:11:46.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100418 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63891 req_id = 4c7c8f5e-c17a-4c5c-84e3-fceb5a0fe940 response_code = 204 uri = /switch-ports
18452024-11-19T02:11:46.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55842
18462024-11-19T02:11:46.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44356
18472024-11-19T02:11:46.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55842 req_id = 728a10ca-ce99-4ed0-9ebe-630970c2f242 response_code = 200 uri = /vpc-routes
18482024-11-19T02:11:46.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63891 req_id = f6a00962-a595-4631-a31f-e35267e13255 response_code = 200 uri = /network-bootstore-config
18492024-11-19T02:11:46.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44356 req_id = 27262170-b6e5-48ee-9e83-d731325e283d response_code = 200 uri = /v2p
18502024-11-19T02:11:46.371ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
18512024-11-19T02:11:46.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55842 req_id = cfb5b436-3c5d-4aeb-9f73-ec6f92881519 response_code = 204 uri = /eip-gateways
18522024-11-19T02:11:46.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51956
18532024-11-19T02:11:46.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
18542024-11-19T02:11:46.414ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
18552024-11-19T02:11:46.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102468 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51956 req_id = e496eba7-dc04-40b3-85fe-ce1a01a5afe9 response_code = 204 uri = /switch-ports
18562024-11-19T02:11:46.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44745
18572024-11-19T02:11:46.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 456 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55842 req_id = b473da46-ba56-4bd6-a376-e4422f9ba3b3 response_code = 204 uri = /vpc-routes
18582024-11-19T02:11:46.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51956 req_id = 301a177f-2c91-4e19-af66-eed87bfd6873 response_code = 200 uri = /network-bootstore-config
18592024-11-19T02:11:46.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44745 req_id = cd16eb82-e288-4ec7-80ae-7cb71ccf073c response_code = 200 uri = /vpc-routes
18602024-11-19T02:11:46.532ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
18612024-11-19T02:11:46.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44745 req_id = 38883bee-50bb-48d4-a264-125614763e00 response_code = 204 uri = /eip-gateways
18622024-11-19T02:11:46.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57040
18632024-11-19T02:11:46.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57040 req_id = a8886aa1-4f01-4ccc-aa2d-245ab784711f response_code = 200 uri = /v2p
18642024-11-19T02:11:46.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44745 req_id = 5e40c338-dbc3-46a1-9c5f-e53e47f5af7e response_code = 204 uri = /vpc-routes
18652024-11-19T02:11:46.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39777
18662024-11-19T02:11:46.658ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
18672024-11-19T02:11:46.696ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
18682024-11-19T02:11:46.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39777 req_id = 17f3cba5-0c51-45b3-ba04-eca965411741 response_code = 204 uri = /switch-ports
18692024-11-19T02:11:46.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39777 req_id = c9583caa-84e6-4a97-aff2-6b39a88bb6b7 response_code = 200 uri = /network-bootstore-config
18702024-11-19T02:11:59.974ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43395
18712024-11-19T02:11:59.974ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43395 req_id = f0ef26bf-f9a6-4300-9c79-1ca1052293ef response_code = 200 uri = /baseboard
18722024-11-19T02:12:15.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47871
18732024-11-19T02:12:15.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47871 req_id = 6e1e99f3-72ad-474a-80f1-e7dae13f6e62 response_code = 200 uri = /vpc-routes
18742024-11-19T02:12:15.996ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
18752024-11-19T02:12:15.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47871 req_id = fed3f0ae-c825-4712-a59a-fcc23fc10fbc response_code = 204 uri = /eip-gateways
18762024-11-19T02:12:16.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47871 req_id = fdbc29da-2519-478b-b188-489958ffd722 response_code = 204 uri = /vpc-routes
18772024-11-19T02:12:16.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40473
18782024-11-19T02:12:16.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40473 req_id = 3b750043-0672-4a89-b8dc-418e88532280 response_code = 200 uri = /v2p
18792024-11-19T02:12:16.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40203
18802024-11-19T02:12:16.080ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
18812024-11-19T02:12:16.129ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
18822024-11-19T02:12:16.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115208 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40203 req_id = 984bc542-62a7-4b6e-9f48-0858166fe249 response_code = 204 uri = /switch-ports
18832024-11-19T02:12:16.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43829
18842024-11-19T02:12:16.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43829 req_id = 3c01bdff-3273-4ada-b9f4-5c05c04e901d response_code = 200 uri = /vpc-routes
18852024-11-19T02:12:16.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40203 req_id = a74087bd-49cf-45e5-a007-4bdc0833980b response_code = 200 uri = /network-bootstore-config
18862024-11-19T02:12:16.241ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
18872024-11-19T02:12:16.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43829 req_id = 6b4ecf4f-8a91-4114-be88-6537f871c5a9 response_code = 204 uri = /eip-gateways
18882024-11-19T02:12:16.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43829 req_id = 9cb8fc64-1a60-447f-ac9e-d09d097f50cf response_code = 204 uri = /vpc-routes
18892024-11-19T02:12:16.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60108
18902024-11-19T02:12:16.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60108 req_id = 2d5ad502-6f2e-4461-a7c6-9f4947b07c98 response_code = 200 uri = /vpc-routes
18912024-11-19T02:12:16.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36688
18922024-11-19T02:12:16.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36688 req_id = 22069d13-63da-4e5c-9134-860805e297e3 response_code = 200 uri = /v2p
18932024-11-19T02:12:16.301ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
18942024-11-19T02:12:16.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60108 req_id = 32a20967-25f4-42b9-abab-191eb658785f response_code = 204 uri = /eip-gateways
18952024-11-19T02:12:16.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42492
18962024-11-19T02:12:16.303ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
18972024-11-19T02:12:16.343ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
18982024-11-19T02:12:16.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97613 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42492 req_id = 5b3f32c2-ab5b-45d8-bb26-8a660e1d722e response_code = 204 uri = /switch-ports
18992024-11-19T02:12:16.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42492 req_id = 07336d00-f26f-44a4-9af6-43c1a1bc9c9e response_code = 200 uri = /network-bootstore-config
19002024-11-19T02:12:16.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60108 req_id = 79be1191-6895-4142-8082-c8efa03d193d response_code = 204 uri = /vpc-routes
19012024-11-19T02:12:16.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46311
19022024-11-19T02:12:16.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46311 req_id = 628d9355-15a4-4402-b8d8-ec303e82daf5 response_code = 200 uri = /v2p
19032024-11-19T02:12:16.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56430
19042024-11-19T02:12:16.464ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
19052024-11-19T02:12:16.499ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
19062024-11-19T02:12:16.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86202 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56430 req_id = 9043787a-cc8e-4649-b8a9-002d97c43e27 response_code = 204 uri = /switch-ports
19072024-11-19T02:12:16.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56430 req_id = c3c0d5a4-57d2-4d0d-b035-4674f2924513 response_code = 200 uri = /network-bootstore-config
19082024-11-19T02:12:30.006ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43549
19092024-11-19T02:12:30.006ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43549 req_id = 44a15ca8-03ae-4ce4-a72e-ae6b66524b41 response_code = 200 uri = /baseboard
19102024-11-19T02:12:46.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62405
19112024-11-19T02:12:46.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62405 req_id = ee2e1bf5-fdf5-4517-b5e2-6998ab5bc90c response_code = 200 uri = /vpc-routes
19122024-11-19T02:12:46.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40153
19132024-11-19T02:12:46.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40153 req_id = 49104842-0965-4021-a4e3-419816f17d85 response_code = 200 uri = /vpc-routes
19142024-11-19T02:12:46.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64775
19152024-11-19T02:12:46.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64775 req_id = 29ccf4af-fe41-4ebb-8bbd-006f07e55de6 response_code = 200 uri = /v2p
19162024-11-19T02:12:46.313ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
19172024-11-19T02:12:46.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40153 req_id = 208bac06-4803-40d7-9935-24da27cd34e9 response_code = 204 uri = /eip-gateways
19182024-11-19T02:12:46.330ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
19192024-11-19T02:12:46.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62405 req_id = ab5aaa50-deda-40ba-a8e1-41c09f990553 response_code = 204 uri = /eip-gateways
19202024-11-19T02:12:46.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62405 req_id = a440b357-0482-4e74-a452-4020ec11e4dd response_code = 204 uri = /vpc-routes
19212024-11-19T02:12:46.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52724
19222024-11-19T02:12:46.348ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
19232024-11-19T02:12:46.385ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
19242024-11-19T02:12:46.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94320 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52724 req_id = 841c4967-ab2c-4cd5-b6d3-be153352c55d response_code = 204 uri = /switch-ports
19252024-11-19T02:12:46.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60475
19262024-11-19T02:12:46.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59931
19272024-11-19T02:12:46.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64036
19282024-11-19T02:12:46.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40153 req_id = da0b0c9e-c15d-40af-a054-dc344256db5e response_code = 204 uri = /vpc-routes
19292024-11-19T02:12:46.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52724 req_id = 48239b57-3a16-4f00-803c-897171cfc513 response_code = 200 uri = /network-bootstore-config
19302024-11-19T02:12:46.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59931 req_id = 2562fae3-806f-4bb2-895e-72ba4109b36a response_code = 200 uri = /vpc-routes
19312024-11-19T02:12:46.443ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
19322024-11-19T02:12:46.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64036 req_id = 9936248c-6796-474d-94b3-65f886e722b0 response_code = 200 uri = /v2p
19332024-11-19T02:12:46.482ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
19342024-11-19T02:12:46.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33043
19352024-11-19T02:12:46.488ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
19362024-11-19T02:12:46.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33043 req_id = d74de20a-6dea-456b-9bde-210183b819cb response_code = 200 uri = /v2p
19372024-11-19T02:12:46.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59931 req_id = 73bd7201-50fe-4f6c-8785-0e0fc1f90a01 response_code = 204 uri = /eip-gateways
19382024-11-19T02:12:46.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4651 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59931 req_id = fa6866a0-5f0e-41a6-a78e-7826627939a5 response_code = 204 uri = /vpc-routes
19392024-11-19T02:12:46.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49181
19402024-11-19T02:12:46.547ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
19412024-11-19T02:12:46.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103993 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60475 req_id = d6f2921d-fc0b-4626-9c17-4f22759bb6b1 response_code = 204 uri = /switch-ports
19422024-11-19T02:12:46.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 437 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60475 req_id = 6d7eb20e-dc3b-4077-bf98-431c3ce2cdb9 response_code = 200 uri = /network-bootstore-config
19432024-11-19T02:12:46.581ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
19442024-11-19T02:12:46.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120253 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49181 req_id = 21d0411b-f386-4f83-813d-c8d23ef2cd90 response_code = 204 uri = /switch-ports
19452024-11-19T02:12:46.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49181 req_id = a9129e54-2318-4d23-a51f-bd0590f90d63 response_code = 200 uri = /network-bootstore-config
19462024-11-19T02:12:51.197ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19472024-11-19T02:13:00.039ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35671
19482024-11-19T02:13:00.039ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35671 req_id = 2a669b1e-cc96-402d-8c39-7e8c6c214ec6 response_code = 200 uri = /baseboard
19492024-11-19T02:13:15.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58978
19502024-11-19T02:13:15.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58978 req_id = 50dcc8f1-db85-4a5e-98a3-8d0a26e26d61 response_code = 200 uri = /vpc-routes
19512024-11-19T02:13:15.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33247
19522024-11-19T02:13:15.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33247 req_id = af9cdc22-2817-4912-9e61-daa0bc9bd8f5 response_code = 200 uri = /v2p
19532024-11-19T02:13:15.997ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
19542024-11-19T02:13:15.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58978 req_id = 976f1094-4a7f-435e-818b-d51cb963aa6e response_code = 204 uri = /eip-gateways
19552024-11-19T02:13:16.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56962
19562024-11-19T02:13:16.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56962 req_id = 026ee0bb-443c-47d7-9a48-e535a241c987 response_code = 200 uri = /vpc-routes
19572024-11-19T02:13:16.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58978 req_id = e09755b6-a015-423a-ae58-a91be0b4b4e1 response_code = 204 uri = /vpc-routes
19582024-11-19T02:13:16.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
19592024-11-19T02:13:16.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56962 req_id = 9093bf43-9150-4b9f-ba59-4cf92b2e95fe response_code = 204 uri = /eip-gateways
19602024-11-19T02:13:16.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54846
19612024-11-19T02:13:16.119ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
19622024-11-19T02:13:16.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
19632024-11-19T02:13:16.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95891 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54846 req_id = 4411feea-e2e0-4359-bf94-5648558233f6 response_code = 204 uri = /switch-ports
19642024-11-19T02:13:16.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50219
19652024-11-19T02:13:16.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54846 req_id = 3c8c9e28-794d-4c98-9f75-bc65c276a33d response_code = 200 uri = /network-bootstore-config
19662024-11-19T02:13:16.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50219 req_id = 90b9c1d4-2827-4eec-8e0b-673f105053cc response_code = 200 uri = /v2p
19672024-11-19T02:13:16.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56962 req_id = 8a1e1f24-1004-4b16-a168-75ecc4b33c90 response_code = 204 uri = /vpc-routes
19682024-11-19T02:13:16.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47413
19692024-11-19T02:13:16.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47413 req_id = 70e7e9f7-d104-450e-bc53-03b4a963ae95 response_code = 200 uri = /vpc-routes
19702024-11-19T02:13:16.289ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
19712024-11-19T02:13:16.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47413 req_id = 5f1bb703-f7b1-4c90-a8fa-1b14a865045b response_code = 204 uri = /eip-gateways
19722024-11-19T02:13:16.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36329
19732024-11-19T02:13:16.294ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
19742024-11-19T02:13:16.336ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
19752024-11-19T02:13:16.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96611 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36329 req_id = 9e2e6a53-8c1e-40e7-9394-cb4ae3d218cb response_code = 204 uri = /switch-ports
19762024-11-19T02:13:16.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47413 req_id = 1ecbc3c2-e1b3-4d8f-bd5c-b5186398ed1f response_code = 204 uri = /vpc-routes
19772024-11-19T02:13:16.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36329 req_id = 0d621b37-4841-42be-9fdc-e6b9ab04280e response_code = 200 uri = /network-bootstore-config
19782024-11-19T02:13:16.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57729
19792024-11-19T02:13:16.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57729 req_id = 834ffd99-a300-4b86-bc67-3fd615466ea9 response_code = 200 uri = /v2p
19802024-11-19T02:13:16.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63347
19812024-11-19T02:13:16.483ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
19822024-11-19T02:13:16.521ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
19832024-11-19T02:13:16.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63347 req_id = 899a5241-2cfd-4859-b303-3babb0a20fc3 response_code = 204 uri = /switch-ports
19842024-11-19T02:13:16.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63347 req_id = a01bd425-80c4-4eac-ac80-149ccdd0e710 response_code = 200 uri = /network-bootstore-config
19852024-11-19T02:13:30.074ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34908
19862024-11-19T02:13:30.074ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34908 req_id = 34845209-8a19-45ea-8771-e4aa8285fc85 response_code = 200 uri = /baseboard
19872024-11-19T02:13:45.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35267
19882024-11-19T02:13:45.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35267 req_id = a22e2da2-cc65-4b7d-9351-c49050d74af4 response_code = 200 uri = /vpc-routes
19892024-11-19T02:13:46.021ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
19902024-11-19T02:13:46.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35267 req_id = 35e46065-f9a7-4b6a-91c8-afdc3f80e0d3 response_code = 204 uri = /eip-gateways
19912024-11-19T02:13:46.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47276
19922024-11-19T02:13:46.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47276 req_id = 06168cb0-4a2f-4e48-bdfb-15c643bb5132 response_code = 200 uri = /vpc-routes
19932024-11-19T02:13:46.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63062
19942024-11-19T02:13:46.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63062 req_id = ecd9d283-f966-4a7e-bbf0-c2dadd8bdbd3 response_code = 200 uri = /v2p
19952024-11-19T02:13:46.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35267 req_id = a60b91a5-6479-4e00-8f9e-4985605c081c response_code = 204 uri = /vpc-routes
19962024-11-19T02:13:46.253ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
19972024-11-19T02:13:46.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47276 req_id = fcd86b22-e31c-4049-b0ea-4954278882fb response_code = 204 uri = /eip-gateways
19982024-11-19T02:13:46.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47276 req_id = d0dafef5-7799-4feb-914b-afc658ef2714 response_code = 204 uri = /vpc-routes
19992024-11-19T02:13:46.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39881
20002024-11-19T02:13:46.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39881 req_id = 4c874186-2e28-40e5-8ed2-3fe8225b832d response_code = 200 uri = /vpc-routes
20012024-11-19T02:13:46.339ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
20022024-11-19T02:13:46.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39881 req_id = f0434978-5cb6-47a6-b654-23022635f17e response_code = 204 uri = /eip-gateways
20032024-11-19T02:13:46.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39881 req_id = 2298b093-4255-47af-b000-7442504d030d response_code = 204 uri = /vpc-routes
20042024-11-19T02:13:46.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32790
20052024-11-19T02:13:46.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32790 req_id = 857b44a9-76c4-4610-b781-2f57728509bc response_code = 200 uri = /v2p
20062024-11-19T02:13:46.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40810
20072024-11-19T02:13:46.459ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
20082024-11-19T02:13:46.498ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
20092024-11-19T02:13:46.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94163 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40810 req_id = 42fda244-ae62-4b60-91f5-e1513ed22316 response_code = 204 uri = /switch-ports
20102024-11-19T02:13:46.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40810 req_id = eac2b552-619d-47a0-8b85-04d50f1c6822 response_code = 200 uri = /network-bootstore-config
20112024-11-19T02:13:46.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42845
20122024-11-19T02:13:46.574ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
20132024-11-19T02:13:46.608ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
20142024-11-19T02:13:46.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82728 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42845 req_id = d2e20eee-908a-40d2-84dd-177f8db0e437 response_code = 204 uri = /switch-ports
20152024-11-19T02:13:46.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60470
20162024-11-19T02:13:46.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60470 req_id = 0ca31b92-5c2a-4192-b809-d1da3619ceec response_code = 200 uri = /v2p
20172024-11-19T02:13:46.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42845 req_id = a437b705-dfa1-4250-9117-bd032a4c8bcb response_code = 200 uri = /network-bootstore-config
20182024-11-19T02:13:46.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54661
20192024-11-19T02:13:46.689ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
20202024-11-19T02:13:46.726ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
20212024-11-19T02:13:46.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54661 req_id = 9e13720b-568e-4900-a7bc-2588d4a58a1e response_code = 204 uri = /switch-ports
20222024-11-19T02:13:46.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54661 req_id = 37fa7bd5-b670-4a1e-b3c7-36a8e4ca03ef response_code = 200 uri = /network-bootstore-config
20232024-11-19T02:14:00.111ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43180
20242024-11-19T02:14:00.111ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43180 req_id = d990617b-3498-401e-ace7-f5d13cf04d71 response_code = 200 uri = /baseboard
20252024-11-19T02:14:15.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64446
20262024-11-19T02:14:15.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64446 req_id = e5998027-f98f-4abe-ab3b-471a681050ef response_code = 200 uri = /vpc-routes
20272024-11-19T02:14:15.997ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
20282024-11-19T02:14:15.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64446 req_id = b55ba166-2e55-443d-9a8f-bbf748efe2dc response_code = 204 uri = /eip-gateways
20292024-11-19T02:14:16.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64446 req_id = 610c57ab-935f-42c7-9c61-31ab78fbf793 response_code = 204 uri = /vpc-routes
20302024-11-19T02:14:16.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45492
20312024-11-19T02:14:16.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45492 req_id = 237dd9cb-6b6e-4165-bfdb-0b90b25a2bb1 response_code = 200 uri = /v2p
20322024-11-19T02:14:16.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43683
20332024-11-19T02:14:16.118ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
20342024-11-19T02:14:16.159ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
20352024-11-19T02:14:16.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105111 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43683 req_id = 86421b8b-cd48-44bd-97a1-00d533577852 response_code = 204 uri = /switch-ports
20362024-11-19T02:14:16.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48445
20372024-11-19T02:14:16.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48445 req_id = 973c6536-4de2-4188-82d4-6a3da39a4a48 response_code = 200 uri = /vpc-routes
20382024-11-19T02:14:16.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43683 req_id = 1b3636bf-9791-4097-b855-1a44353a188b response_code = 200 uri = /network-bootstore-config
20392024-11-19T02:14:16.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60944
20402024-11-19T02:14:16.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60944 req_id = 650ef46d-9e99-4ec2-af37-fe7d742e94d7 response_code = 200 uri = /vpc-routes
20412024-11-19T02:14:16.271ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
20422024-11-19T02:14:16.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48445 req_id = d963f65d-f008-401d-8e70-82316c46d6c4 response_code = 204 uri = /eip-gateways
20432024-11-19T02:14:16.278ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
20442024-11-19T02:14:16.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60944 req_id = 73e5648d-346b-49b5-b016-06d2f7fd6f33 response_code = 204 uri = /eip-gateways
20452024-11-19T02:14:16.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65445
20462024-11-19T02:14:16.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65445 req_id = a6586ee3-e80c-4069-9f0d-293bfcced29a response_code = 200 uri = /v2p
20472024-11-19T02:14:16.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63925
20482024-11-19T02:14:16.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63925 req_id = c44dca83-7797-4da4-b5c2-e3263f09db88 response_code = 200 uri = /v2p
20492024-11-19T02:14:16.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48445 req_id = 075296c8-b457-49ea-b447-7052dd13eac1 response_code = 204 uri = /vpc-routes
20502024-11-19T02:14:16.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60944 req_id = 8c3a7e3e-0ba5-4187-a6c2-c3cd7542dea0 response_code = 204 uri = /vpc-routes
20512024-11-19T02:14:16.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48565
20522024-11-19T02:14:16.358ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
20532024-11-19T02:14:16.398ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
20542024-11-19T02:14:16.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48565 req_id = f4bdac95-40ca-41a8-9ee2-897cdc790970 response_code = 204 uri = /switch-ports
20552024-11-19T02:14:16.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36600
20562024-11-19T02:14:16.456ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
20572024-11-19T02:14:16.490ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
20582024-11-19T02:14:16.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86918 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36600 req_id = 508797cf-04ce-447b-80ad-6986f1429167 response_code = 204 uri = /switch-ports
20592024-11-19T02:14:16.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48565 req_id = 21bec5c3-60a7-4936-84b0-f967ae8204b9 response_code = 200 uri = /network-bootstore-config
20602024-11-19T02:14:16.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36600 req_id = 69725e59-149f-411d-8c4a-bab2d0ffbcca response_code = 200 uri = /network-bootstore-config
20612024-11-19T02:14:30.144ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48137
20622024-11-19T02:14:30.144ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48137 req_id = 9182828d-2d67-4688-9162-892b4b848bf7 response_code = 200 uri = /baseboard
20632024-11-19T02:14:46.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45193
20642024-11-19T02:14:46.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45193 req_id = da7485dd-c0e4-43be-8f2c-506219613a62 response_code = 200 uri = /vpc-routes
20652024-11-19T02:14:46.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51779
20662024-11-19T02:14:46.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51779 req_id = dc7fe888-093a-4a39-b6ef-337b2a2e2cbf response_code = 200 uri = /v2p
20672024-11-19T02:14:46.245ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
20682024-11-19T02:14:46.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45193 req_id = c4e80f02-e938-427e-bc95-9a19c1fdb4d5 response_code = 204 uri = /eip-gateways
20692024-11-19T02:14:46.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45193 req_id = a69042a7-0331-4226-9e25-f761426f5e61 response_code = 204 uri = /vpc-routes
20702024-11-19T02:14:46.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61711
20712024-11-19T02:14:46.291ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
20722024-11-19T02:14:46.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
20732024-11-19T02:14:46.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126991 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61711 req_id = eeba411b-2a5a-4de4-8a08-89492faaea98 response_code = 204 uri = /switch-ports
20742024-11-19T02:14:46.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35295
20752024-11-19T02:14:46.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62940
20762024-11-19T02:14:46.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49882
20772024-11-19T02:14:46.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61711 req_id = d26fc9b4-4028-4ade-b549-75fdca166d33 response_code = 200 uri = /network-bootstore-config
20782024-11-19T02:14:46.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62940 req_id = 61fd7738-ea3a-4d46-8099-beaa72ed0c56 response_code = 200 uri = /vpc-routes
20792024-11-19T02:14:46.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35295 req_id = 7e1126c1-98d0-4714-9aff-03df9bebc9ef response_code = 200 uri = /vpc-routes
20802024-11-19T02:14:46.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49882 req_id = 8b70196a-4938-495a-90d9-c0d04f98e961 response_code = 200 uri = /v2p
20812024-11-19T02:14:46.479ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
20822024-11-19T02:14:46.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35295 req_id = 0685ed5d-b3d0-48b1-ae6c-62dfddfa0eb3 response_code = 204 uri = /eip-gateways
20832024-11-19T02:14:46.479ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
20842024-11-19T02:14:46.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62940 req_id = 228e3b93-c4ff-479b-bbac-9eb5e8f6a99e response_code = 204 uri = /eip-gateways
20852024-11-19T02:14:46.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62940 req_id = 73d2eb42-64bb-48d1-beec-0587fc1d4029 response_code = 204 uri = /vpc-routes
20862024-11-19T02:14:46.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63445
20872024-11-19T02:14:46.512ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
20882024-11-19T02:14:46.556ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
20892024-11-19T02:14:46.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116491 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63445 req_id = fa2c8a5a-0556-4772-a12c-b4f1b7ebc5cd response_code = 204 uri = /switch-ports
20902024-11-19T02:14:46.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57068
20912024-11-19T02:14:46.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40634
20922024-11-19T02:14:46.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63445 req_id = bc7ca2a2-5a74-4b69-8cac-c090cc618a99 response_code = 200 uri = /network-bootstore-config
20932024-11-19T02:14:46.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35295 req_id = a5a73522-432f-4a3a-b9cb-cf21c9c77bbe response_code = 204 uri = /vpc-routes
20942024-11-19T02:14:46.629ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
20952024-11-19T02:14:46.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57068 req_id = 3b87d130-1b17-43eb-8478-73f1d1a90071 response_code = 200 uri = /v2p
20962024-11-19T02:14:46.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58593
20972024-11-19T02:14:46.637ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20982024-11-19T02:14:46.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20992024-11-19T02:14:46.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21002024-11-19T02:14:46.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21012024-11-19T02:14:46.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21022024-11-19T02:14:46.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
21032024-11-19T02:14:46.637ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21042024-11-19T02:14:46.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 521 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58593 req_id = ed273c2a-4885-4dfe-81bd-697766a05542 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21052024-11-19T02:14:46.670ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
21062024-11-19T02:14:46.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40634 req_id = b15ba839-d992-4b77-ac39-06229a23e6ad response_code = 204 uri = /switch-ports
21072024-11-19T02:14:46.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40634 req_id = b1b023b4-2ce4-4949-8f97-db1729935b3c response_code = 200 uri = /network-bootstore-config
21082024-11-19T02:14:46.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50301
21092024-11-19T02:14:46.735ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21102024-11-19T02:14:46.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21112024-11-19T02:14:46.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21122024-11-19T02:14:46.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21132024-11-19T02:14:46.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21142024-11-19T02:14:46.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
21152024-11-19T02:14:46.735ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21162024-11-19T02:14:46.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50301 req_id = f805db0d-2605-4b84-a8d0-c38d61caee50 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21172024-11-19T02:14:46.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54527
21182024-11-19T02:14:46.791ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21192024-11-19T02:14:46.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21202024-11-19T02:14:46.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21212024-11-19T02:14:46.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21222024-11-19T02:14:46.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21232024-11-19T02:14:46.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
21242024-11-19T02:14:46.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21252024-11-19T02:14:46.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54527 req_id = dcedbd17-3de9-4738-9ea8-ca0c8edb4678 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21262024-11-19T02:15:00.177ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54283
21272024-11-19T02:15:00.177ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54283 req_id = 9e49b7e9-2779-436e-bd25-96b0d81f508e response_code = 200 uri = /baseboard
21282024-11-19T02:15:15.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50484
21292024-11-19T02:15:15.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50484 req_id = c618632c-6c22-445e-9f15-362c2411f3af response_code = 200 uri = /vpc-routes
21302024-11-19T02:15:15.907ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
21312024-11-19T02:15:15.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50484 req_id = cb5772dc-63eb-403a-aac7-8c1db1172870 response_code = 204 uri = /eip-gateways
21322024-11-19T02:15:15.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50484 req_id = e5135bca-c347-4332-a6c8-e4eb090227c3 response_code = 204 uri = /vpc-routes
21332024-11-19T02:15:16.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44309
21342024-11-19T02:15:16.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
21352024-11-19T02:15:16.082ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
21362024-11-19T02:15:16.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44309 req_id = e2aca412-e49b-4ee0-a615-ed9168901f2a response_code = 204 uri = /switch-ports
21372024-11-19T02:15:16.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55977
21382024-11-19T02:15:16.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40742
21392024-11-19T02:15:16.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44309 req_id = 92b8b7e8-0f76-45dd-9539-b67e88546efb response_code = 200 uri = /network-bootstore-config
21402024-11-19T02:15:16.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55977 req_id = fd1ac8a7-7a2a-49ff-a4ab-2604862d57e0 response_code = 200 uri = /vpc-routes
21412024-11-19T02:15:16.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40742 req_id = fefacd01-8e19-4550-ace0-ebcb7061ed23 response_code = 200 uri = /v2p
21422024-11-19T02:15:16.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
21432024-11-19T02:15:16.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55977 req_id = da6baa44-1e7e-4ead-aa87-e2512bf8edb3 response_code = 204 uri = /eip-gateways
21442024-11-19T02:15:16.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37685
21452024-11-19T02:15:16.221ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
21462024-11-19T02:15:16.264ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
21472024-11-19T02:15:16.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105228 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37685 req_id = 6e93b5a7-4054-4527-9c5d-d428cea5e770 response_code = 204 uri = /switch-ports
21482024-11-19T02:15:16.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50854
21492024-11-19T02:15:16.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47561
21502024-11-19T02:15:16.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37685 req_id = a1444ebf-bae8-4be5-9b2f-0c3ef1a24d7e response_code = 200 uri = /network-bootstore-config
21512024-11-19T02:15:16.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55977 req_id = 9a611d56-34d8-4284-b417-33dccbdd54fd response_code = 204 uri = /vpc-routes
21522024-11-19T02:15:16.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50854 req_id = ee6411ab-8a27-4e47-a32e-62738019a49a response_code = 200 uri = /vpc-routes
21532024-11-19T02:15:16.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47561 req_id = b152ec30-69a3-4d1b-b6af-21c178428531 response_code = 200 uri = /v2p
21542024-11-19T02:15:16.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
21552024-11-19T02:15:16.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50854 req_id = 751fdc6f-9a2f-4220-8bbc-122688346c35 response_code = 204 uri = /eip-gateways
21562024-11-19T02:15:16.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48357
21572024-11-19T02:15:16.342ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
21582024-11-19T02:15:16.380ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
21592024-11-19T02:15:16.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91443 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48357 req_id = 89b69c90-9c36-421a-bc3e-957f8b2f268a response_code = 204 uri = /switch-ports
21602024-11-19T02:15:16.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41841
21612024-11-19T02:15:16.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41841 req_id = a055ed1e-af4a-40b3-a77a-b0af6b2357de response_code = 200 uri = /v2p
21622024-11-19T02:15:16.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48357 req_id = d72b2608-13e4-4cca-a0b4-3cd0a4374291 response_code = 200 uri = /network-bootstore-config
21632024-11-19T02:15:16.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50854 req_id = a8ac2034-0e28-4fd9-80c6-82679a7c13bf response_code = 204 uri = /vpc-routes
21642024-11-19T02:15:30.212ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49805
21652024-11-19T02:15:30.212ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49805 req_id = f2ccfbe2-2dd2-4221-ae30-86a4a765faa0 response_code = 200 uri = /baseboard
21662024-11-19T02:15:46.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44359
21672024-11-19T02:15:46.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44359 req_id = be6e88cb-9c15-454c-9108-58be70657494 response_code = 200 uri = /vpc-routes
21682024-11-19T02:15:46.125ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
21692024-11-19T02:15:46.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44359 req_id = afa3fb3e-029a-4faa-9f2c-9c7f46dbbbb9 response_code = 204 uri = /eip-gateways
21702024-11-19T02:15:46.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44359 req_id = 9a8ef495-57e4-410d-ac15-1e93ceab2711 response_code = 204 uri = /vpc-routes
21712024-11-19T02:15:46.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52306
21722024-11-19T02:15:46.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52306 req_id = f0bc33d1-22e2-44e9-b71b-1bff5ef17249 response_code = 200 uri = /v2p
21732024-11-19T02:15:46.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52523
21742024-11-19T02:15:46.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52523 req_id = 8d344145-578e-40b5-a01c-47fdab59b506 response_code = 200 uri = /v2p
21752024-11-19T02:15:46.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45708
21762024-11-19T02:15:46.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45708 req_id = 063409a1-725b-425c-9c70-8db74a0327fb response_code = 200 uri = /vpc-routes
21772024-11-19T02:15:46.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32810
21782024-11-19T02:15:46.346ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
21792024-11-19T02:15:46.393ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
21802024-11-19T02:15:46.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112766 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32810 req_id = 27464145-777e-4c9c-b84e-9b0029442fe4 response_code = 204 uri = /switch-ports
21812024-11-19T02:15:46.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44662
21822024-11-19T02:15:46.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
21832024-11-19T02:15:46.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45708 req_id = b620534c-0426-4d0a-bdf9-66eb64f07fe3 response_code = 204 uri = /eip-gateways
21842024-11-19T02:15:46.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56670
21852024-11-19T02:15:46.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32810 req_id = c8919fad-e8a3-4c2e-af7d-2c1fe568e9a7 response_code = 200 uri = /network-bootstore-config
21862024-11-19T02:15:46.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44662 req_id = 39701b13-a4eb-4f5e-aca0-3e5d11a74852 response_code = 200 uri = /vpc-routes
21872024-11-19T02:15:46.459ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
21882024-11-19T02:15:46.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45708 req_id = 50dbc208-55ac-4bde-afe4-b4f9c34047b5 response_code = 204 uri = /vpc-routes
21892024-11-19T02:15:46.501ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
21902024-11-19T02:15:46.505ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
21912024-11-19T02:15:46.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 625 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44662 req_id = d8f4ad55-2b77-40d2-b905-df1e89dc1ae8 response_code = 204 uri = /eip-gateways
21922024-11-19T02:15:46.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101329 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56670 req_id = ca213c49-facb-430c-af0d-5fcaf93c6559 response_code = 204 uri = /switch-ports
21932024-11-19T02:15:46.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56670 req_id = 4fbdea29-0cd9-4557-9cb7-6e263d07ca6c response_code = 200 uri = /network-bootstore-config
21942024-11-19T02:15:46.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56725
21952024-11-19T02:15:46.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56725 req_id = 649003e3-d470-4e3f-93ef-b7eba287e378 response_code = 200 uri = /v2p
21962024-11-19T02:15:46.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44662 req_id = 878691e1-17e3-43bb-a02e-81466a5b5e6e response_code = 204 uri = /vpc-routes
21972024-11-19T02:15:46.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49296
21982024-11-19T02:15:46.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
21992024-11-19T02:15:46.671ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
22002024-11-19T02:15:46.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49296 req_id = ab177084-4946-450d-b5ed-13547b663749 response_code = 204 uri = /switch-ports
22012024-11-19T02:15:46.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49296 req_id = 03f68324-f34f-41b6-bdb9-8fb5ea920573 response_code = 200 uri = /network-bootstore-config
22022024-11-19T02:16:00.243ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45614
22032024-11-19T02:16:00.243ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45614 req_id = d20c83a6-dc0d-41a7-9ce3-290ceb63fec4 response_code = 200 uri = /baseboard
22042024-11-19T02:16:15.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58553
22052024-11-19T02:16:15.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58553 req_id = 1dfb7fdb-7e2b-4b0f-bd55-41a6c612f949 response_code = 200 uri = /vpc-routes
22062024-11-19T02:16:15.939ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
22072024-11-19T02:16:15.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58553 req_id = 2c049d4b-06a4-43f4-be07-198fd11af845 response_code = 204 uri = /eip-gateways
22082024-11-19T02:16:15.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58553 req_id = ace90a4a-525c-4696-8f13-b20dcdd338cd response_code = 204 uri = /vpc-routes
22092024-11-19T02:16:16.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47405
22102024-11-19T02:16:16.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47405 req_id = b7b37899-3754-4b69-9e28-7f5933c48580 response_code = 200 uri = /v2p
22112024-11-19T02:16:16.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62102
22122024-11-19T02:16:16.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62102 req_id = 395bccdb-8200-4ad8-8793-d328326086d6 response_code = 200 uri = /vpc-routes
22132024-11-19T02:16:16.101ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
22142024-11-19T02:16:16.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62102 req_id = 4c4da036-eb4b-4fad-a49a-cf48f1c54cae response_code = 204 uri = /eip-gateways
22152024-11-19T02:16:16.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62102 req_id = e2eed4ff-ab68-4049-91d6-a3ac57dc8b1d response_code = 204 uri = /vpc-routes
22162024-11-19T02:16:16.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41421
22172024-11-19T02:16:16.111ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
22182024-11-19T02:16:16.158ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
22192024-11-19T02:16:16.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110137 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41421 req_id = baa511ab-ff3f-4272-a64a-2ea28f916dad response_code = 204 uri = /switch-ports
22202024-11-19T02:16:16.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52245
22212024-11-19T02:16:16.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45128
22222024-11-19T02:16:16.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45128 req_id = 5f5e7a32-be60-45e9-bf71-700f9b74fce2 response_code = 200 uri = /v2p
22232024-11-19T02:16:16.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52245 req_id = 299b4b9f-830f-4c58-a5f0-7ea8eb4f1e44 response_code = 200 uri = /vpc-routes
22242024-11-19T02:16:16.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41421 req_id = a8f5b15a-0f8b-4512-87d2-bbc86f70e0c7 response_code = 200 uri = /network-bootstore-config
22252024-11-19T02:16:16.238ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
22262024-11-19T02:16:16.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52245 req_id = b1ed6d68-8e14-4442-94c0-24f3baa7fef2 response_code = 204 uri = /eip-gateways
22272024-11-19T02:16:16.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56087
22282024-11-19T02:16:16.278ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
22292024-11-19T02:16:16.327ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
22302024-11-19T02:16:16.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111049 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56087 req_id = fd28cb2f-9c5f-483c-ac64-21ff3a9c5e65 response_code = 204 uri = /switch-ports
22312024-11-19T02:16:16.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59558
22322024-11-19T02:16:16.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52245 req_id = 895d98de-9ad1-4003-80a5-9cab46e43a9f response_code = 204 uri = /vpc-routes
22332024-11-19T02:16:16.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56087 req_id = 8242c7d6-dd93-4323-9e85-ce92b10e7b99 response_code = 200 uri = /network-bootstore-config
22342024-11-19T02:16:16.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59558 req_id = 0e1eaa3c-26af-4f99-b5b0-0605e97c0f49 response_code = 200 uri = /v2p
22352024-11-19T02:16:16.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62332
22362024-11-19T02:16:16.410ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
22372024-11-19T02:16:16.445ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
22382024-11-19T02:16:16.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93192 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62332 req_id = 9d2d140d-0e4e-4f28-a9f3-8156d0605a50 response_code = 204 uri = /switch-ports
22392024-11-19T02:16:16.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62332 req_id = d18a9149-523f-4dbe-8619-a4fc0f69de91 response_code = 200 uri = /network-bootstore-config
22402024-11-19T02:16:30.277ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56949
22412024-11-19T02:16:30.277ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56949 req_id = 23b12c75-4bd5-414d-a6a2-f3a4f10a7f13 response_code = 200 uri = /baseboard
22422024-11-19T02:16:46.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62921
22432024-11-19T02:16:46.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62921 req_id = fc80b232-4e35-4621-94f7-d9e3ac1fc034 response_code = 200 uri = /vpc-routes
22442024-11-19T02:16:46.109ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
22452024-11-19T02:16:46.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62921 req_id = 2ebfcbbf-5bde-4cc9-9146-dd755d361705 response_code = 204 uri = /eip-gateways
22462024-11-19T02:16:46.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62921 req_id = 9725aa82-2486-4c5e-a0ba-6eb6153fbcf6 response_code = 204 uri = /vpc-routes
22472024-11-19T02:16:46.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37554
22482024-11-19T02:16:46.227ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
22492024-11-19T02:16:46.274ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
22502024-11-19T02:16:46.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121888 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37554 req_id = c4ce2e89-924b-4ec8-ac86-b68a2f5a9ea0 response_code = 204 uri = /switch-ports
22512024-11-19T02:16:46.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35481
22522024-11-19T02:16:46.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60724
22532024-11-19T02:16:46.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59045
22542024-11-19T02:16:46.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49339
22552024-11-19T02:16:46.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37554 req_id = 43d39439-42a1-4418-9092-a7533611e676 response_code = 200 uri = /network-bootstore-config
22562024-11-19T02:16:46.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60724 req_id = b891cd3c-0270-4c4c-9d94-73369427a309 response_code = 200 uri = /vpc-routes
22572024-11-19T02:16:46.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35481 req_id = 568a29a4-ea1e-462a-9c4a-e47b137b8275 response_code = 200 uri = /vpc-routes
22582024-11-19T02:16:46.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49339 req_id = b7987178-51ad-4db3-a12a-c079f1e7b025 response_code = 200 uri = /v2p
22592024-11-19T02:16:46.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59045 req_id = 28180170-3e99-4885-b888-8a0c9da06a72 response_code = 200 uri = /v2p
22602024-11-19T02:16:46.365ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
22612024-11-19T02:16:46.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60724 req_id = 6a6b60ce-0ddf-42f5-a577-4a9b7adff73b response_code = 204 uri = /eip-gateways
22622024-11-19T02:16:46.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60724 req_id = b51e1b8d-c238-4703-a90a-e3dc3c0ee3f2 response_code = 204 uri = /vpc-routes
22632024-11-19T02:16:46.401ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
22642024-11-19T02:16:46.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35481 req_id = 025aa84a-419e-435e-a8b1-eb7a043d8b4b response_code = 204 uri = /eip-gateways
22652024-11-19T02:16:46.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35481 req_id = d6c203e0-1e6a-4e11-8900-a5d325511760 response_code = 204 uri = /vpc-routes
22662024-11-19T02:16:46.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42594
22672024-11-19T02:16:46.436ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
22682024-11-19T02:16:46.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
22692024-11-19T02:16:46.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99552 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42594 req_id = 80c02245-06d6-41ae-91d9-0d0d60fe838f response_code = 204 uri = /switch-ports
22702024-11-19T02:16:46.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42594 req_id = 37f64e87-e0aa-48e2-8d99-e10e942f90ad response_code = 200 uri = /network-bootstore-config
22712024-11-19T02:16:46.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56556
22722024-11-19T02:16:46.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56556 req_id = edb86531-da15-44c4-a3ae-bbc5b36e6950 response_code = 200 uri = /v2p
22732024-11-19T02:16:46.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55469
22742024-11-19T02:16:46.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
22752024-11-19T02:16:46.739ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
22762024-11-19T02:16:46.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90999 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55469 req_id = 50840176-5562-42a1-b87a-41de7d53a2d5 response_code = 204 uri = /switch-ports
22772024-11-19T02:16:46.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55469 req_id = 714b4482-7fe0-4fe1-be43-e7740acc48e6 response_code = 200 uri = /network-bootstore-config
22782024-11-19T02:16:49.976ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22792024-11-19T02:16:49.977ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22802024-11-19T02:16:49.978ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22812024-11-19T02:16:49.978ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22822024-11-19T02:16:49.979ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22832024-11-19T02:16:49.980ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22842024-11-19T02:16:49.980ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22852024-11-19T02:16:55.004ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22862024-11-19T02:16:55.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22872024-11-19T02:16:59.976ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22882024-11-19T02:16:59.977ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22892024-11-19T02:16:59.977ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22902024-11-19T02:16:59.978ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22912024-11-19T02:16:59.979ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22922024-11-19T02:16:59.980ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22932024-11-19T02:16:59.980ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22942024-11-19T02:16:59.981ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22952024-11-19T02:16:59.982ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22962024-11-19T02:16:59.982ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22972024-11-19T02:16:59.983ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22982024-11-19T02:16:59.983ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
22992024-11-19T02:16:59.984ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23002024-11-19T02:16:59.984ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23012024-11-19T02:16:59.985ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23022024-11-19T02:16:59.985ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23032024-11-19T02:17:00.309ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44984
23042024-11-19T02:17:00.309ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44984 req_id = bc3720ba-799b-408c-ad69-2b49fa8ecd59 response_code = 200 uri = /baseboard
23052024-11-19T02:17:05.008ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23062024-11-19T02:17:05.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23072024-11-19T02:17:09.980ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23082024-11-19T02:17:09.981ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23092024-11-19T02:17:09.982ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23102024-11-19T02:17:09.983ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23112024-11-19T02:17:09.983ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23122024-11-19T02:17:09.984ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23132024-11-19T02:17:09.985ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23142024-11-19T02:17:09.985ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23152024-11-19T02:17:09.986ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23162024-11-19T02:17:09.986ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23172024-11-19T02:17:09.987ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23182024-11-19T02:17:09.987ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23192024-11-19T02:17:09.988ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23202024-11-19T02:17:09.988ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23212024-11-19T02:17:09.989ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23222024-11-19T02:17:09.989ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23232024-11-19T02:17:15.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23242024-11-19T02:17:15.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23252024-11-19T02:17:15.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53895
23262024-11-19T02:17:15.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53895 req_id = 330288d4-9315-4534-9c32-e484c62060d3 response_code = 200 uri = /vpc-routes
23272024-11-19T02:17:15.961ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
23282024-11-19T02:17:15.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53895 req_id = 14c65e48-585b-4c83-ba8a-3b08c7039d36 response_code = 204 uri = /eip-gateways
23292024-11-19T02:17:15.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53895 req_id = 27abefe5-e091-498e-a8f0-885db6fb244b response_code = 204 uri = /vpc-routes
23302024-11-19T02:17:16.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65019
23312024-11-19T02:17:16.085ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
23322024-11-19T02:17:16.137ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
23332024-11-19T02:17:16.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128761 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65019 req_id = b9374830-cde4-4540-874b-f66b354d5765 response_code = 204 uri = /switch-ports
23342024-11-19T02:17:16.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34507
23352024-11-19T02:17:16.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34960
23362024-11-19T02:17:16.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57884
23372024-11-19T02:17:16.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65019 req_id = fc9a77bb-201e-47c2-9c88-fa63be91344a response_code = 200 uri = /network-bootstore-config
23382024-11-19T02:17:16.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46100
23392024-11-19T02:17:16.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34507 req_id = c3367ae0-9be0-456f-95be-fd827ce6cd36 response_code = 200 uri = /vpc-routes
23402024-11-19T02:17:16.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46100 req_id = 32e53ba5-f71b-4c30-9751-a3cd8f53e2bd response_code = 200 uri = /vpc-routes
23412024-11-19T02:17:16.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57884 req_id = b8cfc0ae-3713-4c4f-99ea-cda9034f69eb response_code = 200 uri = /v2p
23422024-11-19T02:17:16.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34960 req_id = 39bd95b3-d10f-4b72-ab2f-14d250b1fc1b response_code = 200 uri = /v2p
23432024-11-19T02:17:16.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49800
23442024-11-19T02:17:16.216ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
23452024-11-19T02:17:16.261ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
23462024-11-19T02:17:16.266ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
23472024-11-19T02:17:16.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 639 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46100 req_id = 9827b1f7-17f0-48fa-b3a8-edd080075ff3 response_code = 204 uri = /eip-gateways
23482024-11-19T02:17:16.268ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
23492024-11-19T02:17:16.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34507 req_id = b5afe1aa-cb8a-4294-8743-f0584e7150b8 response_code = 204 uri = /eip-gateways
23502024-11-19T02:17:16.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 878 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34507 req_id = b6f6f46e-613e-4153-9cdc-a7bd84840189 response_code = 204 uri = /vpc-routes
23512024-11-19T02:17:16.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1083 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46100 req_id = cfd2b56f-d18f-4be1-a697-e5b79b1e5c65 response_code = 204 uri = /vpc-routes
23522024-11-19T02:17:16.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49800 req_id = 32f36915-b57a-4ced-bbfd-8b1de30ee046 response_code = 204 uri = /switch-ports
23532024-11-19T02:17:16.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49800 req_id = 505de7b4-41c1-4d36-865b-d9192570342b response_code = 200 uri = /network-bootstore-config
23542024-11-19T02:17:16.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63404
23552024-11-19T02:17:16.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63404 req_id = ff2d3ad8-eb5e-4a8e-88ae-4c2f254356d4 response_code = 200 uri = /v2p
23562024-11-19T02:17:16.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33661
23572024-11-19T02:17:16.348ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
23582024-11-19T02:17:16.389ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
23592024-11-19T02:17:16.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33661 req_id = 61039fd0-997d-4762-92a9-b829ced152a0 response_code = 204 uri = /switch-ports
23602024-11-19T02:17:16.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33661 req_id = f7e0dba4-18b4-4700-9393-a4c955e155de response_code = 200 uri = /network-bootstore-config
23612024-11-19T02:17:19.985ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23622024-11-19T02:17:19.986ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23632024-11-19T02:17:19.987ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23642024-11-19T02:17:19.987ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23652024-11-19T02:17:19.988ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23662024-11-19T02:17:19.989ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23672024-11-19T02:17:19.989ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23682024-11-19T02:17:19.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23692024-11-19T02:17:19.991ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23702024-11-19T02:17:19.991ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23712024-11-19T02:17:19.992ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23722024-11-19T02:17:19.992ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23732024-11-19T02:17:19.993ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23742024-11-19T02:17:19.993ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23752024-11-19T02:17:19.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23762024-11-19T02:17:19.995ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23772024-11-19T02:17:25.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23782024-11-19T02:17:25.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23792024-11-19T02:17:29.989ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23802024-11-19T02:17:29.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23812024-11-19T02:17:29.991ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23822024-11-19T02:17:29.992ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23832024-11-19T02:17:29.992ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23842024-11-19T02:17:29.993ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23852024-11-19T02:17:29.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23862024-11-19T02:17:29.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23872024-11-19T02:17:29.995ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23882024-11-19T02:17:29.995ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23892024-11-19T02:17:29.996ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23902024-11-19T02:17:29.996ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23912024-11-19T02:17:29.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23922024-11-19T02:17:29.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23932024-11-19T02:17:29.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23942024-11-19T02:17:29.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23952024-11-19T02:17:30.342ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61843
23962024-11-19T02:17:30.343ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61843 req_id = 73fb4abb-f492-4c51-9896-11185a24fdbc response_code = 200 uri = /baseboard
23972024-11-19T02:17:35.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23982024-11-19T02:17:35.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
23992024-11-19T02:17:36.019ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24002024-11-19T02:17:36.021ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24012024-11-19T02:17:36.052ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1953, tv_nsec: 839554741 } time_to_next_cleanup = 599.99999579s
24022024-11-19T02:17:39.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24032024-11-19T02:17:39.995ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24042024-11-19T02:17:39.995ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24052024-11-19T02:17:39.996ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24062024-11-19T02:17:39.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24072024-11-19T02:17:39.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24082024-11-19T02:17:39.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24092024-11-19T02:17:39.999ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24102024-11-19T02:17:39.999ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24112024-11-19T02:17:40.000ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24122024-11-19T02:17:40.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24132024-11-19T02:17:40.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24142024-11-19T02:17:40.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24152024-11-19T02:17:40.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24162024-11-19T02:17:40.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24172024-11-19T02:17:40.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24182024-11-19T02:17:45.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24192024-11-19T02:17:45.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24202024-11-19T02:17:46.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36357
24212024-11-19T02:17:46.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36357 req_id = 2a5cec33-bd21-47bc-90c7-e21519e44ab6 response_code = 200 uri = /v2p
24222024-11-19T02:17:46.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64665
24232024-11-19T02:17:46.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64665 req_id = fb089a0e-646a-462d-936c-6af39d6dd745 response_code = 200 uri = /vpc-routes
24242024-11-19T02:17:46.117ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
24252024-11-19T02:17:46.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64665 req_id = f737fc57-8476-40a3-a5ef-1d50969c26df response_code = 204 uri = /eip-gateways
24262024-11-19T02:17:46.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64665 req_id = ac171dc1-9093-4340-bd31-32254916e8ce response_code = 204 uri = /vpc-routes
24272024-11-19T02:17:46.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53159
24282024-11-19T02:17:46.239ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
24292024-11-19T02:17:46.285ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
24302024-11-19T02:17:46.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112498 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53159 req_id = b6ab1bc8-b759-4688-ab5e-9753cd3f5edc response_code = 204 uri = /switch-ports
24312024-11-19T02:17:46.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53159 req_id = debfbd41-49f9-418d-a7b9-313e0a29091f response_code = 200 uri = /network-bootstore-config
24322024-11-19T02:17:46.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48439
24332024-11-19T02:17:46.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48439 req_id = 61a465f7-14e9-4ae1-bb0e-0593bccc6610 response_code = 200 uri = /vpc-routes
24342024-11-19T02:17:46.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32925
24352024-11-19T02:17:46.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32925 req_id = 37e3e3bd-f880-4485-aba4-425708a8da3d response_code = 200 uri = /v2p
24362024-11-19T02:17:46.396ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
24372024-11-19T02:17:46.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48439 req_id = ce2a09de-e7da-4b6b-b5a7-51a0ce08eb1a response_code = 204 uri = /eip-gateways
24382024-11-19T02:17:46.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63629
24392024-11-19T02:17:46.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63629 req_id = 34a2ff71-a606-450a-bedf-ca3be48bc7b6 response_code = 200 uri = /vpc-routes
24402024-11-19T02:17:46.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48439 req_id = 457d34d9-1458-4f12-bcc3-18c2e8a21c06 response_code = 204 uri = /vpc-routes
24412024-11-19T02:17:46.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50111
24422024-11-19T02:17:46.450ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
24432024-11-19T02:17:46.495ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
24442024-11-19T02:17:46.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50111 req_id = 66a2d4a6-9294-4ed3-b2c7-1712deed08e5 response_code = 204 uri = /switch-ports
24452024-11-19T02:17:46.553ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
24462024-11-19T02:17:46.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63629 req_id = 1ebcf43e-694a-48ce-afaa-c190223cf27d response_code = 204 uri = /eip-gateways
24472024-11-19T02:17:46.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50111 req_id = fea17482-f6ea-4fe9-b484-6c067f69dd28 response_code = 200 uri = /network-bootstore-config
24482024-11-19T02:17:46.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63629 req_id = 4da58cd9-c390-40b7-bc59-b617c15588f1 response_code = 204 uri = /vpc-routes
24492024-11-19T02:17:46.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45951
24502024-11-19T02:17:46.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45951 req_id = 8d0b2c5a-ef71-48ed-8405-54cb79ea1a1d response_code = 200 uri = /v2p
24512024-11-19T02:17:46.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34758
24522024-11-19T02:17:46.647ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
24532024-11-19T02:17:46.684ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
24542024-11-19T02:17:46.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95719 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34758 req_id = 490c9c63-66d9-4448-a204-2745ef1a2976 response_code = 204 uri = /switch-ports
24552024-11-19T02:17:46.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34758 req_id = 9bfa7dcc-9040-49b4-9996-48223c6ff8d4 response_code = 200 uri = /network-bootstore-config
24562024-11-19T02:17:49.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24572024-11-19T02:17:49.999ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24582024-11-19T02:17:49.999ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24592024-11-19T02:17:50.000ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24602024-11-19T02:17:50.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24612024-11-19T02:17:50.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24622024-11-19T02:17:50.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24632024-11-19T02:17:50.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24642024-11-19T02:17:50.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24652024-11-19T02:17:50.004ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24662024-11-19T02:17:50.004ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24672024-11-19T02:17:50.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24682024-11-19T02:17:50.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24692024-11-19T02:17:50.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24702024-11-19T02:17:50.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24712024-11-19T02:17:50.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24722024-11-19T02:17:51.203ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24732024-11-19T02:17:55.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24742024-11-19T02:17:55.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24752024-11-19T02:18:00.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24762024-11-19T02:18:00.003ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24772024-11-19T02:18:00.004ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24782024-11-19T02:18:00.004ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24792024-11-19T02:18:00.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24802024-11-19T02:18:00.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24812024-11-19T02:18:00.006ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24822024-11-19T02:18:00.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24832024-11-19T02:18:00.008ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24842024-11-19T02:18:00.008ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24852024-11-19T02:18:00.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24862024-11-19T02:18:00.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24872024-11-19T02:18:00.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24882024-11-19T02:18:00.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24892024-11-19T02:18:00.011ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24902024-11-19T02:18:00.011ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24912024-11-19T02:18:00.377ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36216
24922024-11-19T02:18:00.377ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36216 req_id = 498a14f2-6621-4ad4-bd0d-a06a86057bc6 response_code = 200 uri = /baseboard
24932024-11-19T02:18:05.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24942024-11-19T02:18:05.033ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24952024-11-19T02:18:10.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24962024-11-19T02:18:10.007ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24972024-11-19T02:18:10.008ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24982024-11-19T02:18:10.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
24992024-11-19T02:18:10.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25002024-11-19T02:18:10.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25012024-11-19T02:18:10.011ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25022024-11-19T02:18:10.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25032024-11-19T02:18:10.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25042024-11-19T02:18:10.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25052024-11-19T02:18:10.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25062024-11-19T02:18:10.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25072024-11-19T02:18:10.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25082024-11-19T02:18:10.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25092024-11-19T02:18:10.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25102024-11-19T02:18:10.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25112024-11-19T02:18:15.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25122024-11-19T02:18:15.036ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25132024-11-19T02:18:15.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60613
25142024-11-19T02:18:15.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60613 req_id = 6115db9c-d4ad-401f-8670-922fe1bbe896 response_code = 200 uri = /v2p
25152024-11-19T02:18:16.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62438
25162024-11-19T02:18:16.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62438 req_id = 9618c967-85b2-4529-ab39-75387e3f97af response_code = 200 uri = /vpc-routes
25172024-11-19T02:18:16.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
25182024-11-19T02:18:16.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62438 req_id = ff1c702e-33cb-4eab-bcfc-2ff15aa7b3ca response_code = 204 uri = /eip-gateways
25192024-11-19T02:18:16.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62438 req_id = 761dd9b3-ea7f-4cf8-ae14-1ab1a32129d6 response_code = 204 uri = /vpc-routes
25202024-11-19T02:18:16.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64400
25212024-11-19T02:18:16.109ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
25222024-11-19T02:18:16.161ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
25232024-11-19T02:18:16.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121039 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64400 req_id = d0b24a45-09f1-4d8a-a81c-4e11ec5b1da7 response_code = 204 uri = /switch-ports
25242024-11-19T02:18:16.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57483
25252024-11-19T02:18:16.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49259
25262024-11-19T02:18:16.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57483 req_id = e4eb79e6-28a0-4d61-9756-0fb05ab985a8 response_code = 200 uri = /vpc-routes
25272024-11-19T02:18:16.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49259 req_id = f53f0545-2a79-4ea9-bd39-efe00e9b6f46 response_code = 200 uri = /v2p
25282024-11-19T02:18:16.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64400 req_id = 59547fa6-cee0-451d-b266-0ac04a16a43b response_code = 200 uri = /network-bootstore-config
25292024-11-19T02:18:16.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45010
25302024-11-19T02:18:16.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45010 req_id = e6eb637e-edcf-434e-b55f-aba67450cd45 response_code = 200 uri = /vpc-routes
25312024-11-19T02:18:16.271ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
25322024-11-19T02:18:16.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57483 req_id = b0355756-deed-4610-9770-8247d56db574 response_code = 204 uri = /eip-gateways
25332024-11-19T02:18:16.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57483 req_id = 224cb148-d1ab-41fa-86e4-65c5e64b963b response_code = 204 uri = /vpc-routes
25342024-11-19T02:18:16.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44592
25352024-11-19T02:18:16.297ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
25362024-11-19T02:18:16.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
25372024-11-19T02:18:16.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103799 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44592 req_id = 82cdb30e-e9db-42f6-bd9a-66f1ea486236 response_code = 204 uri = /switch-ports
25382024-11-19T02:18:16.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53524
25392024-11-19T02:18:16.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35160
25402024-11-19T02:18:16.402ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
25412024-11-19T02:18:16.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45010 req_id = d22fae84-9721-4ccb-a157-18c4216b0599 response_code = 204 uri = /eip-gateways
25422024-11-19T02:18:16.402ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
25432024-11-19T02:18:16.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44592 req_id = 031255e7-03ad-4bf8-a99d-64f9cc84817c response_code = 200 uri = /network-bootstore-config
25442024-11-19T02:18:16.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35160 req_id = 0c9d18f5-95ec-49b3-8094-0eec1000d2c2 response_code = 200 uri = /v2p
25452024-11-19T02:18:16.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45010 req_id = 69054791-8100-4570-8a99-b75466708ffa response_code = 204 uri = /vpc-routes
25462024-11-19T02:18:16.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
25472024-11-19T02:18:16.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53524 req_id = 857c4eb4-052c-4135-95a7-fb3d1920bf38 response_code = 204 uri = /switch-ports
25482024-11-19T02:18:16.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53524 req_id = 19668fdc-2710-4b42-b4a0-23582e933711 response_code = 200 uri = /network-bootstore-config
25492024-11-19T02:18:20.011ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25502024-11-19T02:18:20.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25512024-11-19T02:18:20.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25522024-11-19T02:18:20.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25532024-11-19T02:18:20.014ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25542024-11-19T02:18:20.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25552024-11-19T02:18:20.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25562024-11-19T02:18:20.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25572024-11-19T02:18:20.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25582024-11-19T02:18:20.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25592024-11-19T02:18:20.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25602024-11-19T02:18:20.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25612024-11-19T02:18:20.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25622024-11-19T02:18:20.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25632024-11-19T02:18:20.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25642024-11-19T02:18:20.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25652024-11-19T02:18:25.039ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25662024-11-19T02:18:25.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25672024-11-19T02:18:30.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25682024-11-19T02:18:30.017ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25692024-11-19T02:18:30.018ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25702024-11-19T02:18:30.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25712024-11-19T02:18:30.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25722024-11-19T02:18:30.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25732024-11-19T02:18:30.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25742024-11-19T02:18:30.022ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25752024-11-19T02:18:30.022ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25762024-11-19T02:18:30.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25772024-11-19T02:18:30.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25782024-11-19T02:18:30.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25792024-11-19T02:18:30.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25802024-11-19T02:18:30.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25812024-11-19T02:18:30.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25822024-11-19T02:18:30.026ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25832024-11-19T02:18:30.409ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36394
25842024-11-19T02:18:30.409ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36394 req_id = 56e11e36-6899-4c96-8d66-676c81b6dcbb response_code = 200 uri = /baseboard
25852024-11-19T02:18:35.044ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25862024-11-19T02:18:35.044ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25872024-11-19T02:18:40.022ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25882024-11-19T02:18:40.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25892024-11-19T02:18:40.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25902024-11-19T02:18:40.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25912024-11-19T02:18:40.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25922024-11-19T02:18:40.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25932024-11-19T02:18:40.026ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25942024-11-19T02:18:40.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25952024-11-19T02:18:40.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25962024-11-19T02:18:40.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25972024-11-19T02:18:40.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25982024-11-19T02:18:40.029ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
25992024-11-19T02:18:40.029ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26002024-11-19T02:18:40.030ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26012024-11-19T02:18:40.030ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26022024-11-19T02:18:40.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26032024-11-19T02:18:45.047ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26042024-11-19T02:18:45.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26052024-11-19T02:18:46.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51031
26062024-11-19T02:18:46.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51031 req_id = 65395fd9-d188-42de-b282-b35fe0ba2884 response_code = 200 uri = /vpc-routes
26072024-11-19T02:18:46.073ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
26082024-11-19T02:18:46.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51031 req_id = 3522cbce-673d-450b-ab25-5e345d6cdbe1 response_code = 204 uri = /eip-gateways
26092024-11-19T02:18:46.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45645
26102024-11-19T02:18:46.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45645 req_id = a4481453-1060-4c3f-9fc5-8238b8c1c34c response_code = 200 uri = /vpc-routes
26112024-11-19T02:18:46.198ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
26122024-11-19T02:18:46.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45645 req_id = ed0506f9-de18-4ac0-a55e-c4e409f75ba2 response_code = 204 uri = /eip-gateways
26132024-11-19T02:18:46.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52711
26142024-11-19T02:18:46.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52711 req_id = 64c55f6d-97af-4d35-9f50-01d68d06d878 response_code = 200 uri = /v2p
26152024-11-19T02:18:46.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51031 req_id = afe2c789-5d55-4e2a-b802-a9c87133aeb1 response_code = 204 uri = /vpc-routes
26162024-11-19T02:18:46.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35529
26172024-11-19T02:18:46.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35529 req_id = 5de5f792-10e0-4c37-a0ef-55935e709e02 response_code = 200 uri = /v2p
26182024-11-19T02:18:46.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45645 req_id = 9162d1e0-09cf-4549-b98f-b3623cc4e076 response_code = 204 uri = /vpc-routes
26192024-11-19T02:18:46.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62498
26202024-11-19T02:18:46.313ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
26212024-11-19T02:18:46.371ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
26222024-11-19T02:18:46.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152032 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62498 req_id = 4cd4a12c-44e3-43a9-b93f-13183d6a409b response_code = 204 uri = /switch-ports
26232024-11-19T02:18:46.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65390
26242024-11-19T02:18:46.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60787
26252024-11-19T02:18:46.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62498 req_id = 1773b688-593d-4129-9ed1-125fc000bdc5 response_code = 200 uri = /network-bootstore-config
26262024-11-19T02:18:46.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60787 req_id = bc7ddb19-dc52-4207-b0ff-63f7b631085e response_code = 200 uri = /vpc-routes
26272024-11-19T02:18:46.466ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
26282024-11-19T02:18:46.522ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
26292024-11-19T02:18:46.537ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
26302024-11-19T02:18:46.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60787 req_id = 0a1e258a-0735-473b-b6cc-6d1d9d4ca7b9 response_code = 204 uri = /eip-gateways
26312024-11-19T02:18:46.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60787 req_id = 14536347-b7af-4156-beb2-b1a445734650 response_code = 204 uri = /vpc-routes
26322024-11-19T02:18:46.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62586
26332024-11-19T02:18:46.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65390 req_id = c494e484-9380-4dc6-80e4-32fe133793aa response_code = 204 uri = /switch-ports
26342024-11-19T02:18:46.607ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
26352024-11-19T02:18:46.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 960 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65390 req_id = a2069567-ab7e-48c0-9bfd-5f8f5ef76c2e response_code = 200 uri = /network-bootstore-config
26362024-11-19T02:18:46.659ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
26372024-11-19T02:18:46.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38597
26382024-11-19T02:18:46.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38597 req_id = 5beb85dc-3579-47cf-a1ae-30145c84022d response_code = 200 uri = /v2p
26392024-11-19T02:18:46.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62586 req_id = 51fb7ef7-3050-4302-b340-d8d432ad8039 response_code = 204 uri = /switch-ports
26402024-11-19T02:18:46.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62586 req_id = 3bfce9e7-7350-403c-888c-6ae966283999 response_code = 200 uri = /network-bootstore-config
26412024-11-19T02:18:50.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26422024-11-19T02:18:50.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26432024-11-19T02:18:50.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26442024-11-19T02:18:50.029ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26452024-11-19T02:18:50.029ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26462024-11-19T02:18:50.030ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26472024-11-19T02:18:50.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26482024-11-19T02:18:50.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26492024-11-19T02:18:50.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26502024-11-19T02:18:50.033ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26512024-11-19T02:18:50.033ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26522024-11-19T02:18:50.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26532024-11-19T02:18:50.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26542024-11-19T02:18:50.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26552024-11-19T02:18:50.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26562024-11-19T02:18:50.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26572024-11-19T02:18:55.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26582024-11-19T02:18:55.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26592024-11-19T02:19:00.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26602024-11-19T02:19:00.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26612024-11-19T02:19:00.032ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26622024-11-19T02:19:00.033ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26632024-11-19T02:19:00.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26642024-11-19T02:19:00.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26652024-11-19T02:19:00.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26662024-11-19T02:19:00.036ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26672024-11-19T02:19:00.036ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26682024-11-19T02:19:00.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26692024-11-19T02:19:00.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26702024-11-19T02:19:00.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26712024-11-19T02:19:00.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26722024-11-19T02:19:00.039ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26732024-11-19T02:19:00.039ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26742024-11-19T02:19:00.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26752024-11-19T02:19:00.443ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59802
26762024-11-19T02:19:00.444ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59802 req_id = 46623b71-45ca-4fef-bce1-527d5d30560d response_code = 200 uri = /baseboard
26772024-11-19T02:19:05.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26782024-11-19T02:19:05.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26792024-11-19T02:19:10.036ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26802024-11-19T02:19:10.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26812024-11-19T02:19:10.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26822024-11-19T02:19:10.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26832024-11-19T02:19:10.039ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26842024-11-19T02:19:10.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26852024-11-19T02:19:10.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26862024-11-19T02:19:10.041ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26872024-11-19T02:19:10.042ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26882024-11-19T02:19:10.042ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26892024-11-19T02:19:10.043ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26902024-11-19T02:19:10.043ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26912024-11-19T02:19:10.044ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26922024-11-19T02:19:10.044ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26932024-11-19T02:19:10.045ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26942024-11-19T02:19:10.045ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26952024-11-19T02:19:15.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26962024-11-19T02:19:15.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
26972024-11-19T02:19:15.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34569
26982024-11-19T02:19:15.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34569 req_id = 34ee7846-6813-4101-bf95-a2e46a579104 response_code = 200 uri = /vpc-routes
26992024-11-19T02:19:15.952ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
27002024-11-19T02:19:15.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34569 req_id = fb78e6a2-e2ca-49ed-b677-d198771fef0b response_code = 204 uri = /eip-gateways
27012024-11-19T02:19:15.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34569 req_id = b0d2e6f0-a307-4005-abf4-6c729eca3688 response_code = 204 uri = /vpc-routes
27022024-11-19T02:19:16.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34636
27032024-11-19T02:19:16.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34636 req_id = e987fc04-a42f-440b-b77e-d872b406f3a0 response_code = 200 uri = /v2p
27042024-11-19T02:19:16.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60547
27052024-11-19T02:19:16.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60547 req_id = 20e1a6b4-4068-4d23-9bdb-0fc87ca98fab response_code = 200 uri = /vpc-routes
27062024-11-19T02:19:16.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47107
27072024-11-19T02:19:16.132ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
27082024-11-19T02:19:16.179ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
27092024-11-19T02:19:16.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117921 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47107 req_id = 463110da-b0ed-434f-b67b-da800702002d response_code = 204 uri = /switch-ports
27102024-11-19T02:19:16.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39421
27112024-11-19T02:19:16.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42204
27122024-11-19T02:19:16.251ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
27132024-11-19T02:19:16.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60547 req_id = 110ba077-40cf-4034-b203-2dfbc1ee0ff4 response_code = 204 uri = /eip-gateways
27142024-11-19T02:19:16.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42204 req_id = 534e3381-37a8-4df2-bb3e-a6b6cca1fd0e response_code = 200 uri = /vpc-routes
27152024-11-19T02:19:16.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47107 req_id = 89c17481-4277-4b70-a50b-c90d95143915 response_code = 200 uri = /network-bootstore-config
27162024-11-19T02:19:16.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39421 req_id = 63ebdc77-ee70-4027-9025-0d01864a0d69 response_code = 200 uri = /v2p
27172024-11-19T02:19:16.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60547 req_id = 87c4f148-1993-469c-bc27-f08e0fc2b37f response_code = 204 uri = /vpc-routes
27182024-11-19T02:19:16.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59137
27192024-11-19T02:19:16.289ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
27202024-11-19T02:19:16.332ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
27212024-11-19T02:19:16.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106541 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59137 req_id = ba1ebe22-aa31-4347-b4d4-149d67ffaba8 response_code = 204 uri = /switch-ports
27222024-11-19T02:19:16.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55344
27232024-11-19T02:19:16.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52726
27242024-11-19T02:19:16.396ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
27252024-11-19T02:19:16.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42204 req_id = c95ba03a-0088-4f4f-8363-88be256642ea response_code = 204 uri = /eip-gateways
27262024-11-19T02:19:16.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59137 req_id = 3e1d54f9-e419-4a9c-b767-af58e303ea24 response_code = 200 uri = /network-bootstore-config
27272024-11-19T02:19:16.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
27282024-11-19T02:19:16.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4529 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55344 req_id = 17391dbb-2ffe-4d6b-a722-7452c2867f0d response_code = 200 uri = /v2p
27292024-11-19T02:19:16.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42204 req_id = 3ef9df89-5809-47b0-bf91-2d5f32fec82d response_code = 204 uri = /vpc-routes
27302024-11-19T02:19:16.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
27312024-11-19T02:19:16.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100139 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52726 req_id = b7be4885-7b49-48c3-89b9-5d4bd14c581a response_code = 204 uri = /switch-ports
27322024-11-19T02:19:16.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52726 req_id = 6fdb4e8d-2453-4ca4-849e-3fdb642f9270 response_code = 200 uri = /network-bootstore-config
27332024-11-19T02:19:20.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27342024-11-19T02:19:20.047ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27352024-11-19T02:19:20.048ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27362024-11-19T02:19:20.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27372024-11-19T02:19:20.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27382024-11-19T02:19:20.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27392024-11-19T02:19:20.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27402024-11-19T02:19:20.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27412024-11-19T02:19:20.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27422024-11-19T02:19:20.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27432024-11-19T02:19:20.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27442024-11-19T02:19:20.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27452024-11-19T02:19:20.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27462024-11-19T02:19:20.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27472024-11-19T02:19:20.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27482024-11-19T02:19:20.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27492024-11-19T02:19:25.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27502024-11-19T02:19:25.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27512024-11-19T02:19:30.045ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27522024-11-19T02:19:30.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27532024-11-19T02:19:30.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27542024-11-19T02:19:30.051ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27552024-11-19T02:19:30.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27562024-11-19T02:19:30.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27572024-11-19T02:19:30.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27582024-11-19T02:19:30.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27592024-11-19T02:19:30.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27602024-11-19T02:19:30.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27612024-11-19T02:19:30.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27622024-11-19T02:19:30.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27632024-11-19T02:19:30.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27642024-11-19T02:19:30.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27652024-11-19T02:19:30.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27662024-11-19T02:19:30.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27672024-11-19T02:19:30.478ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34720
27682024-11-19T02:19:30.478ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34720 req_id = 049a1386-b3b1-45e6-a5d8-35ec7b112bc6 response_code = 200 uri = /baseboard
27692024-11-19T02:19:35.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27702024-11-19T02:19:35.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27712024-11-19T02:19:40.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27722024-11-19T02:19:40.052ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27732024-11-19T02:19:40.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27742024-11-19T02:19:40.053ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27752024-11-19T02:19:40.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27762024-11-19T02:19:40.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27772024-11-19T02:19:40.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27782024-11-19T02:19:40.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27792024-11-19T02:19:40.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27802024-11-19T02:19:40.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27812024-11-19T02:19:40.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27822024-11-19T02:19:40.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27832024-11-19T02:19:40.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27842024-11-19T02:19:40.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27852024-11-19T02:19:40.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27862024-11-19T02:19:40.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27872024-11-19T02:19:45.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27882024-11-19T02:19:45.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
27892024-11-19T02:19:46.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48842
27902024-11-19T02:19:46.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48842 req_id = fde2e76a-fb3c-4ed4-8b06-5c4dac79375c response_code = 200 uri = /v2p
27912024-11-19T02:19:46.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59057
27922024-11-19T02:19:46.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59057 req_id = 80596b52-6034-4d2c-a5c2-ebd65cfa6612 response_code = 200 uri = /vpc-routes
27932024-11-19T02:19:46.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34653
27942024-11-19T02:19:46.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34653 req_id = 84dcef38-3ba0-4985-9859-0795ae7515ee response_code = 200 uri = /vpc-routes
27952024-11-19T02:19:46.249ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
27962024-11-19T02:19:46.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59057 req_id = 835db785-3ab2-4143-928a-99a00ed57dcb response_code = 204 uri = /eip-gateways
27972024-11-19T02:19:46.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59057 req_id = f3c4f74e-97ca-4984-9fd2-ca3af06d9097 response_code = 204 uri = /vpc-routes
27982024-11-19T02:19:46.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
27992024-11-19T02:19:46.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34653 req_id = 2f2218c3-fdaa-4a70-b6cc-73ddc7b31e41 response_code = 204 uri = /eip-gateways
28002024-11-19T02:19:46.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34653 req_id = 81b69b5c-56d3-4f9c-914c-dde8a06ec3ba response_code = 204 uri = /vpc-routes
28012024-11-19T02:19:46.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56909
28022024-11-19T02:19:46.319ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28032024-11-19T02:19:46.319ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28042024-11-19T02:19:46.319ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json file = common/src/ledger.rs:178
28052024-11-19T02:19:46.320ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json file = common/src/ledger.rs:178
28062024-11-19T02:19:46.338ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28072024-11-19T02:19:46.338ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a
28082024-11-19T02:19:46.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51408
28092024-11-19T02:19:46.346ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
28102024-11-19T02:19:46.380ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28112024-11-19T02:19:46.380ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730
28122024-11-19T02:19:46.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46400
28132024-11-19T02:19:46.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46400 req_id = c291b326-3bad-424a-9c9b-2d02ecaf4aed response_code = 200 uri = /vpc-routes
28142024-11-19T02:19:46.405ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
28152024-11-19T02:19:46.415ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28162024-11-19T02:19:46.415ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f
28172024-11-19T02:19:46.443ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28182024-11-19T02:19:46.443ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2354be7c-bc71-4b15-9f57-06b09b66253b
28192024-11-19T02:19:46.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54950
28202024-11-19T02:19:46.466ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28212024-11-19T02:19:46.466ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28222024-11-19T02:19:46.466ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28232024-11-19T02:19:46.467ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28242024-11-19T02:19:46.467ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28252024-11-19T02:19:46.467ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28262024-11-19T02:19:46.467ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28272024-11-19T02:19:46.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5503 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54950 req_id = 78456e7d-195b-4437-9ddb-5784c7a8f5dd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28282024-11-19T02:19:46.469ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28292024-11-19T02:19:46.469ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882
28302024-11-19T02:19:46.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130993 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51408 req_id = 831ad04b-f86c-4597-a3b7-88987c744e11 response_code = 204 uri = /switch-ports
28312024-11-19T02:19:46.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51408 req_id = 298af122-ec00-4df9-9895-fbbf368bb204 response_code = 200 uri = /network-bootstore-config
28322024-11-19T02:19:46.496ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28332024-11-19T02:19:46.496ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56
28342024-11-19T02:19:46.519ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28352024-11-19T02:19:46.519ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e7d17670-49d1-4296-b44f-e53bcd272b84
28362024-11-19T02:19:46.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35327
28372024-11-19T02:19:46.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35327 req_id = edfe8df2-eff3-47e2-bc5b-a7f64200744c response_code = 200 uri = /v2p
28382024-11-19T02:19:46.542ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28392024-11-19T02:19:46.542ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490
28402024-11-19T02:19:46.567ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28412024-11-19T02:19:46.567ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8d92ce26-c543-4771-ad32-a160a4f547aa
28422024-11-19T02:19:46.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56909 req_id = 3568b9e2-50ec-47fb-8696-15b720a92021 response_code = 200 uri = /inventory
28432024-11-19T02:19:46.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43293
28442024-11-19T02:19:46.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43293 req_id = 91c246cc-8a4e-4085-91de-cc6c33c4182e response_code = 200 uri = /v2p
28452024-11-19T02:19:46.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50642
28462024-11-19T02:19:46.605ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28472024-11-19T02:19:46.605ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28482024-11-19T02:19:46.605ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json file = common/src/ledger.rs:178
28492024-11-19T02:19:46.608ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json file = common/src/ledger.rs:178
28502024-11-19T02:19:46.624ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28512024-11-19T02:19:46.624ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a
28522024-11-19T02:19:46.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40205
28532024-11-19T02:19:46.631ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
28542024-11-19T02:19:46.660ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28552024-11-19T02:19:46.660ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730
28562024-11-19T02:19:46.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50393
28572024-11-19T02:19:46.685ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
28582024-11-19T02:19:46.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55438
28592024-11-19T02:19:46.698ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28602024-11-19T02:19:46.698ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f
28612024-11-19T02:19:46.705ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
28622024-11-19T02:19:46.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20023 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46400 req_id = 96c8d7df-bb6a-4719-88c5-24d81cd6a2c7 response_code = 204 uri = /eip-gateways
28632024-11-19T02:19:46.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45499
28642024-11-19T02:19:46.706ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28652024-11-19T02:19:46.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28662024-11-19T02:19:46.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28672024-11-19T02:19:46.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28682024-11-19T02:19:46.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28692024-11-19T02:19:46.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28702024-11-19T02:19:46.706ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28712024-11-19T02:19:46.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 491 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45499 req_id = 27fb150a-6a9a-4654-b591-b4e89e77d92e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28722024-11-19T02:19:46.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 410 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46400 req_id = f820c2d9-b53f-4ba1-ac8f-d12e63bf9f2f response_code = 204 uri = /vpc-routes
28732024-11-19T02:19:46.718ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28742024-11-19T02:19:46.718ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28752024-11-19T02:19:46.718ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6761462c-c735-467b-a33c-59444a1ef020/config/omicron-zones.json file = common/src/ledger.rs:178
28762024-11-19T02:19:46.724ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/config/omicron-zones.json file = common/src/ledger.rs:178
28772024-11-19T02:19:46.736ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28782024-11-19T02:19:46.736ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2354be7c-bc71-4b15-9f57-06b09b66253b
28792024-11-19T02:19:46.758ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57f276f8-1c12-4401-9f3d-21c3bc7af71a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28802024-11-19T02:19:46.758ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_57f276f8-1c12-4401-9f3d-21c3bc7af71a
28812024-11-19T02:19:46.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57361
28822024-11-19T02:19:46.771ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1a01f5db-28b0-4d53-93f3-b21792e75a0f, kind: Service { id: 91bdcbd0-987b-49c4-8200-fc3e8f332b6b }, name: Name("external-dns-91bdcbd0-987b-49c4-8200-fc3e8f332b6b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 175])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 44aaf11d-41cc-4bfe-af84-bade0c866c36, kind: Service { id: 27d1a6ca-1b76-4956-aefa-e234c7d60cd0 }, name: Name("external-dns-27d1a6ca-1b76-4956-aefa-e234c7d60cd0"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 29b1632f-5910-4287-a228-0a2f072906c2, kind: Service { id: f02be878-8b16-4056-a261-089d083d36be }, name: Name("nexus-f02be878-8b16-4056-a261-089d083d36be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ace3f45b-d569-4037-91af-4f9560e3857e, kind: Service { id: 9f0b435f-0000-451e-9dbc-dcec71543c30 }, name: Name("nexus-9f0b435f-0000-451e-9dbc-dcec71543c30"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 230])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f794593b-f8ae-411e-9836-93b29d4ba7a6, kind: Service { id: d90c9eb7-7c7e-4675-94ca-7779e9afc6c6 }, name: Name("nexus-d90c9eb7-7c7e-4675-94ca-7779e9afc6c6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28832024-11-19T02:19:46.771ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28842024-11-19T02:19:46.771ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28852024-11-19T02:19:46.771ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28862024-11-19T02:19:46.771ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28872024-11-19T02:19:46.771ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28882024-11-19T02:19:46.771ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28892024-11-19T02:19:46.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 654 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57361 req_id = 7f55d157-8ac8-4f53-a124-5b8a8af82f38 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28902024-11-19T02:19:46.782ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
28912024-11-19T02:19:46.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151841 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40205 req_id = 839296cc-27a0-4412-b96b-4fe5b10130fe response_code = 204 uri = /switch-ports
28922024-11-19T02:19:46.794ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0a1dc6a4-13f3-4f69-b67a-be04eaf23730 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28932024-11-19T02:19:46.795ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_0a1dc6a4-13f3-4f69-b67a-be04eaf23730
28942024-11-19T02:19:46.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7046 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40205 req_id = f458637b-2fe8-48cb-8bc9-14f17c5831f4 response_code = 200 uri = /network-bootstore-config
28952024-11-19T02:19:46.813ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28962024-11-19T02:19:46.813ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882
28972024-11-19T02:19:46.837ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
28982024-11-19T02:19:46.843ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 14855f12-b0aa-435e-9f15-f1b320ed2e6f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28992024-11-19T02:19:46.844ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_14855f12-b0aa-435e-9f15-f1b320ed2e6f
29002024-11-19T02:19:46.860ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29012024-11-19T02:19:46.860ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56
29022024-11-19T02:19:46.889ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29032024-11-19T02:19:46.890ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e7d17670-49d1-4296-b44f-e53bcd272b84
29042024-11-19T02:19:46.905ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2354be7c-bc71-4b15-9f57-06b09b66253b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29052024-11-19T02:19:46.905ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2354be7c-bc71-4b15-9f57-06b09b66253b
29062024-11-19T02:19:46.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208226 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55438 req_id = cb04a0b5-96b9-406c-b197-d14ea626ecaa response_code = 204 uri = /switch-ports
29072024-11-19T02:19:46.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55438 req_id = 9239a29d-114d-465b-9f7c-2ba376e3f9b6 response_code = 200 uri = /network-bootstore-config
29082024-11-19T02:19:46.923ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29092024-11-19T02:19:46.924ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490
29102024-11-19T02:19:46.939ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 84fcecb7-ccc4-4225-bbb8-f67d31dc3882 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29112024-11-19T02:19:46.939ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_84fcecb7-ccc4-4225-bbb8-f67d31dc3882
29122024-11-19T02:19:46.963ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4a7f23d4-1da0-48ed-bb3a-c91a47472a56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29132024-11-19T02:19:46.963ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_4a7f23d4-1da0-48ed-bb3a-c91a47472a56
29142024-11-19T02:19:46.976ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29152024-11-19T02:19:46.976ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8d92ce26-c543-4771-ad32-a160a4f547aa
29162024-11-19T02:19:46.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 384367 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50642 req_id = aac97647-ea1e-4e38-9e22-7d0a87bb6660 response_code = 200 uri = /inventory
29172024-11-19T02:19:46.992ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e7d17670-49d1-4296-b44f-e53bcd272b84 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29182024-11-19T02:19:46.992ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e7d17670-49d1-4296-b44f-e53bcd272b84
29192024-11-19T02:19:47.014ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e3c761d-8e5f-4960-8456-8b1dbd3fd490 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29202024-11-19T02:19:47.014ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_2e3c761d-8e5f-4960-8456-8b1dbd3fd490
29212024-11-19T02:19:47.037ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8d92ce26-c543-4771-ad32-a160a4f547aa (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29222024-11-19T02:19:47.037ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_8d92ce26-c543-4771-ad32-a160a4f547aa
29232024-11-19T02:19:47.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343986 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50393 req_id = cb2c7a6a-e58f-493a-bc4a-6b3102e216a4 response_code = 200 uri = /inventory
29242024-11-19T02:19:50.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29252024-11-19T02:19:50.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29262024-11-19T02:19:50.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29272024-11-19T02:19:50.056ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29282024-11-19T02:19:50.057ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29292024-11-19T02:19:50.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29302024-11-19T02:19:50.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29312024-11-19T02:19:50.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29322024-11-19T02:19:50.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29332024-11-19T02:19:50.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29342024-11-19T02:19:50.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29352024-11-19T02:19:50.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29362024-11-19T02:19:50.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29372024-11-19T02:19:50.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29382024-11-19T02:19:50.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29392024-11-19T02:19:50.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29402024-11-19T02:19:55.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29412024-11-19T02:19:55.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29422024-11-19T02:20:00.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29432024-11-19T02:20:00.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29442024-11-19T02:20:00.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29452024-11-19T02:20:00.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29462024-11-19T02:20:00.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29472024-11-19T02:20:00.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29482024-11-19T02:20:00.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29492024-11-19T02:20:00.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29502024-11-19T02:20:00.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29512024-11-19T02:20:00.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29522024-11-19T02:20:00.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29532024-11-19T02:20:00.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29542024-11-19T02:20:00.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29552024-11-19T02:20:00.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29562024-11-19T02:20:00.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29572024-11-19T02:20:00.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29582024-11-19T02:20:00.510ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36938
29592024-11-19T02:20:00.510ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36938 req_id = 262d0f71-3fe8-4bbd-830d-9b7d95acc957 response_code = 200 uri = /baseboard
29602024-11-19T02:20:05.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29612024-11-19T02:20:05.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29622024-11-19T02:20:10.063ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29632024-11-19T02:20:10.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29642024-11-19T02:20:10.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29652024-11-19T02:20:10.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29662024-11-19T02:20:10.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29672024-11-19T02:20:10.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29682024-11-19T02:20:10.067ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29692024-11-19T02:20:10.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29702024-11-19T02:20:10.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29712024-11-19T02:20:10.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29722024-11-19T02:20:10.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29732024-11-19T02:20:10.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29742024-11-19T02:20:10.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29752024-11-19T02:20:10.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29762024-11-19T02:20:10.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29772024-11-19T02:20:10.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29782024-11-19T02:20:15.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29792024-11-19T02:20:15.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
29802024-11-19T02:20:15.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34036
29812024-11-19T02:20:15.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34036 req_id = f48eea88-379c-4941-b294-58d88fae2be2 response_code = 200 uri = /vpc-routes
29822024-11-19T02:20:15.915ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
29832024-11-19T02:20:15.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34036 req_id = 368492f6-e989-4959-914d-33209b4f8198 response_code = 204 uri = /eip-gateways
29842024-11-19T02:20:15.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34036 req_id = 8c24ee9d-5d99-44f1-8368-e5a077f1cb77 response_code = 204 uri = /vpc-routes
29852024-11-19T02:20:16.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53582
29862024-11-19T02:20:16.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53582 req_id = 7282341c-1d90-488f-8b59-e69d1587bd3d response_code = 200 uri = /v2p
29872024-11-19T02:20:16.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53710
29882024-11-19T02:20:16.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53710 req_id = ae1ab221-c268-4145-ae0d-7d02de29e3af response_code = 200 uri = /vpc-routes
29892024-11-19T02:20:16.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55245
29902024-11-19T02:20:16.124ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
29912024-11-19T02:20:16.175ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
29922024-11-19T02:20:16.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119606 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55245 req_id = c99ac860-c754-4e21-bc97-6f3f6fb86f54 response_code = 204 uri = /switch-ports
29932024-11-19T02:20:16.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51021
29942024-11-19T02:20:16.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49031
29952024-11-19T02:20:16.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42920
29962024-11-19T02:20:16.244ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
29972024-11-19T02:20:16.244ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
29982024-11-19T02:20:16.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55245 req_id = 68e29c42-ce5e-4caa-b229-654112cc0eaf response_code = 200 uri = /network-bootstore-config
29992024-11-19T02:20:16.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53710 req_id = b34eeb20-d572-4c6b-970e-cc2d65ec8fff response_code = 204 uri = /eip-gateways
30002024-11-19T02:20:16.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4005 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42920 req_id = b62bcdda-703e-4bfd-a489-6e72e326f026 response_code = 200 uri = /vpc-routes
30012024-11-19T02:20:16.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4088 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49031 req_id = f504906f-9e98-45e7-97fc-41f29ab1c820 response_code = 200 uri = /v2p
30022024-11-19T02:20:16.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53710 req_id = b1d78d18-324f-41e7-9d17-8f197ad74867 response_code = 204 uri = /vpc-routes
30032024-11-19T02:20:16.279ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
30042024-11-19T02:20:16.290ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
30052024-11-19T02:20:16.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42920 req_id = f4be7349-78bd-430d-9dbe-0cf0ae2f2b15 response_code = 204 uri = /eip-gateways
30062024-11-19T02:20:16.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51021 req_id = cec3d9b5-683a-4279-bd89-17f358053aab response_code = 204 uri = /switch-ports
30072024-11-19T02:20:16.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51021 req_id = 43a91950-d521-4ec4-b20c-92941f6eec66 response_code = 200 uri = /network-bootstore-config
30082024-11-19T02:20:16.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45181
30092024-11-19T02:20:16.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45181 req_id = f5387af8-5b39-4dc8-9ccc-c538e207bb49 response_code = 200 uri = /v2p
30102024-11-19T02:20:16.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42920 req_id = 48cdf4cc-bbc8-4cd9-b78d-207bd6f57004 response_code = 204 uri = /vpc-routes
30112024-11-19T02:20:16.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39851
30122024-11-19T02:20:16.428ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
30132024-11-19T02:20:16.472ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
30142024-11-19T02:20:16.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39851 req_id = b9bcb5e7-3ff6-457c-9d1f-f490946eddb3 response_code = 204 uri = /switch-ports
30152024-11-19T02:20:16.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39851 req_id = 33dfc742-6c99-498f-aa65-b1327dd2c9bc response_code = 200 uri = /network-bootstore-config
30162024-11-19T02:20:20.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30172024-11-19T02:20:20.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30182024-11-19T02:20:20.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30192024-11-19T02:20:20.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30202024-11-19T02:20:20.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30212024-11-19T02:20:20.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30222024-11-19T02:20:20.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30232024-11-19T02:20:20.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30242024-11-19T02:20:20.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30252024-11-19T02:20:20.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30262024-11-19T02:20:20.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30272024-11-19T02:20:20.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30282024-11-19T02:20:20.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30292024-11-19T02:20:20.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30302024-11-19T02:20:20.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30312024-11-19T02:20:20.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30322024-11-19T02:20:25.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30332024-11-19T02:20:25.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30342024-11-19T02:20:30.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30352024-11-19T02:20:30.072ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30362024-11-19T02:20:30.073ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30372024-11-19T02:20:30.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30382024-11-19T02:20:30.074ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30392024-11-19T02:20:30.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30402024-11-19T02:20:30.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30412024-11-19T02:20:30.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30422024-11-19T02:20:30.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30432024-11-19T02:20:30.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30442024-11-19T02:20:30.078ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30452024-11-19T02:20:30.078ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30462024-11-19T02:20:30.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30472024-11-19T02:20:30.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30482024-11-19T02:20:30.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30492024-11-19T02:20:30.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30502024-11-19T02:20:30.544ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37058
30512024-11-19T02:20:30.544ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37058 req_id = 75a9a932-8729-453c-883a-1e18487f5c37 response_code = 200 uri = /baseboard
30522024-11-19T02:20:35.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30532024-11-19T02:20:35.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30542024-11-19T02:20:40.076ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30552024-11-19T02:20:40.077ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30562024-11-19T02:20:40.078ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30572024-11-19T02:20:40.078ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30582024-11-19T02:20:40.079ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30592024-11-19T02:20:40.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30602024-11-19T02:20:40.080ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30612024-11-19T02:20:40.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30622024-11-19T02:20:40.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30632024-11-19T02:20:40.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30642024-11-19T02:20:40.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30652024-11-19T02:20:40.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30662024-11-19T02:20:40.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30672024-11-19T02:20:40.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30682024-11-19T02:20:40.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30692024-11-19T02:20:40.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30702024-11-19T02:20:45.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30712024-11-19T02:20:45.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
30722024-11-19T02:20:46.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34244
30732024-11-19T02:20:46.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34244 req_id = 65e8064f-cb8e-4847-88cc-073011d11512 response_code = 200 uri = /vpc-routes
30742024-11-19T02:20:46.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32836
30752024-11-19T02:20:46.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32836 req_id = f7bee185-dfef-42bc-b5ed-fafd15769ed9 response_code = 200 uri = /vpc-routes
30762024-11-19T02:20:46.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
30772024-11-19T02:20:46.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34244 req_id = 8ba04046-2aa2-417d-8d9e-be777f1fafe0 response_code = 204 uri = /eip-gateways
30782024-11-19T02:20:46.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34244 req_id = 1bc7df5b-190c-490a-8108-a5549ec494a7 response_code = 204 uri = /vpc-routes
30792024-11-19T02:20:46.273ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
30802024-11-19T02:20:46.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32836 req_id = 916c47bc-eaef-4f8b-83c1-07911fde968e response_code = 204 uri = /eip-gateways
30812024-11-19T02:20:46.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32836 req_id = e7fa8563-957b-4dc5-acb1-a5d42da2963c response_code = 204 uri = /vpc-routes
30822024-11-19T02:20:46.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47869
30832024-11-19T02:20:46.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
30842024-11-19T02:20:46.421ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
30852024-11-19T02:20:46.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111468 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47869 req_id = f170e3bb-cc22-4006-8d29-81c9ab9ad0db response_code = 204 uri = /switch-ports
30862024-11-19T02:20:46.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59743
30872024-11-19T02:20:46.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53010
30882024-11-19T02:20:46.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63550
30892024-11-19T02:20:46.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59743 req_id = e6fcffa6-00e7-47dc-83dc-84a2721e8cc3 response_code = 200 uri = /vpc-routes
30902024-11-19T02:20:46.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63550 req_id = d0bec252-3d0d-46b3-a898-e4097efd3bda response_code = 200 uri = /v2p
30912024-11-19T02:20:46.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47869 req_id = 0234fc90-a790-4cb0-88da-ee3352a2b57f response_code = 200 uri = /network-bootstore-config
30922024-11-19T02:20:46.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53010 req_id = 15b47f45-9406-482e-af21-0b9311dec728 response_code = 200 uri = /v2p
30932024-11-19T02:20:46.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36556
30942024-11-19T02:20:46.513ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
30952024-11-19T02:20:46.557ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
30962024-11-19T02:20:46.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108881 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36556 req_id = 4e1a1e07-58aa-453a-9c61-3c323e48cdc9 response_code = 204 uri = /switch-ports
30972024-11-19T02:20:46.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60214
30982024-11-19T02:20:46.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46953
30992024-11-19T02:20:46.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36556 req_id = f91b4213-8a77-4333-99ed-65d1c26b547b response_code = 200 uri = /network-bootstore-config
31002024-11-19T02:20:46.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60214 req_id = 0591dc46-6ac5-4104-98e8-1f600f66e3d4 response_code = 200 uri = /v2p
31012024-11-19T02:20:46.622ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
31022024-11-19T02:20:46.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59743 req_id = b40db8db-57bd-4ed4-9dac-24159a63b78c response_code = 204 uri = /eip-gateways
31032024-11-19T02:20:46.622ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
31042024-11-19T02:20:46.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59743 req_id = d1b30bc4-0b78-4e65-8824-3edb7b262127 response_code = 204 uri = /vpc-routes
31052024-11-19T02:20:46.668ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
31062024-11-19T02:20:46.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112380 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46953 req_id = 45622553-081e-49de-b4bd-a549a504319a response_code = 204 uri = /switch-ports
31072024-11-19T02:20:46.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46953 req_id = c9362f50-8d7b-4ebb-851f-ef81573be588 response_code = 200 uri = /network-bootstore-config
31082024-11-19T02:20:50.081ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31092024-11-19T02:20:50.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31102024-11-19T02:20:50.082ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31112024-11-19T02:20:50.083ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31122024-11-19T02:20:50.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31132024-11-19T02:20:50.084ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31142024-11-19T02:20:50.085ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31152024-11-19T02:20:50.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31162024-11-19T02:20:50.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31172024-11-19T02:20:50.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31182024-11-19T02:20:50.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31192024-11-19T02:20:50.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31202024-11-19T02:20:50.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31212024-11-19T02:20:50.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31222024-11-19T02:20:50.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31232024-11-19T02:20:50.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31242024-11-19T02:20:55.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31252024-11-19T02:20:55.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31262024-11-19T02:21:00.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31272024-11-19T02:21:00.086ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31282024-11-19T02:21:00.087ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31292024-11-19T02:21:00.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31302024-11-19T02:21:00.088ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31312024-11-19T02:21:00.089ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31322024-11-19T02:21:00.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31332024-11-19T02:21:00.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31342024-11-19T02:21:00.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31352024-11-19T02:21:00.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31362024-11-19T02:21:00.092ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31372024-11-19T02:21:00.092ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31382024-11-19T02:21:00.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31392024-11-19T02:21:00.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31402024-11-19T02:21:00.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31412024-11-19T02:21:00.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31422024-11-19T02:21:00.577ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46052
31432024-11-19T02:21:00.577ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46052 req_id = 1a66c08b-aa4d-432e-8d75-1111bc397dff response_code = 200 uri = /baseboard
31442024-11-19T02:21:05.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31452024-11-19T02:21:05.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31462024-11-19T02:21:10.090ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31472024-11-19T02:21:10.091ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31482024-11-19T02:21:10.092ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31492024-11-19T02:21:10.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31502024-11-19T02:21:10.093ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31512024-11-19T02:21:10.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31522024-11-19T02:21:10.094ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31532024-11-19T02:21:10.095ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31542024-11-19T02:21:10.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31552024-11-19T02:21:10.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31562024-11-19T02:21:10.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31572024-11-19T02:21:10.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31582024-11-19T02:21:10.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31592024-11-19T02:21:10.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31602024-11-19T02:21:10.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31612024-11-19T02:21:10.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31622024-11-19T02:21:15.109ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31632024-11-19T02:21:15.110ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
31642024-11-19T02:21:15.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59503
31652024-11-19T02:21:15.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59503 req_id = afdb26a1-c659-4173-9fee-4f014ad341ca response_code = 200 uri = /vpc-routes
31662024-11-19T02:21:16.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
31672024-11-19T02:21:16.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59503 req_id = 6bea2479-342c-4586-b5b3-29adbab8e35a response_code = 204 uri = /eip-gateways
31682024-11-19T02:21:16.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59503 req_id = 79b5fa1a-3a90-4580-83da-571b49b3237f response_code = 204 uri = /vpc-routes
31692024-11-19T02:21:16.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43224
31702024-11-19T02:21:16.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43224 req_id = f6a786ab-dd08-47bb-ab26-077778045123 response_code = 200 uri = /v2p
31712024-11-19T02:21:16.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46378
31722024-11-19T02:21:16.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
31732024-11-19T02:21:16.209ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
31742024-11-19T02:21:16.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119234 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46378 req_id = 796c5a0b-7f38-449d-be26-9c95bdf3c40b response_code = 204 uri = /switch-ports
31752024-11-19T02:21:16.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55273
31762024-11-19T02:21:16.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65280
31772024-11-19T02:21:16.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62692
31782024-11-19T02:21:16.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62692 req_id = 504e12c0-5aad-4d2e-97c4-4e1de879aa23 response_code = 200 uri = /v2p
31792024-11-19T02:21:16.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55273 req_id = b80170c9-8eab-4ae2-ac4f-83c5710c7163 response_code = 200 uri = /vpc-routes
31802024-11-19T02:21:16.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65280 req_id = c7171fce-04da-40c8-833a-70bac7e5f2ee response_code = 200 uri = /vpc-routes
31812024-11-19T02:21:16.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46378 req_id = 82901166-b349-4a17-9ca8-b5278c43d515 response_code = 200 uri = /network-bootstore-config
31822024-11-19T02:21:16.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56427
31832024-11-19T02:21:16.303ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
31842024-11-19T02:21:16.346ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
31852024-11-19T02:21:16.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109911 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56427 req_id = cbdc5c3a-f361-4343-a409-b990e09747ea response_code = 204 uri = /switch-ports
31862024-11-19T02:21:16.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
31872024-11-19T02:21:16.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64357
31882024-11-19T02:21:16.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65280 req_id = 045cc20c-c080-430c-a56d-8f39b9c90f77 response_code = 204 uri = /eip-gateways
31892024-11-19T02:21:16.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56062
31902024-11-19T02:21:16.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
31912024-11-19T02:21:16.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55273 req_id = 4d4a99ad-ada7-4142-bc31-a5d34e4b61a4 response_code = 204 uri = /eip-gateways
31922024-11-19T02:21:16.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56427 req_id = de271e54-98e1-4f2c-b8ae-6594cbda47a2 response_code = 200 uri = /network-bootstore-config
31932024-11-19T02:21:16.414ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
31942024-11-19T02:21:16.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64357 req_id = 8fe749e0-0c29-4898-b31a-fbe12138ee60 response_code = 200 uri = /v2p
31952024-11-19T02:21:16.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65280 req_id = de1a02fa-88dd-472d-afff-3bee80cd6559 response_code = 204 uri = /vpc-routes
31962024-11-19T02:21:16.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55273 req_id = 211d4293-e8ad-46d0-9d70-8e3023147cca response_code = 204 uri = /vpc-routes
31972024-11-19T02:21:16.463ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
31982024-11-19T02:21:16.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117298 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56062 req_id = 562529ca-101b-413e-977c-e90a00142904 response_code = 204 uri = /switch-ports
31992024-11-19T02:21:16.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56062 req_id = 0e5a0686-d089-49bb-a489-5fbf8d65f9eb response_code = 200 uri = /network-bootstore-config
32002024-11-19T02:21:20.095ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32012024-11-19T02:21:20.096ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32022024-11-19T02:21:20.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32032024-11-19T02:21:20.097ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32042024-11-19T02:21:20.098ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32052024-11-19T02:21:20.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32062024-11-19T02:21:20.099ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32072024-11-19T02:21:20.100ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32082024-11-19T02:21:20.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32092024-11-19T02:21:20.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32102024-11-19T02:21:20.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32112024-11-19T02:21:20.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32122024-11-19T02:21:20.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32132024-11-19T02:21:20.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32142024-11-19T02:21:20.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32152024-11-19T02:21:20.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32162024-11-19T02:21:25.113ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32172024-11-19T02:21:25.114ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32182024-11-19T02:21:30.100ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32192024-11-19T02:21:30.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32202024-11-19T02:21:30.101ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32212024-11-19T02:21:30.102ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32222024-11-19T02:21:30.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32232024-11-19T02:21:30.103ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32242024-11-19T02:21:30.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32252024-11-19T02:21:30.105ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32262024-11-19T02:21:30.105ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32272024-11-19T02:21:30.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32282024-11-19T02:21:30.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32292024-11-19T02:21:30.107ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32302024-11-19T02:21:30.107ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32312024-11-19T02:21:30.108ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32322024-11-19T02:21:30.108ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32332024-11-19T02:21:30.109ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32342024-11-19T02:21:30.611ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41857
32352024-11-19T02:21:30.612ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41857 req_id = d3992378-5965-43a9-aca0-a00bc230dbb6 response_code = 200 uri = /baseboard
32362024-11-19T02:21:35.118ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32372024-11-19T02:21:35.119ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32382024-11-19T02:21:40.104ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32392024-11-19T02:21:40.105ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32402024-11-19T02:21:40.106ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32412024-11-19T02:21:40.107ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32422024-11-19T02:21:40.107ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32432024-11-19T02:21:40.108ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32442024-11-19T02:21:40.109ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32452024-11-19T02:21:40.109ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32462024-11-19T02:21:40.110ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32472024-11-19T02:21:40.111ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32482024-11-19T02:21:40.111ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32492024-11-19T02:21:40.112ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32502024-11-19T02:21:40.112ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32512024-11-19T02:21:40.112ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32522024-11-19T02:21:40.114ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32532024-11-19T02:21:40.114ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32542024-11-19T02:21:45.123ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32552024-11-19T02:21:45.124ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32562024-11-19T02:21:46.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61106
32572024-11-19T02:21:46.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61106 req_id = 96de48db-cd20-47f9-9050-402110dfbbc0 response_code = 200 uri = /v2p
32582024-11-19T02:21:46.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45807
32592024-11-19T02:21:46.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45807 req_id = 5394ef87-00ef-49df-9e77-d46a13ee3c71 response_code = 200 uri = /vpc-routes
32602024-11-19T02:21:46.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49106
32612024-11-19T02:21:46.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49106 req_id = 77df7e96-a14b-4729-a416-ab5679259310 response_code = 200 uri = /vpc-routes
32622024-11-19T02:21:46.305ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
32632024-11-19T02:21:46.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45807 req_id = 63e9af8a-e63d-4da3-8dab-253f8cea4d1a response_code = 204 uri = /eip-gateways
32642024-11-19T02:21:46.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45807 req_id = 606ae1b8-5bd3-4486-b096-5f41fa2dbd71 response_code = 204 uri = /vpc-routes
32652024-11-19T02:21:46.338ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
32662024-11-19T02:21:46.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49106 req_id = 551d0ffb-9bcd-4ae5-855c-c61cfccbf726 response_code = 204 uri = /eip-gateways
32672024-11-19T02:21:46.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49106 req_id = 30052f7d-26f0-448d-921c-1fe8f5934544 response_code = 204 uri = /vpc-routes
32682024-11-19T02:21:46.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38514
32692024-11-19T02:21:46.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38514 req_id = 01ba9ad6-5b7d-48da-adc8-44ea69c9a50f response_code = 200 uri = /v2p
32702024-11-19T02:21:46.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61514
32712024-11-19T02:21:46.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61514 req_id = e1ea177c-5679-47c4-988b-2be38a5d58f1 response_code = 200 uri = /v2p
32722024-11-19T02:21:46.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34680
32732024-11-19T02:21:46.497ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
32742024-11-19T02:21:46.538ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
32752024-11-19T02:21:46.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34680 req_id = 4fdaf647-d900-4a50-ba82-a2ec3b13babf response_code = 204 uri = /switch-ports
32762024-11-19T02:21:46.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59457
32772024-11-19T02:21:46.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37610
32782024-11-19T02:21:46.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37610 req_id = 07d035a5-9bc6-46c8-9583-fcd651965863 response_code = 200 uri = /vpc-routes
32792024-11-19T02:21:46.600ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
32802024-11-19T02:21:46.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34680 req_id = e616def9-9904-4357-a876-a8b46228cc67 response_code = 200 uri = /network-bootstore-config
32812024-11-19T02:21:46.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
32822024-11-19T02:21:46.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37610 req_id = b5784313-7896-4cec-9a30-80c8c32c1872 response_code = 204 uri = /eip-gateways
32832024-11-19T02:21:46.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 583 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37610 req_id = 8c3059be-3efc-4e4b-9f2e-ceeb7c2bf2d1 response_code = 204 uri = /vpc-routes
32842024-11-19T02:21:46.646ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
32852024-11-19T02:21:46.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34259
32862024-11-19T02:21:46.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59457 req_id = 5d29b1a5-fdab-4677-bdd6-fabdbec697de response_code = 204 uri = /switch-ports
32872024-11-19T02:21:46.713ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
32882024-11-19T02:21:46.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6937 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59457 req_id = 4bb80434-8b15-45a2-aee9-56c0fc7c5bb1 response_code = 200 uri = /network-bootstore-config
32892024-11-19T02:21:46.758ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
32902024-11-19T02:21:46.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109838 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34259 req_id = c1bb7c40-3c20-45b1-91fc-539d5b3709ea response_code = 204 uri = /switch-ports
32912024-11-19T02:21:46.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34259 req_id = 705972a6-ba18-4626-a574-395e94769da1 response_code = 200 uri = /network-bootstore-config
32922024-11-19T02:21:50.111ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32932024-11-19T02:21:50.112ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32942024-11-19T02:21:50.113ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32952024-11-19T02:21:50.114ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32962024-11-19T02:21:50.115ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32972024-11-19T02:21:50.116ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32982024-11-19T02:21:50.117ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
32992024-11-19T02:21:50.118ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33002024-11-19T02:21:50.119ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33012024-11-19T02:21:50.121ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33022024-11-19T02:21:50.122ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33032024-11-19T02:21:50.123ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33042024-11-19T02:21:50.123ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33052024-11-19T02:21:50.124ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33062024-11-19T02:21:50.125ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33072024-11-19T02:21:50.125ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33082024-11-19T02:21:53.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45775
33092024-11-19T02:21:53.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45775 req_id = 978354bc-5e38-4055-a7cd-ad021f298a5b response_code = 200 uri = /v2p
33102024-11-19T02:21:53.475ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(9105002) }
33112024-11-19T02:21:53.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45775 req_id = 3bc8cf8c-03ef-4de9-bd37-53182c150cd3 response_code = 204 uri = /v2p
33122024-11-19T02:21:53.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45987
33132024-11-19T02:21:53.557ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 9252ac8f-7e18-4a2d-aef8-0a254f640e58, kind: Instance { id: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9105002), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9252ac8f-7e18-4a2d-aef8-0a254f640e58, kind: Instance { id: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9105002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9252ac8f-7e18-4a2d-aef8-0a254f640e58, kind: Instance { id: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9105002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9105002))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9252ac8f-7e18-4a2d-aef8-0a254f640e58, kind: Instance { id: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9105002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-6b6d67785d7", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5f6d5e47-d502-4eb8-8c6e-3e01b78aac44, read_only_parent: Some(Volume { block_size: 512, id: c17e1076-99d3-480e-9fcf-d9e17c2c4f1b, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 657c0123-d9d9-4197-be2a-fe681cc9b22c, key: Some("qfTqIQfeJTCHEFHtomm7ofpLJNfhMmGF6/G27sg5UXM="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::19]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5f6d5e47-d502-4eb8-8c6e-3e01b78aac44, key: Some("PYwMaMKrMrisBU6W8tWnkkvaUQkBpdebwvYHrXBM59s="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::18]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-6b6d67785d7" }] }), cloud_init_bytes: Some(..) } instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 metadata = InstanceMetadata { silo_id: 78638afa-e975-44a9-b764-0afec18d156f, project_id: 001a3915-439c-4a06-bc29-bf97442cc48c } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-19T02:21:53.550472161Z }
33142024-11-19T02:21:53.557ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 migration_id = None propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33152024-11-19T02:21:53.557ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 migration_id = None propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 9252ac8f-7e18-4a2d-aef8-0a254f640e58, kind: Instance { id: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9105002), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9252ac8f-7e18-4a2d-aef8-0a254f640e58, kind: Instance { id: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9105002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9252ac8f-7e18-4a2d-aef8-0a254f640e58, kind: Instance { id: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9105002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9105002))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9252ac8f-7e18-4a2d-aef8-0a254f640e58, kind: Instance { id: e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9105002), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-6b6d67785d7", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5f6d5e47-d502-4eb8-8c6e-3e01b78aac44, read_only_parent: Some(Volume { block_size: 512, id: c17e1076-99d3-480e-9fcf-d9e17c2c4f1b, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 657c0123-d9d9-4197-be2a-fe681cc9b22c, key: Some("qfTqIQfeJTCHEFHtomm7ofpLJNfhMmGF6/G27sg5UXM="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::19]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5f6d5e47-d502-4eb8-8c6e-3e01b78aac44, key: Some("PYwMaMKrMrisBU6W8tWnkkvaUQkBpdebwvYHrXBM59s="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::18]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-6b6d67785d7" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-19T02:21:53.550472161Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
33162024-11-19T02:21:53.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4499 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45987 req_id = 715d726c-aec2-4405-8efc-3b726c7aa570 response_code = 200 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2
33172024-11-19T02:21:53.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43352
33182024-11-19T02:21:53.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43352 req_id = 07c49d24-fa0f-41c9-b093-0d5c2c1da658 response_code = 200 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2/state
33192024-11-19T02:21:53.739ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 9105002 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
33202024-11-19T02:21:53.739ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33212024-11-19T02:21:53.787ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2 file = illumos-utils/src/zone.rs:325 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33222024-11-19T02:21:53.813ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2 file = illumos-utils/src/zone.rs:363 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33232024-11-19T02:21:53.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33689
33242024-11-19T02:21:53.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33689 req_id = 761db579-a3d4-471e-85a2-37112d2a5ee1 response_code = 200 uri = /vpc-routes
33252024-11-19T02:21:53.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {9252ac8f-7e18-4a2d-aef8-0a254f640e58: {10.151.1.175: {dfdf41f5-2407-4df9-a1c1-7cff7c91332f}, 10.151.1.176: {dfdf41f5-2407-4df9-a1c1-7cff7c91332f}}} }
33262024-11-19T02:21:55.127ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33272024-11-19T02:21:55.128ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33282024-11-19T02:21:55.151ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33292024-11-19T02:21:55.152ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2 zone file = illumos-utils/src/running_zone.rs:488 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 zone = oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2
33302024-11-19T02:21:55.333ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2") failed: Property not found. retry in 54.347695ms file = illumos-utils/src/svc.rs:36 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 zone = oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2
33312024-11-19T02:21:55.424ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2") failed: Property not found. retry in 50.890896ms file = illumos-utils/src/svc.rs:36 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 zone = oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2
33322024-11-19T02:21:55.498ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2") failed: Property not found. retry in 257.085507ms file = illumos-utils/src/svc.rs:36 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 zone = oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2
33332024-11-19T02:21:55.775ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2") failed: Property not found. retry in 445.93056ms file = illumos-utils/src/svc.rs:36 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 zone = oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2
33342024-11-19T02:21:56.236ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2") failed: Property not found. retry in 1.024726307s file = illumos-utils/src/svc.rs:36 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 zone = oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2
33352024-11-19T02:21:57.275ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2") failed: Property not found. retry in 673.117482ms file = illumos-utils/src/svc.rs:36 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 zone = oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2
33362024-11-19T02:21:57.962ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2") failed: Property not found. retry in 1.473885947s file = illumos-utils/src/svc.rs:36 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 zone = oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2
33372024-11-19T02:21:59.450ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2") failed: Property not found. retry in 1.189046798s file = illumos-utils/src/svc.rs:36 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 zone = oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2
33382024-11-19T02:22:00.116ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33392024-11-19T02:22:00.117ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33402024-11-19T02:22:00.118ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33412024-11-19T02:22:00.119ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33422024-11-19T02:22:00.119ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33432024-11-19T02:22:00.121ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33442024-11-19T02:22:00.122ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33452024-11-19T02:22:00.123ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33462024-11-19T02:22:00.124ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33472024-11-19T02:22:00.124ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33482024-11-19T02:22:00.125ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33492024-11-19T02:22:00.126ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33502024-11-19T02:22:00.126ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33512024-11-19T02:22:00.127ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33522024-11-19T02:22:00.127ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33532024-11-19T02:22:00.128ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33542024-11-19T02:22:00.662ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33565
33552024-11-19T02:22:00.662ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33565 req_id = a359cd15-1c53-40dc-8e5b-3830fce812df response_code = 200 uri = /baseboard
33562024-11-19T02:22:00.675ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2 file = sled-agent/src/instance.rs:1787 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33572024-11-19T02:22:00.686ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2") failed: Property not found. retry in 72.270254ms file = illumos-utils/src/svc.rs:36 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33582024-11-19T02:22:00.773ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33592024-11-19T02:22:00.811ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33602024-11-19T02:22:00.951ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33612024-11-19T02:22:00.951ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33622024-11-19T02:22:00.952ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-19T02:22:00.951975507Z } file = sled-agent/src/instance.rs:780 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33632024-11-19T02:22:00.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7092064 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33689 req_id = bd849d43-691b-48d6-9799-e573a006682b response_code = 204 uri = /eip-gateways
33642024-11-19T02:22:00.952ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-19T02:22:00.951975507Z } propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33652024-11-19T02:22:00.952ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-19T02:22:00.951975507Z }, migration_in: None, migration_out: None }
33662024-11-19T02:22:01.008ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-19T02:22:01.008909469Z } file = sled-agent/src/instance.rs:780 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33672024-11-19T02:22:01.009ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-19T02:22:01.008909469Z } propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33682024-11-19T02:22:01.009ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-19T02:22:01.008909469Z }, migration_in: None, migration_out: None }
33692024-11-19T02:22:01.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33689 req_id = 785ea761-a193-4aeb-8d89-da67f00c5429 response_code = 204 uri = /vpc-routes
33702024-11-19T02:22:05.131ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33712024-11-19T02:22:05.132ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33722024-11-19T02:22:10.121ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33732024-11-19T02:22:10.122ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33742024-11-19T02:22:10.123ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33752024-11-19T02:22:10.123ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33762024-11-19T02:22:10.124ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33772024-11-19T02:22:10.125ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33782024-11-19T02:22:10.125ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33792024-11-19T02:22:10.126ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33802024-11-19T02:22:10.127ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33812024-11-19T02:22:10.127ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33822024-11-19T02:22:10.128ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33832024-11-19T02:22:10.128ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33842024-11-19T02:22:10.129ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33852024-11-19T02:22:10.129ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33862024-11-19T02:22:10.130ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33872024-11-19T02:22:10.130ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33882024-11-19T02:22:11.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64555
33892024-11-19T02:22:11.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64555 req_id = ad9af1bf-2ef1-4e9c-a7ea-5a55b56dffa8 response_code = 200 uri = /vmms/e917287e-a0d9-4025-b75c-a5f9cb0524d2/state
33902024-11-19T02:22:11.333ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-19T02:22:11.333202969Z } file = sled-agent/src/instance.rs:780 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33912024-11-19T02:22:11.333ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-19T02:22:11.333202969Z } propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33922024-11-19T02:22:11.333ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-19T02:22:11.333202969Z }, migration_in: None, migration_out: None }
33932024-11-19T02:22:11.356ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-19T02:22:11.356148001Z } file = sled-agent/src/instance.rs:780 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33942024-11-19T02:22:11.356ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-19T02:22:11.356148001Z } propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33952024-11-19T02:22:11.356ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
33962024-11-19T02:22:11.356ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
33972024-11-19T02:22:11.356ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 147226795602608918 n_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33982024-11-19T02:22:11.356ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 16325032445927711383 n_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
33992024-11-19T02:22:11.356ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
34002024-11-19T02:22:11.356ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/6761462c-c735-467b-a33c-59444a1ef020/debug/bundle/zone", "/pool/int/cd1eb215-4755-4f5a-a1d1-eee3d03545e0/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/57f276f8-1c12-4401-9f3d-21c3bc7af71a/crypt/debug", "/pool/ext/0a1dc6a4-13f3-4f69-b67a-be04eaf23730/crypt/debug", "/pool/ext/14855f12-b0aa-435e-9f15-f1b320ed2e6f/crypt/debug", "/pool/ext/2354be7c-bc71-4b15-9f57-06b09b66253b/crypt/debug", "/pool/ext/84fcecb7-ccc4-4225-bbb8-f67d31dc3882/crypt/debug", "/pool/ext/4a7f23d4-1da0-48ed-bb3a-c91a47472a56/crypt/debug", "/pool/ext/e7d17670-49d1-4296-b44f-e53bcd272b84/crypt/debug", "/pool/ext/2e3c761d-8e5f-4960-8456-8b1dbd3fd490/crypt/debug", "/pool/ext/8d92ce26-c543-4771-ad32-a160a4f547aa/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2
34012024-11-19T02:22:12.030ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2", bundle_id: 5544f9eb-c88c-419f-9a2a-20e00736186b }, time_created: 2024-11-19T02:22:11.356955351Z, version: 0, cause: TerminatedInstance }
34022024-11-19T02:22:12.030ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_e917287e-a0d9-4025-b75c-a5f9cb0524d2 file = sled-agent/src/instance.rs:1032 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
34032024-11-19T02:22:13.776ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
34042024-11-19T02:22:13.797ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(9105002), kind: System }
34052024-11-19T02:22:13.797ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(9105002), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
34062024-11-19T02:22:13.797ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T02:22:13.797947680Z }, migration_in: None, migration_out: None }
34072024-11-19T02:22:13.828ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T02:22:13.797947680Z }, migration_in: None, migration_out: None }
34082024-11-19T02:22:13.831ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = e6c1b322-4c1e-4a23-a2f5-88b4c6c2e947 propolis_id = e917287e-a0d9-4025-b75c-a5f9cb0524d2
34092024-11-19T02:22:14.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35991
34102024-11-19T02:22:14.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35991 req_id = b573580c-8457-42c0-8c9f-747b27528466 response_code = 200 uri = /vpc-routes
34112024-11-19T02:22:14.417ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
34122024-11-19T02:22:14.417ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
34132024-11-19T02:22:14.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35991 req_id = 66760ab5-976c-45ae-a684-ccca7dbbeb87 response_code = 204 uri = /eip-gateways
34142024-11-19T02:22:14.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50572
34152024-11-19T02:22:14.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35991 req_id = 5601cdc4-c365-41ac-83ed-bfa089e95839 response_code = 204 uri = /vpc-routes
34162024-11-19T02:22:14.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50572 req_id = 4b56587a-1a08-49a0-80ce-d769a7c899ce response_code = 200 uri = /v2p
34172024-11-19T02:22:15.136ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
34182024-11-19T02:22:15.137ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181
34192024-11-19T02:22:15.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33479
34202024-11-19T02:22:15.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33479 req_id = 20cdb21d-aed5-4b92-b239-54c716f9d627 response_code = 200 uri = /v2p
34212024-11-19T02:22:15.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54582
34222024-11-19T02:22:15.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54582 req_id = e712a319-18bb-482e-9ef9-f924e8b25690 response_code = 200 uri = /vpc-routes
34232024-11-19T02:22:15.706ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
34242024-11-19T02:22:15.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54582 req_id = f62072cb-64a5-4076-aca6-6f455143a25a response_code = 204 uri = /eip-gateways
34252024-11-19T02:22:15.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54582 req_id = a2bdafee-35c2-4aac-9fed-5b5a038b869f response_code = 204 uri = /vpc-routes
34262024-11-19T02:22:15.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46593
34272024-11-19T02:22:15.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46593 req_id = d4df9093-1c62-4224-9402-5ce63461b63e response_code = 200 uri = /vpc-routes
34282024-11-19T02:22:15.953ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
34292024-11-19T02:22:15.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46593 req_id = 3020b9fb-ebbc-4967-9ea0-91b54a3a0abe response_code = 204 uri = /eip-gateways
34302024-11-19T02:22:15.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46593 req_id = ed8be22a-aff4-42be-b1f0-b9bc2e12bbd3 response_code = 204 uri = /vpc-routes
34312024-11-19T02:22:15.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63130
34322024-11-19T02:22:15.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63130 req_id = 75c63108-b658-4f8f-97dd-6de8bd73322c response_code = 200 uri = /v2p
34332024-11-19T02:22:16.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59644
34342024-11-19T02:22:16.037ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
34352024-11-19T02:22:16.110ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
34362024-11-19T02:22:16.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165570 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59644 req_id = 716d5ae7-1a3e-4a54-9eb4-4d73b33a61db response_code = 204 uri = /switch-ports
34372024-11-19T02:22:16.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33293
34382024-11-19T02:22:16.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33293 req_id = 60e50e4e-8a52-445f-a6d5-a08577063d15 response_code = 200 uri = /vpc-routes
34392024-11-19T02:22:16.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59644 req_id = 02a0910e-b2a4-4b3f-b68d-07417269a298 response_code = 200 uri = /network-bootstore-config
34402024-11-19T02:22:16.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37047
34412024-11-19T02:22:16.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37047 req_id = 73ec8fd6-0a66-46ef-8557-d2d5e731c3c4 response_code = 200 uri = /vpc-routes
34422024-11-19T02:22:16.246ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
34432024-11-19T02:22:16.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33293 req_id = df3ae0f1-abdb-4784-b55c-8c8fa58df7a2 response_code = 204 uri = /eip-gateways
34442024-11-19T02:22:16.250ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
34452024-11-19T02:22:16.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37047 req_id = bd785d00-e96c-4e22-8f94-b945c8c14e82 response_code = 204 uri = /eip-gateways
34462024-11-19T02:22:16.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32907
34472024-11-19T02:22:16.254ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
34482024-11-19T02:22:16.304ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
34492024-11-19T02:22:16.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32907 req_id = 353a2afc-76c0-4a65-a4f8-b3a3e0ca8cfc response_code = 204 uri = /switch-ports
34502024-11-19T02:22:16.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62651
34512024-11-19T02:22:16.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45728
34522024-11-19T02:22:16.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61331
34532024-11-19T02:22:16.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 493 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37047 req_id = e2574323-a0d0-4ed5-8bf7-13f297874030 response_code = 204 uri = /vpc-routes
34542024-11-19T02:22:16.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32907 req_id = a90365ac-28f5-48b6-9ead-b54050c516c2 response_code = 200 uri = /network-bootstore-config
34552024-11-19T02:22:16.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61331 req_id = 9ef14abd-f801-4c1b-a67f-4f628855334e response_code = 200 uri = /v2p
34562024-11-19T02:22:16.373ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4176
34572024-11-19T02:22:16.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 494 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33293 req_id = aecbb805-dca4-4a22-97f1-10f3abbf4b18 response_code = 204 uri = /vpc-routes
34582024-11-19T02:22:16.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45728 req_id = 63642844-9a18-4f51-b723-78c45f344020 response_code = 200 uri = /v2p
34592024-11-19T02:22:16.427ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4200
34602024-11-19T02:22:16.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62651 req_id = 388806c0-6d84-45d6-8a4c-01b32a27a939 response_code = 204 uri = /switch-ports
34612024-11-19T02:22:16.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62651 req_id = 18a383d4-ea7f-4eb0-8380-195dc4549d1e response_code = 200 uri = /network-bootstore-config
34622024-11-19T02:22:16.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45128
34632024-11-19T02:22:16.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45128 req_id = d4f413c7-76a1-4b23-a3e8-942ea5f9febb response_code = 200 uri = /vpc-routes
34642024-11-19T02:22:16.773ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = ffe74824-0c08-48e1-a755-fb123e8dc181 values = ExternalIpGatewayMap { mappings: {} }
34652024-11-19T02:22:16.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45128 req_id = 7c595f7c-7dc2-44f3-9604-452bf5366035 response_code = 204 uri = /eip-gateways
34662024-11-19T02:22:16.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45128 req_id = 99c49a73-72c3-4634-be12-e0bb034f49f2 response_code = 204 uri = /vpc-routes