Max level shown:
1 [ Feb 23 09:05:08 Enabled. ]
2 [ Feb 23 09:05:08 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Feb 23 09:05:08 Method "start" exited with status 0. ]
4 [ Feb 23 09:05:08 Rereading configuration. ]
5 [ Feb 23 09:05:08 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-02-23T09:05:08.554ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-02-23T09:05:08.554ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-02-23T09:05:08.607ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-02-23T09:05:08.607ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-02-23T09:05:08.723ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-02-23T09:05:08.732ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-02-23T09:05:08.739ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-02-23T09:05:09.342ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-02-23T09:05:09.483ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-02-23T09:05:09.483ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-02-23T09:05:09.483ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-02-23T09:05:09.483ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-02-23T09:05:09.483ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-02-23T09:05:09.483ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-02-23T09:05:09.486ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-02-23T09:05:09.486ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-02-23T09:05:09.486ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-02-23T09:05:09.486ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-02-23T09:05:09.486ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-02-23T09:05:09.486ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-02-23T09:05:09.486ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-02-23T09:05:09.486ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-02-23T09:05:09.486ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-02-23T09:05:09.498ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-02-23T09:05:09.498ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool)
322025-02-23T09:05:09.603ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal }
332025-02-23T09:05:09.976ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-02-23T09:05:09.976ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-02-23T09:05:09.976ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-02-23T09:05:09.976ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-02-23T09:05:09.976ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-02-23T09:05:09.976ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-02-23T09:05:09.976ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-02-23T09:05:09.985ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-02-23T09:05:09.985ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 67cffe32-ab3a-41cf-b933-841677f02710 (zpool)
422025-02-23T09:05:10.075ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal }
432025-02-23T09:05:10.438ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-02-23T09:05:10.438ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-02-23T09:05:10.438ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-02-23T09:05:10.438ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-02-23T09:05:10.438ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-02-23T09:05:10.438ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-02-23T09:05:10.438ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-02-23T09:05:10.438ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-02-23T09:05:10.438ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-02-23T09:05:10.438ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-02-23T09:05:10.438ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-02-23T09:05:10.438ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-02-23T09:05:10.438ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-02-23T09:05:10.438ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-02-23T09:05:10.438ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-02-23T09:05:10.438ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-02-23T09:05:10.438ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-02-23T09:05:10.438ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-02-23T09:05:10.438ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-02-23T09:05:10.438ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-02-23T09:05:10.438ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-02-23T09:05:10.438ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
752025-02-23T09:05:10.438ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762025-02-23T09:05:10.438ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792025-02-23T09:05:10.438ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-02-23T09:05:10.438ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-02-23T09:05:10.438ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-02-23T09:05:10.438ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-02-23T09:05:10.438ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
852025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862025-02-23T09:05:10.438ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-02-23T09:05:10.438ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-02-23T09:05:10.438ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-02-23T09:05:10.438ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922025-02-23T09:05:10.438ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-02-23T09:05:10.438ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-02-23T09:05:10.438ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-02-23T09:05:10.438ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-02-23T09:05:10.438ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-02-23T09:05:10.438ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-02-23T09:05:10.438ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1012025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022025-02-23T09:05:10.438ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-02-23T09:05:10.438ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-02-23T09:05:10.438ZINFOSledAgent (bootstore): No ledger in /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-02-23T09:05:10.438ZINFOSledAgent (bootstore): No ledger in /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-02-23T09:05:10.438ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-02-23T09:05:10.438ZINFOSledAgent (bootstore): No ledger in /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-02-23T09:05:10.438ZINFOSledAgent (bootstore): No ledger in /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-02-23T09:05:10.438ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-02-23T09:05:10.438ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-02-23T09:05:10.438ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-02-23T09:05:10.449ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:793
1132025-02-23T09:05:10.449ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 35927, tv_nsec: 268759582 } time_to_next_cleanup = 599.999905048s
1142025-02-23T09:05:10.449ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1152025-02-23T09:05:10.449ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4018
1162025-02-23T09:05:10.450ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-02-23T09:05:10.450ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-02-23T09:05:10.453ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-02-23T09:05:10.455ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-02-23T09:05:10.455ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1190
1212025-02-23T09:05:10.455ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-02-23T09:05:10.455ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-02-23T09:05:10.455ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-02-23T09:05:10.455ZINFOSledAgent (RSS): No ledger in /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/rss-started.marker file = common/src/ledger.rs:188
1252025-02-23T09:05:10.455ZINFOSledAgent (RSS): No ledger in /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/rss-started.marker file = common/src/ledger.rs:188
1262025-02-23T09:05:10.456ZINFOSledAgent (RSS): No ledger in /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-02-23T09:05:10.456ZINFOSledAgent (RSS): No ledger in /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-02-23T09:05:10.456ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1239
1292025-02-23T09:05:10.456ZINFOSledAgent (RSS): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-02-23T09:05:10.456ZINFOSledAgent (RSS): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-02-23T09:05:10.456ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1271
1322025-02-23T09:05:10.456ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-02-23T09:05:10.456ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-02-23T09:05:10.456ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1302
1352025-02-23T09:05:10.456ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-02-23T09:05:10.456ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-02-23T09:05:10.456ZINFOSledAgent (bootstore): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-02-23T09:05:10.456ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-02-23T09:05:10.456ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b (sled), rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-02-23T09:05:10.457ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4315
1412025-02-23T09:05:10.457ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4721
1422025-02-23T09:05:10.462ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/cc13773/tls/src/client.rs:50
1432025-02-23T09:05:10.468ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/cc13773/tls/src/keys.rs:307
1442025-02-23T09:05:10.469ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/cc13773/tls/src/keys.rs:376
1452025-02-23T09:05:10.473ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/cc13773/tls/src/keys.rs:307
1462025-02-23T09:05:10.473ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/cc13773/tls/src/keys.rs:376
1472025-02-23T09:05:10.473ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:37798
1482025-02-23T09:05:10.473ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b (sled), rack_id: 38f3d9f8-4c95-4159-994a-e2f97a9a0026, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-02-23T09:05:10.473ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-02-23T09:05:10.473ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-02-23T09:05:10.473ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-02-23T09:05:10.473ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-02-23T09:05:10.473ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-02-23T09:05:10.473ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-02-23T09:05:10.473ZINFOSledAgent (StorageManager): No ledger in /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-02-23T09:05:10.473ZINFOSledAgent (StorageManager): No ledger in /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-02-23T09:05:10.473ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-02-23T09:05:10.473ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-02-23T09:05:10.473ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-02-23T09:05:10.473ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-02-23T09:05:10.473ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-02-23T09:05:10.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-02-23T09:05:10.511ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-02-23T09:05:10.529ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-02-23T09:05:10.562ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
1662025-02-23T09:05:10.562ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-02-23T09:05:10.562ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
1682025-02-23T09:05:10.562ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-02-23T09:05:10.565ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 103.940839ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3f521c57-cf4f-44e0-866d-098a0f29135a", "content-length": "124", "date": "Sun, 23 Feb 2025 09:05:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3f521c57-cf4f-44e0-866d-098a0f29135a" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-02-23T09:05:10.576ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_fd8d21b3-29c3-4d3c-958a-941ca0a566f2/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-02-23T09:05:10.601ZINFOSledAgent: successfully created encrypted zvol: name="oxi_fd8d21b3-29c3-4d3c-958a-941ca0a566f2/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-02-23T09:05:10.601ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_fd8d21b3-29c3-4d3c-958a-941ca0a566f2/swap" file = sled-agent/src/swap_device.rs:96
1732025-02-23T09:05:10.607ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
1742025-02-23T09:05:10.607ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-02-23T09:05:10.607ZINFOSledAgent (BackingFs): Ensuring dataset oxi_fd8d21b3-29c3-4d3c-958a-941ca0a566f2/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-02-23T09:05:10.671ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-02-23T09:05:10.671ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 120.219426ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f64073db-f208-435f-9e52-dde118519a99", "content-length": "124", "date": "Sun, 23 Feb 2025 09:05:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f64073db-f208-435f-9e52-dde118519a99" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-02-23T09:05:10.676ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-02-23T09:05:10.792ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-02-23T09:05:10.793ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 146.803506ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "01b73b1b-e486-43c5-bfe2-e6a9a7c86ef8", "content-length": "124", "date": "Sun, 23 Feb 2025 09:05:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "01b73b1b-e486-43c5-bfe2-e6a9a7c86ef8" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-02-23T09:05:10.895ZINFOSledAgent (BackingFs): Mounting oxi_fd8d21b3-29c3-4d3c-958a-941ca0a566f2/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-02-23T09:05:10.908ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-02-23T09:05:10.908ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-02-23T09:05:10.908ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-02-23T09:05:10.909ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-02-23T09:05:10.943ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-02-23T09:05:10.944ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 115.656623ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6ca277d1-4dc0-4fba-85a2-ca3e3cc10c98", "content-length": "124", "date": "Sun, 23 Feb 2025 09:05:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6ca277d1-4dc0-4fba-85a2-ca3e3cc10c98" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-02-23T09:05:11.060ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-02-23T09:05:11.061ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 282.101494ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "703e6367-7997-4a42-9e22-0ba32180175c", "content-length": "124", "date": "Sun, 23 Feb 2025 09:05:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "703e6367-7997-4a42-9e22-0ba32180175c" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-02-23T09:05:11.344ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-02-23T09:05:11.345ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 333.11911ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2217bc8e-dc10-49a9-9767-c4e62de6c0a7", "content-length": "124", "date": "Sun, 23 Feb 2025 09:05:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2217bc8e-dc10-49a9-9767-c4e62de6c0a7" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-02-23T09:05:11.660ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
1932025-02-23T09:05:11.665ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:58504 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
1942025-02-23T09:05:11.665ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
1952025-02-23T09:05:11.665ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:58504 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
1962025-02-23T09:05:11.666ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 320.46517ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
1972025-02-23T09:05:11.667ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
1982025-02-23T09:05:11.667ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
1992025-02-23T09:05:11.668ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:977 underlay_address = fd00:1122:3344:101::1
2002025-02-23T09:05:11.668ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012025-02-23T09:05:11.679ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022025-02-23T09:05:11.989ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 711.896746ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2032025-02-23T09:05:12.702ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 752.946922ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2042025-02-23T09:05:13.459ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.215453618s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2052025-02-23T09:05:14.676ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.108791981s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2062025-02-23T09:05:14.751ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2749
2072025-02-23T09:05:14.751ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2977
2082025-02-23T09:05:14.751ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2619
2092025-02-23T09:05:14.751ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2666
2102025-02-23T09:05:14.751ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3058
2112025-02-23T09:05:14.751ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3103
2122025-02-23T09:05:14.753ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2885
2132025-02-23T09:05:14.754ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2660
2142025-02-23T09:05:14.755ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='2a80cc10-3106-4705-a189-5caa46d3f12b'/> <propval type="astring" name="rack_id" value='38f3d9f8-4c95-4159-994a-e2f97a9a0026'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feeb:65eb'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='38f3d9f8-4c95-4159-994a-e2f97a9a0026'/> <propval type="astring" name="sled_id" value='367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='38f3d9f8-4c95-4159-994a-e2f97a9a0026'/> <propval type="astring" name="sled_id" value='367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b'/> <propval type="astring" name="rack_uuid" value='38f3d9f8-4c95-4159-994a-e2f97a9a0026'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b'/> <propval type="astring" name="rack_uuid" value='38f3d9f8-4c95-4159-994a-e2f97a9a0026'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2152025-02-23T09:05:14.755ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_switch
2162025-02-23T09:05:15.100ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 34.347456ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-02-23T09:05:15.296ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 56.964328ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-02-23T09:05:15.502ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 135.146421ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-02-23T09:05:15.696ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 497.498991ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-02-23T09:05:16.337ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 772.971933ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-02-23T09:05:17.160ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.088792529s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-02-23T09:05:17.787ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.472219148s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2232025-02-23T09:05:18.353ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 841.727987ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-02-23T09:05:19.206ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.372880595s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-02-23T09:05:20.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2262025-02-23T09:05:20.861ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2272025-02-23T09:05:20.863ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2282025-02-23T09:05:20.863ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2292025-02-23T09:05:20.863ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2302025-02-23T09:05:20.863ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2312025-02-23T09:05:20.863ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322025-02-23T09:05:20.863ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2332025-02-23T09:05:20.863ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2342025-02-23T09:05:20.863ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4018
2352025-02-23T09:05:20.864ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:37798
2362025-02-23T09:05:21.067ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2372025-02-23T09:05:21.067ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2382025-02-23T09:05:21.071ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4339 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2392025-02-23T09:05:21.071ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4355
2402025-02-23T09:05:21.071ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:535 zone = oxz_switch
2412025-02-23T09:05:21.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37165
2422025-02-23T09:05:21.337ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2432025-02-23T09:05:21.337ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442025-02-23T09:05:21.337ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-zones.json file = common/src/ledger.rs:188
2452025-02-23T09:05:21.337ZINFOSledAgent (ServiceManager): No ledger in /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-zones.json file = common/src/ledger.rs:188
2462025-02-23T09:05:21.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37165 req_id = 6c695b19-4d44-40b6-9283-07759d48f720 response_code = 200 uri = /inventory
2472025-02-23T09:05:21.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46305
2482025-02-23T09:05:21.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46305 req_id = 8f725d68-747d-4793-810d-67c11e0e192e response_code = 200 uri = /sled-role
2492025-02-23T09:05:21.398ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0bf1dbe2-3bde-43af-b3d4-c667d6b76e90 (physical_disk), pool_id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 3affcb68-0445-4ca3-8073-6bacd689aa99 (physical_disk), pool_id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 3b6b9ab7-70fe-4ac9-91a3-47a5889fe611 (physical_disk), pool_id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7c4115b6-552d-42b8-9590-9923f7360497 (physical_disk), pool_id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 7caba9dd-f548-473f-b0f2-a12712486ba7 (physical_disk), pool_id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7d615539-92ad-46b6-b58d-c27bc17cbb18 (physical_disk), pool_id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: ab153ba7-255e-4e31-909b-32ab41c31e6b (physical_disk), pool_id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d4991fd0-655a-4d89-8e18-9c9e68c94308 (physical_disk), pool_id: dd28684b-0582-4159-82e0-305747c1d637 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: df6c4dfe-3ae1-4395-9f75-34954c6972c3 (physical_disk), pool_id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2502025-02-23T09:05:21.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36164
2512025-02-23T09:05:21.399ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2522025-02-23T09:05:21.399ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0bf1dbe2-3bde-43af-b3d4-c667d6b76e90 (physical_disk), pool_id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 3affcb68-0445-4ca3-8073-6bacd689aa99 (physical_disk), pool_id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 3b6b9ab7-70fe-4ac9-91a3-47a5889fe611 (physical_disk), pool_id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7c4115b6-552d-42b8-9590-9923f7360497 (physical_disk), pool_id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 7caba9dd-f548-473f-b0f2-a12712486ba7 (physical_disk), pool_id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7d615539-92ad-46b6-b58d-c27bc17cbb18 (physical_disk), pool_id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: ab153ba7-255e-4e31-909b-32ab41c31e6b (physical_disk), pool_id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d4991fd0-655a-4d89-8e18-9c9e68c94308 (physical_disk), pool_id: dd28684b-0582-4159-82e0-305747c1d637 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: df6c4dfe-3ae1-4395-9f75-34954c6972c3 (physical_disk), pool_id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2532025-02-23T09:05:21.399ZINFOSledAgent (StorageManager): No ledger in /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2542025-02-23T09:05:21.399ZINFOSledAgent (StorageManager): No ledger in /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552025-02-23T09:05:21.399ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2562025-02-23T09:05:21.399ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2572025-02-23T09:05:21.399ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2582025-02-23T09:05:21.399ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2592025-02-23T09:05:21.399ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2602025-02-23T09:05:21.564ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2612025-02-23T09:05:21.565ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool)
2622025-02-23T09:05:21.779ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2632025-02-23T09:05:21.779ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2642025-02-23T09:05:21.999ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2652025-02-23T09:05:22.001ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) file = sled-agent/src/probe_manager.rs:238 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
2662025-02-23T09:05:22.062ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }
2672025-02-23T09:05:22.070ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2682025-02-23T09:05:22.070ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2692025-02-23T09:05:22.070ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2702025-02-23T09:05:22.070ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2712025-02-23T09:05:22.070ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722025-02-23T09:05:22.070ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-02-23T09:05:22.071ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2742025-02-23T09:05:22.104ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752025-02-23T09:05:22.113ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone file = sled-storage/src/dataset.rs:302
2762025-02-23T09:05:22.255ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff file = sled-storage/src/dataset.rs:388
2772025-02-23T09:05:22.263ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2782025-02-23T09:05:22.263ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2792025-02-23T09:05:22.263ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2802025-02-23T09:05:22.263ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2812025-02-23T09:05:22.263ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2822025-02-23T09:05:22.274ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2832025-02-23T09:05:22.274ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9e960c69-de8b-458e-900f-827df5fd1555 (zpool)
2842025-02-23T09:05:22.370ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }
2852025-02-23T09:05:22.379ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2862025-02-23T09:05:22.379ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2872025-02-23T09:05:22.379ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2882025-02-23T09:05:22.379ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2892025-02-23T09:05:22.379ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2902025-02-23T09:05:22.379ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-02-23T09:05:22.379ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2922025-02-23T09:05:22.413ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2932025-02-23T09:05:22.422ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9e960c69-de8b-458e-900f-827df5fd1555/crypt/zone file = sled-storage/src/dataset.rs:302
2942025-02-23T09:05:22.565ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9e960c69-de8b-458e-900f-827df5fd1555 file = sled-storage/src/dataset.rs:388
2952025-02-23T09:05:22.574ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2962025-02-23T09:05:22.574ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2972025-02-23T09:05:22.574ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2982025-02-23T09:05:22.574ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2992025-02-23T09:05:22.574ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3002025-02-23T09:05:22.586ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3012025-02-23T09:05:22.586ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b04b1013-1fd4-4342-9735-04e35a199534 (zpool)
3022025-02-23T09:05:22.680ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }
3032025-02-23T09:05:22.688ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3042025-02-23T09:05:22.688ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3052025-02-23T09:05:22.688ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3062025-02-23T09:05:22.688ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3072025-02-23T09:05:22.688ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3082025-02-23T09:05:22.688ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092025-02-23T09:05:22.688ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3102025-02-23T09:05:22.725ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3112025-02-23T09:05:22.733ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b04b1013-1fd4-4342-9735-04e35a199534/crypt/zone file = sled-storage/src/dataset.rs:302
3122025-02-23T09:05:22.872ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b04b1013-1fd4-4342-9735-04e35a199534 file = sled-storage/src/dataset.rs:388
3132025-02-23T09:05:22.880ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3142025-02-23T09:05:22.880ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3152025-02-23T09:05:22.880ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3162025-02-23T09:05:22.880ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3172025-02-23T09:05:22.880ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3182025-02-23T09:05:22.890ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3192025-02-23T09:05:22.890ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7f9f3d10-8155-4511-8c83-34282eab634b (zpool)
3202025-02-23T09:05:22.984ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }
3212025-02-23T09:05:22.992ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3222025-02-23T09:05:22.992ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3232025-02-23T09:05:22.992ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3242025-02-23T09:05:22.992ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3252025-02-23T09:05:22.992ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3262025-02-23T09:05:22.992ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272025-02-23T09:05:22.992ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3282025-02-23T09:05:23.003ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) file = sled-agent/src/probe_manager.rs:238 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3292025-02-23T09:05:23.028ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3302025-02-23T09:05:23.036ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone file = sled-storage/src/dataset.rs:302
3312025-02-23T09:05:23.175ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7f9f3d10-8155-4511-8c83-34282eab634b file = sled-storage/src/dataset.rs:388
3322025-02-23T09:05:23.183ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3332025-02-23T09:05:23.183ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3342025-02-23T09:05:23.183ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3352025-02-23T09:05:23.183ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3362025-02-23T09:05:23.183ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3372025-02-23T09:05:23.193ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3382025-02-23T09:05:23.193ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool)
3392025-02-23T09:05:23.287ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }
3402025-02-23T09:05:23.295ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3412025-02-23T09:05:23.295ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3422025-02-23T09:05:23.295ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3432025-02-23T09:05:23.295ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3442025-02-23T09:05:23.295ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3452025-02-23T09:05:23.296ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-02-23T09:05:23.296ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3472025-02-23T09:05:23.332ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3482025-02-23T09:05:23.336ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 20.489566259s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3492025-02-23T09:05:23.340ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/zone file = sled-storage/src/dataset.rs:302
3502025-02-23T09:05:23.476ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7 file = sled-storage/src/dataset.rs:388
3512025-02-23T09:05:23.484ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522025-02-23T09:05:23.484ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532025-02-23T09:05:23.484ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542025-02-23T09:05:23.484ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552025-02-23T09:05:23.484ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562025-02-23T09:05:23.494ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572025-02-23T09:05:23.494ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = dd28684b-0582-4159-82e0-305747c1d637 (zpool)
3582025-02-23T09:05:23.591ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }
3592025-02-23T09:05:23.599ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3602025-02-23T09:05:23.599ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3612025-02-23T09:05:23.599ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3622025-02-23T09:05:23.599ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3632025-02-23T09:05:23.599ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-02-23T09:05:23.600ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-02-23T09:05:23.600ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3662025-02-23T09:05:23.635ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672025-02-23T09:05:23.643ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_dd28684b-0582-4159-82e0-305747c1d637/crypt/zone file = sled-storage/src/dataset.rs:302
3682025-02-23T09:05:23.784ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_dd28684b-0582-4159-82e0-305747c1d637 file = sled-storage/src/dataset.rs:388
3692025-02-23T09:05:23.793ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702025-02-23T09:05:23.793ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712025-02-23T09:05:23.793ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722025-02-23T09:05:23.793ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732025-02-23T09:05:23.793ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742025-02-23T09:05:23.803ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752025-02-23T09:05:23.803ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool)
3762025-02-23T09:05:23.896ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }
3772025-02-23T09:05:23.904ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3782025-02-23T09:05:23.904ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3792025-02-23T09:05:23.904ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3802025-02-23T09:05:23.904ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3812025-02-23T09:05:23.904ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822025-02-23T09:05:23.904ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-02-23T09:05:23.904ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3842025-02-23T09:05:23.938ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3852025-02-23T09:05:23.948ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/zone file = sled-storage/src/dataset.rs:302
3862025-02-23T09:05:24.005ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) file = sled-agent/src/probe_manager.rs:238 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
3872025-02-23T09:05:24.091ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_52c0a5e3-b03e-446e-9e20-336c4f905023 file = sled-storage/src/dataset.rs:388
3882025-02-23T09:05:24.099ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892025-02-23T09:05:24.099ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902025-02-23T09:05:24.099ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912025-02-23T09:05:24.099ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922025-02-23T09:05:24.099ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932025-02-23T09:05:24.109ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942025-02-23T09:05:24.109ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool)
3952025-02-23T09:05:24.207ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }
3962025-02-23T09:05:24.215ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3972025-02-23T09:05:24.216ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3982025-02-23T09:05:24.216ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3992025-02-23T09:05:24.216ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4002025-02-23T09:05:24.216ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-02-23T09:05:24.216ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022025-02-23T09:05:24.216ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4032025-02-23T09:05:24.252ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042025-02-23T09:05:24.261ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_32f1e829-361d-464b-83d6-3092853cc1e7/crypt/zone file = sled-storage/src/dataset.rs:302
4052025-02-23T09:05:24.409ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_32f1e829-361d-464b-83d6-3092853cc1e7 file = sled-storage/src/dataset.rs:388
4062025-02-23T09:05:24.417ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072025-02-23T09:05:24.417ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082025-02-23T09:05:24.417ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092025-02-23T09:05:24.417ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102025-02-23T09:05:24.417ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112025-02-23T09:05:24.428ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122025-02-23T09:05:24.428ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool)
4132025-02-23T09:05:24.525ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }
4142025-02-23T09:05:24.535ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4152025-02-23T09:05:24.535ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4162025-02-23T09:05:24.535ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4172025-02-23T09:05:24.535ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4182025-02-23T09:05:24.535ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192025-02-23T09:05:24.535ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-02-23T09:05:24.535ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4212025-02-23T09:05:24.574ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222025-02-23T09:05:24.586ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone file = sled-storage/src/dataset.rs:302
4232025-02-23T09:05:24.734ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 file = sled-storage/src/dataset.rs:388
4242025-02-23T09:05:24.742ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252025-02-23T09:05:24.743ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262025-02-23T09:05:24.743ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272025-02-23T09:05:24.743ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd8d21b3-29c3-4d3c-958a-941ca0a566f2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67cffe32-ab3a-41cf-b933-841677f02710 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282025-02-23T09:05:24.743ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292025-02-23T09:05:24.743ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302025-02-23T09:05:24.743ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-02-23T09:05:24.743ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4322025-02-23T09:05:24.743ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4332025-02-23T09:05:24.743ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4342025-02-23T09:05:24.743ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4352025-02-23T09:05:24.743ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4362025-02-23T09:05:24.743ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4372025-02-23T09:05:24.743ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4382025-02-23T09:05:24.743ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392025-02-23T09:05:24.743ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4402025-02-23T09:05:24.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3344704 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36164 req_id = 2e3ddd39-5b71-42b7-aebb-56997a13fcdc response_code = 200 uri = /omicron-physical-disks
4412025-02-23T09:05:24.775ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00db2824-4e34-40c3-9df7-e044a2961088 (dataset): DatasetConfig { id: 00db2824-4e34-40c3-9df7-e044a2961088 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0bdf5aa1-1059-43d9-867b-b236d808f038 (dataset): DatasetConfig { id: 0bdf5aa1-1059-43d9-867b-b236d808f038 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d89eff1-fc49-4ed8-8911-8433d9321931 (dataset): DatasetConfig { id: 0d89eff1-fc49-4ed8-8911-8433d9321931 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e956b62-3ce6-4d30-b413-6c920b11db7c (dataset): DatasetConfig { id: 0e956b62-3ce6-4d30-b413-6c920b11db7c (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0fc7306b-faed-40a3-94e2-cad232cda269 (dataset): DatasetConfig { id: 0fc7306b-faed-40a3-94e2-cad232cda269 (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13014f8e-6ac4-4964-be73-8eaf97a9ac84 (dataset): DatasetConfig { id: 13014f8e-6ac4-4964-be73-8eaf97a9ac84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 132cc06e-a739-4075-a8ad-17c57bd654f6 (dataset): DatasetConfig { id: 132cc06e-a739-4075-a8ad-17c57bd654f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 174759b1-9efc-42ac-8336-13cad365abcb (dataset): DatasetConfig { id: 174759b1-9efc-42ac-8336-13cad365abcb (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e98d13c-69b4-40e1-a9fc-511739227082 (dataset): DatasetConfig { id: 1e98d13c-69b4-40e1-a9fc-511739227082 (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24ca4c82-5423-4d21-8118-54721eddb854 (dataset): DatasetConfig { id: 24ca4c82-5423-4d21-8118-54721eddb854 (dataset), name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a47f314-29f8-4964-88a8-80688237a5e3 (dataset): DatasetConfig { id: 2a47f314-29f8-4964-88a8-80688237a5e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a641894-721b-4824-8d1e-d0d21db77551 (dataset): DatasetConfig { id: 2a641894-721b-4824-8d1e-d0d21db77551 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a83452c-9caa-49cd-9e40-397e75eff559 (dataset): DatasetConfig { id: 2a83452c-9caa-49cd-9e40-397e75eff559 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2eb2cf2d-32d5-4e5b-9978-6cbb44dc9f3e (dataset): DatasetConfig { id: 2eb2cf2d-32d5-4e5b-9978-6cbb44dc9f3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 357b4cee-bfc3-45c6-8e62-9ca854dffe9f (dataset): DatasetConfig { id: 357b4cee-bfc3-45c6-8e62-9ca854dffe9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d2b866d-f2d4-48e4-963b-9bf619a33f22 (dataset): DatasetConfig { id: 3d2b866d-f2d4-48e4-963b-9bf619a33f22 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40810357-50b9-44d6-8dd6-ca0e8b9b82c6 (dataset): DatasetConfig { id: 40810357-50b9-44d6-8dd6-ca0e8b9b82c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40dfabf1-9887-45e7-a2d5-73a87307ca04 (dataset): DatasetConfig { id: 40dfabf1-9887-45e7-a2d5-73a87307ca04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48317e7c-e071-45cf-a4fd-6a0d381a1572 (dataset): DatasetConfig { id: 48317e7c-e071-45cf-a4fd-6a0d381a1572 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4af402b8-56ff-4ee9-9e9b-3d0ff40ce6fb (dataset): DatasetConfig { id: 4af402b8-56ff-4ee9-9e9b-3d0ff40ce6fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50bdfb58-186b-400e-adb4-0af04675092d (dataset): DatasetConfig { id: 50bdfb58-186b-400e-adb4-0af04675092d (dataset), name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56379e0e-9fba-42b9-a533-7178a2b0fb75 (dataset): DatasetConfig { id: 56379e0e-9fba-42b9-a533-7178a2b0fb75 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59f80428-da26-40d0-b33a-a5e166848bdc (dataset): DatasetConfig { id: 59f80428-da26-40d0-b33a-a5e166848bdc (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59fdd53c-891e-4231-a5b5-df73a3294831 (dataset): DatasetConfig { id: 59fdd53c-891e-4231-a5b5-df73a3294831 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bacbee4-33de-4013-a0f7-b98bd32ddf7d (dataset): DatasetConfig { id: 5bacbee4-33de-4013-a0f7-b98bd32ddf7d (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 654e0409-9af4-4204-9fc3-95cd8fd8b98f (dataset): DatasetConfig { id: 654e0409-9af4-4204-9fc3-95cd8fd8b98f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65eb79b7-302c-45a9-9cfd-deecee8bca8d (dataset): DatasetConfig { id: 65eb79b7-302c-45a9-9cfd-deecee8bca8d (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66eb2ce9-4cec-46af-a048-7c1d27e9d6bb (dataset): DatasetConfig { id: 66eb2ce9-4cec-46af-a048-7c1d27e9d6bb (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68e43784-2144-4574-be13-045909a82ab4 (dataset): DatasetConfig { id: 68e43784-2144-4574-be13-045909a82ab4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c07520b-9dce-4398-9c4d-3478d2cf7021 (dataset): DatasetConfig { id: 6c07520b-9dce-4398-9c4d-3478d2cf7021 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ee6a6e9-f3da-434d-91e7-42fdfb8921b7 (dataset): DatasetConfig { id: 6ee6a6e9-f3da-434d-91e7-42fdfb8921b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7065eaac-b096-4751-8019-1b43a4468465 (dataset): DatasetConfig { id: 7065eaac-b096-4751-8019-1b43a4468465 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71a6aa8b-46ff-49be-a400-0406d2a911a8 (dataset): DatasetConfig { id: 71a6aa8b-46ff-49be-a400-0406d2a911a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77ce254b-b20d-4d34-969d-a6124a028589 (dataset): DatasetConfig { id: 77ce254b-b20d-4d34-969d-a6124a028589 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_70464b9d-8658-401f-8157-5d899e662209" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77e1e291-0b8d-4377-b25c-6c664c5b4974 (dataset): DatasetConfig { id: 77e1e291-0b8d-4377-b25c-6c664c5b4974 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79e607f1-8e74-4032-9f0c-ea32205f6276 (dataset): DatasetConfig { id: 79e607f1-8e74-4032-9f0c-ea32205f6276 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c0c27d5-9b64-4132-a399-1d9fc077c302 (dataset): DatasetConfig { id: 7c0c27d5-9b64-4132-a399-1d9fc077c302 (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8555759e-68d3-4972-a16a-f90ffd360113 (dataset): DatasetConfig { id: 8555759e-68d3-4972-a16a-f90ffd360113 (dataset), name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a14c7e9-56e0-4799-8e15-60e12ce380ea (dataset): DatasetConfig { id: 8a14c7e9-56e0-4799-8e15-60e12ce380ea (dataset), name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e0f1872-95ed-454c-9099-0d63844512c8 (dataset): DatasetConfig { id: 8e0f1872-95ed-454c-9099-0d63844512c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 91d963b4-c8d5-47d3-b564-48a8759c14ca (dataset): DatasetConfig { id: 91d963b4-c8d5-47d3-b564-48a8759c14ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 95de5799-495c-4870-ad91-21576cb55846 (dataset): DatasetConfig { id: 95de5799-495c-4870-ad91-21576cb55846 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9806f4fd-12ce-4691-ab1f-cc54f916b0ad (dataset): DatasetConfig { id: 9806f4fd-12ce-4691-ab1f-cc54f916b0ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 990e8ca5-3bd7-4734-86b8-c1404e73901a (dataset): DatasetConfig { id: 990e8ca5-3bd7-4734-86b8-c1404e73901a (dataset), name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d4d8f1c-1377-4dd6-b020-27049bc74f1d (dataset): DatasetConfig { id: 9d4d8f1c-1377-4dd6-b020-27049bc74f1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2220063-0d26-4403-8680-805c7af70fb0 (dataset): DatasetConfig { id: b2220063-0d26-4403-8680-805c7af70fb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b33ebe20-1b66-458f-8248-14f3d3bba9fc (dataset): DatasetConfig { id: b33ebe20-1b66-458f-8248-14f3d3bba9fc (dataset), name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b71e92ae-09af-4d12-9fd8-4c0d98f5db2f (dataset): DatasetConfig { id: b71e92ae-09af-4d12-9fd8-4c0d98f5db2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b85556b7-03ed-451b-afe6-58135598ee3d (dataset): DatasetConfig { id: b85556b7-03ed-451b-afe6-58135598ee3d (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcc295c3-b682-43cf-bf68-35f3a107444c (dataset): DatasetConfig { id: bcc295c3-b682-43cf-bf68-35f3a107444c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bebbb77a-137c-4405-8e83-dd225243c010 (dataset): DatasetConfig { id: bebbb77a-137c-4405-8e83-dd225243c010 (dataset), name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c081c270-0eb9-42a3-9ef9-bd5195918510 (dataset): DatasetConfig { id: c081c270-0eb9-42a3-9ef9-bd5195918510 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0d1db6b-e31d-4bfb-810a-b708c2c77510 (dataset): DatasetConfig { id: c0d1db6b-e31d-4bfb-810a-b708c2c77510 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3c6bbdc-28d4-4f42-8dd1-5f180c174207 (dataset): DatasetConfig { id: c3c6bbdc-28d4-4f42-8dd1-5f180c174207 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb2d5c17-9e2d-41f6-9ee1-416b80ba2ca6 (dataset): DatasetConfig { id: cb2d5c17-9e2d-41f6-9ee1-416b80ba2ca6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb5652a1-9779-464f-9981-71318bcd385c (dataset): DatasetConfig { id: cb5652a1-9779-464f-9981-71318bcd385c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d2aa03e4-9bd5-4f56-ab34-bf7e280d4956 (dataset): DatasetConfig { id: d2aa03e4-9bd5-4f56-ab34-bf7e280d4956 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d2ee6e47-1cf6-4203-93ec-9cc0c0315b70 (dataset): DatasetConfig { id: d2ee6e47-1cf6-4203-93ec-9cc0c0315b70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3a2c68c-64af-44fb-aac8-798ef6a37fc2 (dataset): DatasetConfig { id: d3a2c68c-64af-44fb-aac8-798ef6a37fc2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d41b323e-f92e-477f-b47d-b3e4b650ced0 (dataset): DatasetConfig { id: d41b323e-f92e-477f-b47d-b3e4b650ced0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5c3c087-1263-42ba-bc02-415e6897593f (dataset): DatasetConfig { id: d5c3c087-1263-42ba-bc02-415e6897593f (dataset), name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2396462-a14e-48c9-a2ca-3b9b67fe3136 (dataset): DatasetConfig { id: e2396462-a14e-48c9-a2ca-3b9b67fe3136 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e71c43e1-077d-4b47-b02e-ee11fa723f06 (dataset): DatasetConfig { id: e71c43e1-077d-4b47-b02e-ee11fa723f06 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ebac35d9-8600-49ac-b680-0f001210fb8e (dataset): DatasetConfig { id: ebac35d9-8600-49ac-b680-0f001210fb8e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6ce0c57-4436-4753-8434-48920a5511e9 (dataset): DatasetConfig { id: f6ce0c57-4436-4753-8434-48920a5511e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fae0160d-949b-4890-801b-3ac3646d9514 (dataset): DatasetConfig { id: fae0160d-949b-4890-801b-3ac3646d9514 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422025-02-23T09:05:24.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41711
4432025-02-23T09:05:24.776ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4442025-02-23T09:05:24.776ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00db2824-4e34-40c3-9df7-e044a2961088 (dataset): DatasetConfig { id: 00db2824-4e34-40c3-9df7-e044a2961088 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0bdf5aa1-1059-43d9-867b-b236d808f038 (dataset): DatasetConfig { id: 0bdf5aa1-1059-43d9-867b-b236d808f038 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d89eff1-fc49-4ed8-8911-8433d9321931 (dataset): DatasetConfig { id: 0d89eff1-fc49-4ed8-8911-8433d9321931 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e956b62-3ce6-4d30-b413-6c920b11db7c (dataset): DatasetConfig { id: 0e956b62-3ce6-4d30-b413-6c920b11db7c (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0fc7306b-faed-40a3-94e2-cad232cda269 (dataset): DatasetConfig { id: 0fc7306b-faed-40a3-94e2-cad232cda269 (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13014f8e-6ac4-4964-be73-8eaf97a9ac84 (dataset): DatasetConfig { id: 13014f8e-6ac4-4964-be73-8eaf97a9ac84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 132cc06e-a739-4075-a8ad-17c57bd654f6 (dataset): DatasetConfig { id: 132cc06e-a739-4075-a8ad-17c57bd654f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 174759b1-9efc-42ac-8336-13cad365abcb (dataset): DatasetConfig { id: 174759b1-9efc-42ac-8336-13cad365abcb (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e98d13c-69b4-40e1-a9fc-511739227082 (dataset): DatasetConfig { id: 1e98d13c-69b4-40e1-a9fc-511739227082 (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24ca4c82-5423-4d21-8118-54721eddb854 (dataset): DatasetConfig { id: 24ca4c82-5423-4d21-8118-54721eddb854 (dataset), name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a47f314-29f8-4964-88a8-80688237a5e3 (dataset): DatasetConfig { id: 2a47f314-29f8-4964-88a8-80688237a5e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a641894-721b-4824-8d1e-d0d21db77551 (dataset): DatasetConfig { id: 2a641894-721b-4824-8d1e-d0d21db77551 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a83452c-9caa-49cd-9e40-397e75eff559 (dataset): DatasetConfig { id: 2a83452c-9caa-49cd-9e40-397e75eff559 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2eb2cf2d-32d5-4e5b-9978-6cbb44dc9f3e (dataset): DatasetConfig { id: 2eb2cf2d-32d5-4e5b-9978-6cbb44dc9f3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 357b4cee-bfc3-45c6-8e62-9ca854dffe9f (dataset): DatasetConfig { id: 357b4cee-bfc3-45c6-8e62-9ca854dffe9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d2b866d-f2d4-48e4-963b-9bf619a33f22 (dataset): DatasetConfig { id: 3d2b866d-f2d4-48e4-963b-9bf619a33f22 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40810357-50b9-44d6-8dd6-ca0e8b9b82c6 (dataset): DatasetConfig { id: 40810357-50b9-44d6-8dd6-ca0e8b9b82c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40dfabf1-9887-45e7-a2d5-73a87307ca04 (dataset): DatasetConfig { id: 40dfabf1-9887-45e7-a2d5-73a87307ca04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48317e7c-e071-45cf-a4fd-6a0d381a1572 (dataset): DatasetConfig { id: 48317e7c-e071-45cf-a4fd-6a0d381a1572 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4af402b8-56ff-4ee9-9e9b-3d0ff40ce6fb (dataset): DatasetConfig { id: 4af402b8-56ff-4ee9-9e9b-3d0ff40ce6fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50bdfb58-186b-400e-adb4-0af04675092d (dataset): DatasetConfig { id: 50bdfb58-186b-400e-adb4-0af04675092d (dataset), name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56379e0e-9fba-42b9-a533-7178a2b0fb75 (dataset): DatasetConfig { id: 56379e0e-9fba-42b9-a533-7178a2b0fb75 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59f80428-da26-40d0-b33a-a5e166848bdc (dataset): DatasetConfig { id: 59f80428-da26-40d0-b33a-a5e166848bdc (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59fdd53c-891e-4231-a5b5-df73a3294831 (dataset): DatasetConfig { id: 59fdd53c-891e-4231-a5b5-df73a3294831 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bacbee4-33de-4013-a0f7-b98bd32ddf7d (dataset): DatasetConfig { id: 5bacbee4-33de-4013-a0f7-b98bd32ddf7d (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 654e0409-9af4-4204-9fc3-95cd8fd8b98f (dataset): DatasetConfig { id: 654e0409-9af4-4204-9fc3-95cd8fd8b98f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65eb79b7-302c-45a9-9cfd-deecee8bca8d (dataset): DatasetConfig { id: 65eb79b7-302c-45a9-9cfd-deecee8bca8d (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66eb2ce9-4cec-46af-a048-7c1d27e9d6bb (dataset): DatasetConfig { id: 66eb2ce9-4cec-46af-a048-7c1d27e9d6bb (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68e43784-2144-4574-be13-045909a82ab4 (dataset): DatasetConfig { id: 68e43784-2144-4574-be13-045909a82ab4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c07520b-9dce-4398-9c4d-3478d2cf7021 (dataset): DatasetConfig { id: 6c07520b-9dce-4398-9c4d-3478d2cf7021 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ee6a6e9-f3da-434d-91e7-42fdfb8921b7 (dataset): DatasetConfig { id: 6ee6a6e9-f3da-434d-91e7-42fdfb8921b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7065eaac-b096-4751-8019-1b43a4468465 (dataset): DatasetConfig { id: 7065eaac-b096-4751-8019-1b43a4468465 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71a6aa8b-46ff-49be-a400-0406d2a911a8 (dataset): DatasetConfig { id: 71a6aa8b-46ff-49be-a400-0406d2a911a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77ce254b-b20d-4d34-969d-a6124a028589 (dataset): DatasetConfig { id: 77ce254b-b20d-4d34-969d-a6124a028589 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_70464b9d-8658-401f-8157-5d899e662209" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77e1e291-0b8d-4377-b25c-6c664c5b4974 (dataset): DatasetConfig { id: 77e1e291-0b8d-4377-b25c-6c664c5b4974 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79e607f1-8e74-4032-9f0c-ea32205f6276 (dataset): DatasetConfig { id: 79e607f1-8e74-4032-9f0c-ea32205f6276 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c0c27d5-9b64-4132-a399-1d9fc077c302 (dataset): DatasetConfig { id: 7c0c27d5-9b64-4132-a399-1d9fc077c302 (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8555759e-68d3-4972-a16a-f90ffd360113 (dataset): DatasetConfig { id: 8555759e-68d3-4972-a16a-f90ffd360113 (dataset), name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a14c7e9-56e0-4799-8e15-60e12ce380ea (dataset): DatasetConfig { id: 8a14c7e9-56e0-4799-8e15-60e12ce380ea (dataset), name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e0f1872-95ed-454c-9099-0d63844512c8 (dataset): DatasetConfig { id: 8e0f1872-95ed-454c-9099-0d63844512c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 91d963b4-c8d5-47d3-b564-48a8759c14ca (dataset): DatasetConfig { id: 91d963b4-c8d5-47d3-b564-48a8759c14ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 95de5799-495c-4870-ad91-21576cb55846 (dataset): DatasetConfig { id: 95de5799-495c-4870-ad91-21576cb55846 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9806f4fd-12ce-4691-ab1f-cc54f916b0ad (dataset): DatasetConfig { id: 9806f4fd-12ce-4691-ab1f-cc54f916b0ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 990e8ca5-3bd7-4734-86b8-c1404e73901a (dataset): DatasetConfig { id: 990e8ca5-3bd7-4734-86b8-c1404e73901a (dataset), name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d4d8f1c-1377-4dd6-b020-27049bc74f1d (dataset): DatasetConfig { id: 9d4d8f1c-1377-4dd6-b020-27049bc74f1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2220063-0d26-4403-8680-805c7af70fb0 (dataset): DatasetConfig { id: b2220063-0d26-4403-8680-805c7af70fb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b33ebe20-1b66-458f-8248-14f3d3bba9fc (dataset): DatasetConfig { id: b33ebe20-1b66-458f-8248-14f3d3bba9fc (dataset), name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b71e92ae-09af-4d12-9fd8-4c0d98f5db2f (dataset): DatasetConfig { id: b71e92ae-09af-4d12-9fd8-4c0d98f5db2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b85556b7-03ed-451b-afe6-58135598ee3d (dataset): DatasetConfig { id: b85556b7-03ed-451b-afe6-58135598ee3d (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcc295c3-b682-43cf-bf68-35f3a107444c (dataset): DatasetConfig { id: bcc295c3-b682-43cf-bf68-35f3a107444c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bebbb77a-137c-4405-8e83-dd225243c010 (dataset): DatasetConfig { id: bebbb77a-137c-4405-8e83-dd225243c010 (dataset), name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c081c270-0eb9-42a3-9ef9-bd5195918510 (dataset): DatasetConfig { id: c081c270-0eb9-42a3-9ef9-bd5195918510 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0d1db6b-e31d-4bfb-810a-b708c2c77510 (dataset): DatasetConfig { id: c0d1db6b-e31d-4bfb-810a-b708c2c77510 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3c6bbdc-28d4-4f42-8dd1-5f180c174207 (dataset): DatasetConfig { id: c3c6bbdc-28d4-4f42-8dd1-5f180c174207 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb2d5c17-9e2d-41f6-9ee1-416b80ba2ca6 (dataset): DatasetConfig { id: cb2d5c17-9e2d-41f6-9ee1-416b80ba2ca6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb5652a1-9779-464f-9981-71318bcd385c (dataset): DatasetConfig { id: cb5652a1-9779-464f-9981-71318bcd385c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d2aa03e4-9bd5-4f56-ab34-bf7e280d4956 (dataset): DatasetConfig { id: d2aa03e4-9bd5-4f56-ab34-bf7e280d4956 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d2ee6e47-1cf6-4203-93ec-9cc0c0315b70 (dataset): DatasetConfig { id: d2ee6e47-1cf6-4203-93ec-9cc0c0315b70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3a2c68c-64af-44fb-aac8-798ef6a37fc2 (dataset): DatasetConfig { id: d3a2c68c-64af-44fb-aac8-798ef6a37fc2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d41b323e-f92e-477f-b47d-b3e4b650ced0 (dataset): DatasetConfig { id: d41b323e-f92e-477f-b47d-b3e4b650ced0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5c3c087-1263-42ba-bc02-415e6897593f (dataset): DatasetConfig { id: d5c3c087-1263-42ba-bc02-415e6897593f (dataset), name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2396462-a14e-48c9-a2ca-3b9b67fe3136 (dataset): DatasetConfig { id: e2396462-a14e-48c9-a2ca-3b9b67fe3136 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e71c43e1-077d-4b47-b02e-ee11fa723f06 (dataset): DatasetConfig { id: e71c43e1-077d-4b47-b02e-ee11fa723f06 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ebac35d9-8600-49ac-b680-0f001210fb8e (dataset): DatasetConfig { id: ebac35d9-8600-49ac-b680-0f001210fb8e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6ce0c57-4436-4753-8434-48920a5511e9 (dataset): DatasetConfig { id: f6ce0c57-4436-4753-8434-48920a5511e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fae0160d-949b-4890-801b-3ac3646d9514 (dataset): DatasetConfig { id: fae0160d-949b-4890-801b-3ac3646d9514 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4452025-02-23T09:05:24.776ZINFOSledAgent (StorageManager): No ledger in /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462025-02-23T09:05:24.776ZINFOSledAgent (StorageManager): No ledger in /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-02-23T09:05:24.776ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4482025-02-23T09:05:24.792ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4492025-02-23T09:05:24.792ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4502025-02-23T09:05:24.792ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_32f1e829-361d-464b-83d6-3092853cc1e7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4512025-02-23T09:05:24.841ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522025-02-23T09:05:24.841ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532025-02-23T09:05:24.841ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/zone/oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4"), full_name: "oxp_52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/zone/oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4" } file = sled-storage/src/manager.rs:1431
4542025-02-23T09:05:24.901ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552025-02-23T09:05:24.901ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4562025-02-23T09:05:24.901ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4572025-02-23T09:05:24.948ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582025-02-23T09:05:24.948ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4592025-02-23T09:05:24.948ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone/oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4"), full_name: "oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone/oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4" } file = sled-storage/src/manager.rs:1431
4602025-02-23T09:05:25.006ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) file = sled-agent/src/probe_manager.rs:238 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
4612025-02-23T09:05:25.009ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-02-23T09:05:25.009ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-02-23T09:05:25.009ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone/oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b"), full_name: "oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone/oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b" } file = sled-storage/src/manager.rs:1431
4642025-02-23T09:05:25.068ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-02-23T09:05:25.068ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662025-02-23T09:05:25.068ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/32f1e829-361d-464b-83d6-3092853cc1e7/crypt/zone/oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff"), full_name: "oxp_32f1e829-361d-464b-83d6-3092853cc1e7/crypt/zone/oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff" } file = sled-storage/src/manager.rs:1431
4672025-02-23T09:05:25.128ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-02-23T09:05:25.128ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692025-02-23T09:05:25.128ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4702025-02-23T09:05:25.176ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-02-23T09:05:25.176ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4722025-02-23T09:05:25.176ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone"), full_name: "oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone" } file = sled-storage/src/manager.rs:1431
4732025-02-23T09:05:25.204ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-02-23T09:05:25.205ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4752025-02-23T09:05:25.205ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4762025-02-23T09:05:25.255ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-02-23T09:05:25.255ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-02-23T09:05:25.255ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b04b1013-1fd4-4342-9735-04e35a199534/crypt/zone/oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9"), full_name: "oxp_b04b1013-1fd4-4342-9735-04e35a199534/crypt/zone/oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9" } file = sled-storage/src/manager.rs:1431
4792025-02-23T09:05:25.314ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-02-23T09:05:25.314ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4812025-02-23T09:05:25.314ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9e960c69-de8b-458e-900f-827df5fd1555/crypt/zone"), full_name: "oxp_9e960c69-de8b-458e-900f-827df5fd1555/crypt/zone" } file = sled-storage/src/manager.rs:1431
4822025-02-23T09:05:25.343ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-02-23T09:05:25.343ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4842025-02-23T09:05:25.343ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9e960c69-de8b-458e-900f-827df5fd1555/crypt/zone/oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42"), full_name: "oxp_9e960c69-de8b-458e-900f-827df5fd1555/crypt/zone/oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42" } file = sled-storage/src/manager.rs:1431
4852025-02-23T09:05:25.401ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-02-23T09:05:25.401ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4872025-02-23T09:05:25.401ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7f9f3d10-8155-4511-8c83-34282eab634b/crypt/debug"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/debug" } file = sled-storage/src/manager.rs:1431
4882025-02-23T09:05:25.430ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-02-23T09:05:25.430ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902025-02-23T09:05:25.430ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7/crucible" } file = sled-storage/src/manager.rs:1431
4912025-02-23T09:05:25.477ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-02-23T09:05:25.477ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4932025-02-23T09:05:25.477ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/zone/oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3"), full_name: "oxp_52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/zone/oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3" } file = sled-storage/src/manager.rs:1431
4942025-02-23T09:05:25.535ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952025-02-23T09:05:25.535ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962025-02-23T09:05:25.535ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crucible" } file = sled-storage/src/manager.rs:1431
4972025-02-23T09:05:25.581ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982025-02-23T09:05:25.581ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992025-02-23T09:05:25.581ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5002025-02-23T09:05:25.630ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-02-23T09:05:25.630ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5022025-02-23T09:05:25.630ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_52c0a5e3-b03e-446e-9e20-336c4f905023/crucible" } file = sled-storage/src/manager.rs:1431
5032025-02-23T09:05:25.677ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-02-23T09:05:25.677ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052025-02-23T09:05:25.677ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone/oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone/oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47" } file = sled-storage/src/manager.rs:1431
5062025-02-23T09:05:25.736ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-02-23T09:05:25.736ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-02-23T09:05:25.736ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5092025-02-23T09:05:25.784ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-02-23T09:05:25.784ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5112025-02-23T09:05:25.784ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dd28684b-0582-4159-82e0-305747c1d637/crypt/zone"), full_name: "oxp_dd28684b-0582-4159-82e0-305747c1d637/crypt/zone" } file = sled-storage/src/manager.rs:1431
5122025-02-23T09:05:25.813ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-02-23T09:05:25.813ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142025-02-23T09:05:25.813ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/zone/oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee"), full_name: "oxp_52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/zone/oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee" } file = sled-storage/src/manager.rs:1431
5152025-02-23T09:05:25.873ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-02-23T09:05:25.873ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5172025-02-23T09:05:25.873ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone/oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44"), full_name: "oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone/oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44" } file = sled-storage/src/manager.rs:1431
5182025-02-23T09:05:25.936ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-02-23T09:05:25.936ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5202025-02-23T09:05:25.936ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone" } file = sled-storage/src/manager.rs:1431
5212025-02-23T09:05:25.966ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-02-23T09:05:25.966ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5232025-02-23T09:05:25.966ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/debug"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/debug" } file = sled-storage/src/manager.rs:1431
5242025-02-23T09:05:25.996ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-02-23T09:05:25.996ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262025-02-23T09:05:25.996ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/zone/oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14"), full_name: "oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/zone/oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14" } file = sled-storage/src/manager.rs:1431
5272025-02-23T09:05:26.008ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) file = sled-agent/src/probe_manager.rs:238 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
5282025-02-23T09:05:26.059ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-02-23T09:05:26.059ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5302025-02-23T09:05:26.059ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/32f1e829-361d-464b-83d6-3092853cc1e7/crypt/zone/oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df"), full_name: "oxp_32f1e829-361d-464b-83d6-3092853cc1e7/crypt/zone/oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df" } file = sled-storage/src/manager.rs:1431
5312025-02-23T09:05:26.116ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-02-23T09:05:26.116ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5332025-02-23T09:05:26.116ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone" } file = sled-storage/src/manager.rs:1431
5342025-02-23T09:05:26.146ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-02-23T09:05:26.146ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362025-02-23T09:05:26.146ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crucible" } file = sled-storage/src/manager.rs:1431
5372025-02-23T09:05:26.195ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-02-23T09:05:26.195ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392025-02-23T09:05:26.195ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone/oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone/oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95" } file = sled-storage/src/manager.rs:1431
5402025-02-23T09:05:26.255ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-02-23T09:05:26.255ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-02-23T09:05:26.255ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_32f1e829-361d-464b-83d6-3092853cc1e7/crucible" } file = sled-storage/src/manager.rs:1431
5432025-02-23T09:05:26.303ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-02-23T09:05:26.303ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452025-02-23T09:05:26.303ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone/oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone/oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45" } file = sled-storage/src/manager.rs:1431
5462025-02-23T09:05:26.364ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-02-23T09:05:26.364ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5482025-02-23T09:05:26.364ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/zone"), full_name: "oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/zone" } file = sled-storage/src/manager.rs:1431
5492025-02-23T09:05:26.393ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-02-23T09:05:26.393ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-02-23T09:05:26.393ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone/oxz_crucible_70464b9d-8658-401f-8157-5d899e662209"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone/oxz_crucible_70464b9d-8658-401f-8157-5d899e662209" } file = sled-storage/src/manager.rs:1431
5522025-02-23T09:05:26.454ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-02-23T09:05:26.454ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542025-02-23T09:05:26.454ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone/oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone/oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f" } file = sled-storage/src/manager.rs:1431
5552025-02-23T09:05:26.514ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-02-23T09:05:26.514ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5572025-02-23T09:05:26.514ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone/oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone/oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c" } file = sled-storage/src/manager.rs:1431
5582025-02-23T09:05:26.575ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-02-23T09:05:26.575ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602025-02-23T09:05:26.575ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone/oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1"), full_name: "oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/zone/oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1" } file = sled-storage/src/manager.rs:1431
5612025-02-23T09:05:26.638ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-02-23T09:05:26.638ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5632025-02-23T09:05:26.638ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b04b1013-1fd4-4342-9735-04e35a199534/crucible" } file = sled-storage/src/manager.rs:1431
5642025-02-23T09:05:26.688ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652025-02-23T09:05:26.688ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662025-02-23T09:05:26.688ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dd28684b-0582-4159-82e0-305747c1d637/crucible" } file = sled-storage/src/manager.rs:1431
5672025-02-23T09:05:26.736ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682025-02-23T09:05:26.736ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5692025-02-23T09:05:26.736ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dd28684b-0582-4159-82e0-305747c1d637/crypt/debug"), full_name: "oxp_dd28684b-0582-4159-82e0-305747c1d637/crypt/debug" } file = sled-storage/src/manager.rs:1431
5702025-02-23T09:05:26.766ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712025-02-23T09:05:26.766ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5722025-02-23T09:05:26.766ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/debug"), full_name: "oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/debug" } file = sled-storage/src/manager.rs:1431
5732025-02-23T09:05:26.797ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-02-23T09:05:26.797ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5752025-02-23T09:05:26.797ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/zone"), full_name: "oxp_52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/zone" } file = sled-storage/src/manager.rs:1431
5762025-02-23T09:05:26.827ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-02-23T09:05:26.827ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782025-02-23T09:05:26.827ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5792025-02-23T09:05:26.876ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-02-23T09:05:26.876ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5812025-02-23T09:05:26.876ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b04b1013-1fd4-4342-9735-04e35a199534/crypt/zone/oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9"), full_name: "oxp_b04b1013-1fd4-4342-9735-04e35a199534/crypt/zone/oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9" } file = sled-storage/src/manager.rs:1431
5822025-02-23T09:05:26.937ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-02-23T09:05:26.937ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5842025-02-23T09:05:26.937ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone/oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone/oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071" } file = sled-storage/src/manager.rs:1431
5852025-02-23T09:05:26.996ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-02-23T09:05:26.996ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5872025-02-23T09:05:26.996ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/32f1e829-361d-464b-83d6-3092853cc1e7/crypt/zone"), full_name: "oxp_32f1e829-361d-464b-83d6-3092853cc1e7/crypt/zone" } file = sled-storage/src/manager.rs:1431
5882025-02-23T09:05:27.011ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) file = sled-agent/src/probe_manager.rs:238 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
5892025-02-23T09:05:27.026ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-02-23T09:05:27.026ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912025-02-23T09:05:27.026ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dd28684b-0582-4159-82e0-305747c1d637/crypt/zone/oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca"), full_name: "oxp_dd28684b-0582-4159-82e0-305747c1d637/crypt/zone/oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca" } file = sled-storage/src/manager.rs:1431
5922025-02-23T09:05:27.085ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-02-23T09:05:27.085ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5942025-02-23T09:05:27.085ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/debug"), full_name: "oxp_52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/debug" } file = sled-storage/src/manager.rs:1431
5952025-02-23T09:05:27.116ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-02-23T09:05:27.116ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972025-02-23T09:05:27.116ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone/oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/zone/oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e" } file = sled-storage/src/manager.rs:1431
5982025-02-23T09:05:27.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-02-23T09:05:27.175ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6002025-02-23T09:05:27.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/debug"), full_name: "oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/debug" } file = sled-storage/src/manager.rs:1431
6012025-02-23T09:05:27.204ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-02-23T09:05:27.204ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6032025-02-23T09:05:27.204ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dd28684b-0582-4159-82e0-305747c1d637/crypt/zone/oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e"), full_name: "oxp_dd28684b-0582-4159-82e0-305747c1d637/crypt/zone/oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e" } file = sled-storage/src/manager.rs:1431
6042025-02-23T09:05:27.266ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-02-23T09:05:27.266ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-02-23T09:05:27.266ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9e960c69-de8b-458e-900f-827df5fd1555/crypt/zone/oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8"), full_name: "oxp_9e960c69-de8b-458e-900f-827df5fd1555/crypt/zone/oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8" } file = sled-storage/src/manager.rs:1431
6072025-02-23T09:05:27.326ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-02-23T09:05:27.326ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-02-23T09:05:27.326ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6102025-02-23T09:05:27.376ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-02-23T09:05:27.376ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-02-23T09:05:27.376ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6132025-02-23T09:05:27.427ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-02-23T09:05:27.427ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152025-02-23T09:05:27.427ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9e960c69-de8b-458e-900f-827df5fd1555/crucible" } file = sled-storage/src/manager.rs:1431
6162025-02-23T09:05:27.475ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-02-23T09:05:27.475ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182025-02-23T09:05:27.475ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone/oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone/oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc" } file = sled-storage/src/manager.rs:1431
6192025-02-23T09:05:27.536ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-02-23T09:05:27.536ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212025-02-23T09:05:27.536ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crucible" } file = sled-storage/src/manager.rs:1431
6222025-02-23T09:05:27.584ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-02-23T09:05:27.585ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242025-02-23T09:05:27.585ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone/oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/zone/oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1" } file = sled-storage/src/manager.rs:1431
6252025-02-23T09:05:27.644ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262025-02-23T09:05:27.644ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6272025-02-23T09:05:27.644ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b04b1013-1fd4-4342-9735-04e35a199534/crypt/debug"), full_name: "oxp_b04b1013-1fd4-4342-9735-04e35a199534/crypt/debug" } file = sled-storage/src/manager.rs:1431
6282025-02-23T09:05:27.673ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-02-23T09:05:27.673ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302025-02-23T09:05:27.673ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6312025-02-23T09:05:27.724ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-02-23T09:05:27.724ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6332025-02-23T09:05:27.724ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b04b1013-1fd4-4342-9735-04e35a199534/crypt/zone"), full_name: "oxp_b04b1013-1fd4-4342-9735-04e35a199534/crypt/zone" } file = sled-storage/src/manager.rs:1431
6342025-02-23T09:05:27.754ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-02-23T09:05:27.754ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6362025-02-23T09:05:27.754ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9e960c69-de8b-458e-900f-827df5fd1555/crypt/debug"), full_name: "oxp_9e960c69-de8b-458e-900f-827df5fd1555/crypt/debug" } file = sled-storage/src/manager.rs:1431
6372025-02-23T09:05:27.782ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-02-23T09:05:27.782ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392025-02-23T09:05:27.783ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9e960c69-de8b-458e-900f-827df5fd1555/crypt/zone/oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05"), full_name: "oxp_9e960c69-de8b-458e-900f-827df5fd1555/crypt/zone/oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05" } file = sled-storage/src/manager.rs:1431
6402025-02-23T09:05:27.845ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-02-23T09:05:27.845ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-02-23T09:05:27.845ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/zone/oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b"), full_name: "oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/zone/oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b" } file = sled-storage/src/manager.rs:1431
6432025-02-23T09:05:27.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-02-23T09:05:27.908ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452025-02-23T09:05:27.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6462025-02-23T09:05:27.958ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-02-23T09:05:27.958ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6482025-02-23T09:05:27.958ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/32f1e829-361d-464b-83d6-3092853cc1e7/crypt/debug"), full_name: "oxp_32f1e829-361d-464b-83d6-3092853cc1e7/crypt/debug" } file = sled-storage/src/manager.rs:1431
6492025-02-23T09:05:27.988ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6502025-02-23T09:05:27.988ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-02-23T09:05:27.988ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
6522025-02-23T09:05:27.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3212938 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41711 req_id = c7f0580f-a2e6-4bff-9958-d50d6d6bb9a3 response_code = 200 uri = /datasets
6532025-02-23T09:05:28.013ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) file = sled-agent/src/probe_manager.rs:238 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
6542025-02-23T09:05:28.021ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 54837768-c843-4ec9-bd3b-c9b189b1b07e (service), filesystem_pool: Some(ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4eed87a-fe22-4a1d-8d93-25bee968f9d1 (service), filesystem_pool: Some(ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: d681d220-bdd0-4ed7-bcd5-3445bfe35e44 (service), filesystem_pool: Some(ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6552025-02-23T09:05:28.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53963
6562025-02-23T09:05:28.021ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6572025-02-23T09:05:28.021ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582025-02-23T09:05:28.030ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592025-02-23T09:05:28.030ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602025-02-23T09:05:28.039ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612025-02-23T09:05:28.039ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622025-02-23T09:05:28.048ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6632025-02-23T09:05:28.048ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-zones.json file = common/src/ledger.rs:188
6642025-02-23T09:05:28.048ZINFOSledAgent (ServiceManager): No ledger in /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-02-23T09:05:28.048ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4918 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6662025-02-23T09:05:28.048ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-02-23T09:05:28.093ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-02-23T09:05:28.093ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-02-23T09:05:28.093ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-02-23T09:05:28.148ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e file = illumos-utils/src/zone.rs:325
6712025-02-23T09:05:28.151ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1 file = illumos-utils/src/zone.rs:325
6722025-02-23T09:05:28.155ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44 file = illumos-utils/src/zone.rs:325
6732025-02-23T09:05:28.168ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e file = illumos-utils/src/zone.rs:363
6742025-02-23T09:05:28.172ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1 file = illumos-utils/src/zone.rs:363
6752025-02-23T09:05:28.176ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44 file = illumos-utils/src/zone.rs:363
6762025-02-23T09:05:29.015ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) file = sled-agent/src/probe_manager.rs:238 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
6772025-02-23T09:05:29.906ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782025-02-23T09:05:29.906ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6792025-02-23T09:05:29.907ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44
6802025-02-23T09:05:30.397ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812025-02-23T09:05:30.833ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4389336623993297407 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
6822025-02-23T09:05:30.833ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5565372494966967925 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
6832025-02-23T09:05:30.879ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6842025-02-23T09:05:30.879ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852025-02-23T09:05:30.886ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44") failed: Property not found. retry in 39.434272ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44
6862025-02-23T09:05:30.886ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6872025-02-23T09:05:30.886ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
6882025-02-23T09:05:30.891ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1
6892025-02-23T09:05:30.936ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44") failed: Property not found. retry in 97.555787ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44
6902025-02-23T09:05:31.015ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e") failed: Property not found. retry in 73.837745ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
6912025-02-23T09:05:31.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1") failed: Property not found. retry in 72.46ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1
6922025-02-23T09:05:31.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44") failed: Property not found. retry in 182.493607ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44
6932025-02-23T09:05:31.179ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e") failed: Property not found. retry in 76.225438ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
6942025-02-23T09:05:31.191ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1") failed: Property not found. retry in 110.325899ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1
6952025-02-23T09:05:31.211ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4363
6962025-02-23T09:05:31.211ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4373 gateway = fd00:1122:3344:101::1
6972025-02-23T09:05:31.223ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4387 gateway = fd00:1122:3344:101::1
6982025-02-23T09:05:31.223ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4452
6992025-02-23T09:05:31.252ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44") failed: Property not found. retry in 387.434921ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44
7002025-02-23T09:05:31.293ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e") failed: Property not found. retry in 190.173688ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
7012025-02-23T09:05:31.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1") failed: Property not found. retry in 152.476588ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1
7022025-02-23T09:05:31.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e") failed: Property not found. retry in 300.804479ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
7032025-02-23T09:05:31.538ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1") failed: Property not found. retry in 306.929527ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1
7042025-02-23T09:05:31.619ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4493
7052025-02-23T09:05:31.619ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4520
7062025-02-23T09:05:31.654ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44") failed: Property not found. retry in 933.583577ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44
7072025-02-23T09:05:31.680ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4533
7082025-02-23T09:05:31.680ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4404
7092025-02-23T09:05:31.741ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4446
7102025-02-23T09:05:31.741ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4500 rack_subnet = fd00:1122:3344::
7112025-02-23T09:05:31.765ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4511
7122025-02-23T09:05:31.765ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4584
7132025-02-23T09:05:31.781ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
7142025-02-23T09:05:31.781ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
7152025-02-23T09:05:31.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e") failed: Property not found. retry in 931.966211ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
7162025-02-23T09:05:31.847ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4616
7172025-02-23T09:05:31.847ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4622
7182025-02-23T09:05:31.851ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1") failed: Property not found. retry in 1.073507215s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1
7192025-02-23T09:05:31.940ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4663
7202025-02-23T09:05:31.940ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4536
7212025-02-23T09:05:32.039ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4569
7222025-02-23T09:05:32.039ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7232025-02-23T09:05:32.072ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b) file = sled-agent/src/nexus.rs:530 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
7242025-02-23T09:05:32.073ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7252025-02-23T09:05:32.105ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7262025-02-23T09:05:32.105ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7272025-02-23T09:05:32.106ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7282025-02-23T09:05:32.106ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7292025-02-23T09:05:32.146ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
7302025-02-23T09:05:32.198ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7312025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7322025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7332025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7342025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7352025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7362025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7372025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7382025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7392025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7402025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7412025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7422025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7432025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7442025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7452025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7462025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7472025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7482025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7492025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7502025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7512025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7522025-02-23T09:05:32.199ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7532025-02-23T09:05:32.599ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44") failed: Property not found. retry in 1.178082367s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44
7542025-02-23T09:05:32.769ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e") failed: Property not found. retry in 922.993602ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
7552025-02-23T09:05:32.936ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1") failed: Property not found. retry in 1.357050313s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1
7562025-02-23T09:05:33.701ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e") failed: Property not found. retry in 1.05757185s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
7572025-02-23T09:05:33.785ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44") failed: Property not found. retry in 1.45087406s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44
7582025-02-23T09:05:34.301ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1") failed: Property not found. retry in 508.358095ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1
7592025-02-23T09:05:34.767ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e") failed: Property not found. retry in 1.112184269s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
7602025-02-23T09:05:34.820ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1") failed: Property not found. retry in 1.253232613s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1
7612025-02-23T09:05:35.246ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44") failed: Property not found. retry in 1.392214433s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44
7622025-02-23T09:05:35.892ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e") failed: Property not found. retry in 611.437715ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
7632025-02-23T09:05:36.657ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_internal_dns_54837768-c843-4ec9-bd3b-c9b189b1b07e
7642025-02-23T09:05:36.657ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_internal_dns_a4eed87a-fe22-4a1d-8d93-25bee968f9d1
7652025-02-23T09:05:36.657ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_internal_dns_d681d220-bdd0-4ed7-bcd5-3445bfe35e44
7662025-02-23T09:05:36.657ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672025-02-23T09:05:36.657ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682025-02-23T09:05:36.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8636328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53963 req_id = e6f5f4df-cddf-4b2a-8ae0-b476dad31ae5 response_code = 204 uri = /omicron-zones
7692025-02-23T09:05:36.659ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702025-02-23T09:05:36.878ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 79.058178ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7712025-02-23T09:05:36.976ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722025-02-23T09:05:37.022ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732025-02-23T09:05:37.077ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7742025-02-23T09:05:37.077ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7752025-02-23T09:05:37.108ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7762025-02-23T09:05:37.109ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7772025-02-23T09:05:37.109ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7782025-02-23T09:05:37.139ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 54837768-c843-4ec9-bd3b-c9b189b1b07e (service), filesystem_pool: Some(ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4eed87a-fe22-4a1d-8d93-25bee968f9d1 (service), filesystem_pool: Some(ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: d681d220-bdd0-4ed7-bcd5-3445bfe35e44 (service), filesystem_pool: Some(ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f1ab904-d03a-4587-b425-904f2d0e950b (service), filesystem_pool: Some(ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 243f288a-7a0d-4875-b9a9-69ce1d872f9e, kind: Service { id: 4f1ab904-d03a-4587-b425-904f2d0e950b }, name: Name("ntp-4f1ab904-d03a-4587-b425-904f2d0e950b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 238])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7792025-02-23T09:05:37.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47310
7802025-02-23T09:05:37.139ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812025-02-23T09:05:37.139ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822025-02-23T09:05:37.151ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-02-23T09:05:37.151ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-02-23T09:05:37.162ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-02-23T09:05:37.162ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-02-23T09:05:37.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872025-02-23T09:05:37.171ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-zones.json file = common/src/ledger.rs:177
7882025-02-23T09:05:37.171ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-zones.json file = common/src/ledger.rs:177
7892025-02-23T09:05:37.171ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4918 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7902025-02-23T09:05:37.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7912025-02-23T09:05:37.182ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7922025-02-23T09:05:37.215ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7932025-02-23T09:05:37.215ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7942025-02-23T09:05:37.215ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7952025-02-23T09:05:37.245ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 215, 238]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7962025-02-23T09:05:37.245ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1320 zone_type = boundary_ntp
7972025-02-23T09:05:37.246ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7982025-02-23T09:05:37.246ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7992025-02-23T09:05:37.246ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8002025-02-23T09:05:37.248ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8012025-02-23T09:05:37.270ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b file = illumos-utils/src/zone.rs:325
8022025-02-23T09:05:37.289ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b file = illumos-utils/src/zone.rs:363
8032025-02-23T09:05:37.943ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8042025-02-23T09:05:37.943ZINFOSledAgent (ServiceManager): Booting oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8052025-02-23T09:05:38.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b") failed: Property not found. retry in 73.846192ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8062025-02-23T09:05:38.155ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b") failed: Property not found. retry in 67.350319ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8072025-02-23T09:05:38.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b") failed: Property not found. retry in 136.471181ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8082025-02-23T09:05:38.381ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b") failed: Property not found. retry in 455.55732ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8092025-02-23T09:05:38.845ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b") failed: Property not found. retry in 872.918558ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8102025-02-23T09:05:39.728ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b") failed: Property not found. retry in 505.676517ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8112025-02-23T09:05:40.244ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b") failed: Property not found. retry in 1.125547838s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8122025-02-23T09:05:40.835ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4389336623993297407 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8132025-02-23T09:05:40.835ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5565372494966967925 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8142025-02-23T09:05:41.379ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b") failed: Property not found. retry in 781.479536ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8152025-02-23T09:05:41.783ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8162025-02-23T09:05:41.784ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8172025-02-23T09:05:42.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b") failed: Property not found. retry in 1.12529707s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8182025-02-23T09:05:43.316ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b
8192025-02-23T09:05:43.316ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8202025-02-23T09:05:43.316ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8212025-02-23T09:05:43.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6177104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47310 req_id = bd6714ba-cdd8-46dd-ba57-81441300e009 response_code = 204 uri = /omicron-zones
8222025-02-23T09:05:43.319ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8232025-02-23T09:05:43.351ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8242025-02-23T09:05:43.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42185
8252025-02-23T09:05:43.360ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3971
8262025-02-23T09:05:43.360ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 9209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42185 req_id = 0d0aee38-19c5-482b-a20c-89c7981a2776 response_code = 500 uri = /timesync
8272025-02-23T09:05:43.363ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8282025-02-23T09:05:43.494ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8292025-02-23T09:05:43.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34033
8302025-02-23T09:05:46.106ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 160710331282159437 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8312025-02-23T09:05:46.527ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13194955994800973285 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8322025-02-23T09:05:46.658ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18437753839839851264 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8332025-02-23T09:05:47.502ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3971
8342025-02-23T09:05:47.502ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008369 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34033 req_id = 944d8e88-f714-412b-a848-d2dc6ebcf384 response_code = 500 uri = /timesync
8352025-02-23T09:05:47.505ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362025-02-23T09:05:47.646ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8372025-02-23T09:05:47.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63389
8382025-02-23T09:05:47.655ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3971
8392025-02-23T09:05:47.655ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 9021 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63389 req_id = 61be0485-e671-4cef-9daf-b21b0e19d31d response_code = 500 uri = /timesync
8402025-02-23T09:05:47.659ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8412025-02-23T09:05:47.891ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8422025-02-23T09:05:47.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39218
8432025-02-23T09:05:47.899ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_4f1ab904-d03a-4587-b425-904f2d0e950b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3971
8442025-02-23T09:05:47.899ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 8389 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39218 req_id = ac7357e9-b340-49da-8b79-3695ce6ecaf9 response_code = 500 uri = /timesync
8452025-02-23T09:05:47.901ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8462025-02-23T09:05:48.025ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472025-02-23T09:05:48.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43580
8482025-02-23T09:05:50.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009347 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43580 req_id = 3fa2dec7-8ad9-413a-802c-b0cd7c173b35 response_code = 200 uri = /timesync
8492025-02-23T09:05:50.037ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8502025-02-23T09:05:50.037ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512025-02-23T09:05:50.351ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8522025-02-23T09:05:50.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37563
8532025-02-23T09:05:50.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37563 req_id = 34f70b98-2f22-49ab-b193-659943ead164 response_code = 200 uri = /timesync
8542025-02-23T09:05:50.364ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8552025-02-23T09:05:50.364ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8562025-02-23T09:05:50.561ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572025-02-23T09:05:50.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52917
8582025-02-23T09:05:50.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8940 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52917 req_id = 018b7866-7789-496f-a77f-47760d9e6afa response_code = 200 uri = /timesync
8592025-02-23T09:05:50.573ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8602025-02-23T09:05:50.573ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612025-02-23T09:05:50.838ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4389336623993297407 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8622025-02-23T09:05:50.838ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5565372494966967925 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8632025-02-23T09:05:50.916ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642025-02-23T09:05:50.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65473
8652025-02-23T09:05:50.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8477 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65473 req_id = 4a549698-424e-4ec6-b338-311da41cec30 response_code = 200 uri = /timesync
8662025-02-23T09:05:50.927ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8672025-02-23T09:05:50.927ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682025-02-23T09:05:52.364ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692025-02-23T09:05:52.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59887
8702025-02-23T09:05:52.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8780 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59887 req_id = 2a3324ad-457f-4d73-8c87-368fccff312b response_code = 200 uri = /timesync
8712025-02-23T09:05:52.375ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8722025-02-23T09:05:52.375ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732025-02-23T09:05:52.709ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8742025-02-23T09:05:52.709ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8752025-02-23T09:05:53.004ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8762025-02-23T09:05:53.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34791
8772025-02-23T09:05:53.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34791 req_id = 10455c72-ed85-4a30-b451-cc83ccae41ea response_code = 200 uri = /timesync
8782025-02-23T09:05:53.001ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8792025-02-23T09:05:53.001ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802025-02-23T09:05:53.675ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812025-02-23T09:05:53.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47444
8822025-02-23T09:05:53.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8755 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47444 req_id = a9e3d81b-ff76-400f-a3c3-b40166bcd3c0 response_code = 200 uri = /timesync
8832025-02-23T09:05:53.686ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8842025-02-23T09:05:53.686ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852025-02-23T09:05:54.218ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5196273294890166826 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8862025-02-23T09:05:54.218ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8545082169909195280 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
8872025-02-23T09:05:54.270ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8882025-02-23T09:05:54.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57190
8892025-02-23T09:05:54.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8544 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57190 req_id = f9f6fb07-f421-49e7-b466-7ca2edd3d1e4 response_code = 200 uri = /timesync
8902025-02-23T09:05:54.282ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740301552.482295, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8912025-02-23T09:05:54.282ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8922025-02-23T09:05:54.962ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8932025-02-23T09:05:54.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49427
8942025-02-23T09:05:54.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49427 req_id = 5028d41f-ae66-4041-8135-59b5bd002b90 response_code = 200 uri = /timesync
8952025-02-23T09:05:54.975ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740301552.482295, correction: 0.220794499 } file = sled-agent/src/rack_setup/service.rs:743
8962025-02-23T09:05:54.975ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8972025-02-23T09:05:55.634ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8982025-02-23T09:05:55.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43538
8992025-02-23T09:05:55.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8465 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43538 req_id = 3f69b78d-d901-48f6-b6aa-55059012ad96 response_code = 200 uri = /timesync
9002025-02-23T09:05:55.645ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740301552.482295, correction: 0.218980134 } file = sled-agent/src/rack_setup/service.rs:743
9012025-02-23T09:05:55.645ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9022025-02-23T09:05:56.361ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9032025-02-23T09:05:56.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64846
9042025-02-23T09:05:56.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9462 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64846 req_id = d48c50d4-2c78-4b8e-bcdf-1abca62baf51 response_code = 200 uri = /timesync
9052025-02-23T09:05:56.373ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740301552.482295, correction: 0.219379112 } file = sled-agent/src/rack_setup/service.rs:743
9062025-02-23T09:05:56.373ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9072025-02-23T09:05:57.010ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 160710331282159437 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9082025-02-23T09:05:57.433ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13194955994800973285 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9092025-02-23T09:05:57.565ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18437753839839851264 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9102025-02-23T09:05:58.166ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9112025-02-23T09:05:58.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45461
9122025-02-23T09:05:58.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9013 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45461 req_id = a72883da-0905-4d61-bb4a-d1dc866de3e9 response_code = 200 uri = /timesync
9132025-02-23T09:05:58.178ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301557.6180935, correction: 0.204743788 } file = sled-agent/src/rack_setup/service.rs:743
9142025-02-23T09:05:58.178ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9152025-02-23T09:05:59.160ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9162025-02-23T09:05:59.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35528
9172025-02-23T09:05:59.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8630 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35528 req_id = df622d28-63f1-4fd2-981f-298c8ef5822e response_code = 200 uri = /timesync
9182025-02-23T09:05:59.171ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301559.1682878, correction: 0.201115772 } file = sled-agent/src/rack_setup/service.rs:743
9192025-02-23T09:05:59.171ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9202025-02-23T09:05:59.773ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 224.753474ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9212025-02-23T09:06:00.140ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9222025-02-23T09:06:00.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42795
9232025-02-23T09:06:00.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8714 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42795 req_id = e661a309-e493-453e-b8a5-4dcf008627c4 response_code = 200 uri = /timesync
9242025-02-23T09:06:00.152ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301559.1682878, correction: 0.198467612 } file = sled-agent/src/rack_setup/service.rs:743
9252025-02-23T09:06:00.152ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9262025-02-23T09:06:01.755ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4389336623993297407 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9272025-02-23T09:06:01.755ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5565372494966967925 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9282025-02-23T09:06:02.456ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65273
9292025-02-23T09:06:02.456ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65273 req_id = cbb41174-6e72-44a2-85f6-d56cf3411fdb response_code = 200 uri = /baseboard
9302025-02-23T09:06:02.706ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9312025-02-23T09:06:02.706ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9322025-02-23T09:06:03.362ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9332025-02-23T09:06:03.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64769
9342025-02-23T09:06:03.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8551 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64769 req_id = 4ce726f6-bd60-4aa8-a1f0-e45c387d7125 response_code = 200 uri = /timesync
9352025-02-23T09:06:03.374ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301562.5377586, correction: 0.189814061 } file = sled-agent/src/rack_setup/service.rs:743
9362025-02-23T09:06:03.374ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9372025-02-23T09:06:04.245ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5196273294890166826 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9382025-02-23T09:06:04.245ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8545082169909195280 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9392025-02-23T09:06:05.866ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9402025-02-23T09:06:05.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37688
9412025-02-23T09:06:05.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37688 req_id = 8f499c5c-e2bc-4b74-802a-6c975aaf0336 response_code = 200 uri = /timesync
9422025-02-23T09:06:05.877ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301564.4538467, correction: 0.183144033 } file = sled-agent/src/rack_setup/service.rs:743
9432025-02-23T09:06:05.877ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9442025-02-23T09:06:07.040ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 160710331282159437 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9452025-02-23T09:06:07.461ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13194955994800973285 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9462025-02-23T09:06:07.592ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18437753839839851264 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9472025-02-23T09:06:10.307ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9482025-02-23T09:06:10.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43375
9492025-02-23T09:06:10.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43375 req_id = 299a015e-1a76-47fe-ab9c-3e01dd332d45 response_code = 200 uri = /timesync
9502025-02-23T09:06:10.321ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301569.4891052, correction: 0.17117618 } file = sled-agent/src/rack_setup/service.rs:743
9512025-02-23T09:06:10.321ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9522025-02-23T09:06:11.785ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4389336623993297407 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9532025-02-23T09:06:11.785ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5565372494966967925 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9542025-02-23T09:06:12.735ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9552025-02-23T09:06:12.735ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9562025-02-23T09:06:14.275ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5196273294890166826 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9572025-02-23T09:06:14.275ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8545082169909195280 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9582025-02-23T09:06:15.076ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 440.49174ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9592025-02-23T09:06:15.850ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9602025-02-23T09:06:15.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51813
9612025-02-23T09:06:15.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51813 req_id = ac45b2b4-f020-4cca-9822-6edcd18d6165 response_code = 200 uri = /timesync
9622025-02-23T09:06:15.862ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301574.6164663, correction: 0.156226993 } file = sled-agent/src/rack_setup/service.rs:743
9632025-02-23T09:06:15.862ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9642025-02-23T09:06:17.069ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 160710331282159437 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9652025-02-23T09:06:17.490ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13194955994800973285 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9662025-02-23T09:06:17.621ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18437753839839851264 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9672025-02-23T09:06:18.238ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9682025-02-23T09:06:18.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58746
9692025-02-23T09:06:18.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9025 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58746 req_id = e31c2d6e-419f-4ce9-9668-7e97d21eb84e response_code = 200 uri = /timesync
9702025-02-23T09:06:18.250ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301575.587953, correction: 0.149766281 } file = sled-agent/src/rack_setup/service.rs:743
9712025-02-23T09:06:18.250ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9722025-02-23T09:06:21.051ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9732025-02-23T09:06:21.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58557
9742025-02-23T09:06:21.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8962 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58557 req_id = bd69aaa5-b4a9-4b20-b980-6696592edec5 response_code = 200 uri = /timesync
9752025-02-23T09:06:21.064ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301579.8983808, correction: 0.142167673 } file = sled-agent/src/rack_setup/service.rs:743
9762025-02-23T09:06:21.064ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9772025-02-23T09:06:21.814ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4389336623993297407 reason = Duration(60s) sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9782025-02-23T09:06:21.815ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5565372494966967925 reason = Duration(60s) sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9792025-02-23T09:06:22.765ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9802025-02-23T09:06:22.765ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9812025-02-23T09:06:24.303ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5196273294890166826 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9822025-02-23T09:06:24.304ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8545082169909195280 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9832025-02-23T09:06:27.098ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 160710331282159437 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9842025-02-23T09:06:27.519ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13194955994800973285 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9852025-02-23T09:06:27.649ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18437753839839851264 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9862025-02-23T09:06:28.073ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9872025-02-23T09:06:28.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47671
9882025-02-23T09:06:28.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9389 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47671 req_id = 6a242bb5-0ab3-44d1-b929-254869c1fc71 response_code = 200 uri = /timesync
9892025-02-23T09:06:28.085ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301586.5633364, correction: 0.123176582 } file = sled-agent/src/rack_setup/service.rs:743
9902025-02-23T09:06:28.085ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9912025-02-23T09:06:30.595ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 818.398391ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9922025-02-23T09:06:32.574ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47142
9932025-02-23T09:06:32.574ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47142 req_id = 245c2c46-50eb-495b-8416-1a9709658f1b response_code = 200 uri = /baseboard
9942025-02-23T09:06:32.794ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9952025-02-23T09:06:32.794ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
9962025-02-23T09:06:33.720ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9972025-02-23T09:06:33.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52840
9982025-02-23T09:06:33.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52840 req_id = 0e91ad33-41e8-4720-b146-ce5f205e8eb9 response_code = 200 uri = /timesync
9992025-02-23T09:06:33.732ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301591.832832, correction: 0.107919544 } file = sled-agent/src/rack_setup/service.rs:743
10002025-02-23T09:06:33.732ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10012025-02-23T09:06:34.332ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5196273294890166826 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10022025-02-23T09:06:34.333ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8545082169909195280 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10032025-02-23T09:06:37.127ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 160710331282159437 reason = Duration(60s) sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10042025-02-23T09:06:37.547ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13194955994800973285 reason = Duration(60s) sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10052025-02-23T09:06:37.678ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 18437753839839851264 reason = Duration(60s) sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10062025-02-23T09:06:40.959ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10072025-02-23T09:06:40.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62428
10082025-02-23T09:06:40.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9054 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62428 req_id = e4751521-23f1-42a4-bcd9-d5f69ada5af5 response_code = 200 uri = /timesync
10092025-02-23T09:06:40.971ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301599.927776, correction: 0.088356823 } file = sled-agent/src/rack_setup/service.rs:743
10102025-02-23T09:06:40.971ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10112025-02-23T09:06:42.823ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10122025-02-23T09:06:42.824ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10132025-02-23T09:06:44.362ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5196273294890166826 reason = Duration(60s) sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10142025-02-23T09:06:44.363ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8545082169909195280 reason = Duration(60s) sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10152025-02-23T09:06:46.490ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.352230569s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10162025-02-23T09:06:47.400ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10172025-02-23T09:06:47.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46675
10182025-02-23T09:06:47.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8814 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46675 req_id = 3ac13b36-9409-4435-b891-e646d9a95c9c response_code = 200 uri = /timesync
10192025-02-23T09:06:47.412ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301604.781061, correction: 0.071053505 } file = sled-agent/src/rack_setup/service.rs:743
10202025-02-23T09:06:47.413ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10212025-02-23T09:06:52.853ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10222025-02-23T09:06:52.853ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10232025-02-23T09:07:02.688ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39646
10242025-02-23T09:07:02.688ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39646 req_id = 0d5a6e41-4518-46a7-a76b-c5b29af954c5 response_code = 200 uri = /baseboard
10252025-02-23T09:07:02.882ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16298968003135171180 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10262025-02-23T09:07:02.882ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3450626838468215985 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10272025-02-23T09:07:02.922ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.258147929s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10282025-02-23T09:07:06.835ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10292025-02-23T09:07:06.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41993
10302025-02-23T09:07:06.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 23109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41993 req_id = b0f76a18-ea14-4617-b651-8339c94b501a response_code = 200 uri = /timesync
10312025-02-23T09:07:06.858ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-23T09:06:37.127815773Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 160710331282159437 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10322025-02-23T09:07:06.860ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-23T09:06:21.814723486Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4389336623993297407 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10332025-02-23T09:07:06.860ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-23T09:06:21.815239431Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5565372494966967925 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10342025-02-23T09:07:06.861ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-23T09:06:37.678479895Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 18437753839839851264 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10352025-02-23T09:07:06.861ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-23T09:06:37.547689339Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13194955994800973285 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10362025-02-23T09:07:06.861ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-23T09:06:44.363035801Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8545082169909195280 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10372025-02-23T09:07:06.862ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-23T09:06:44.362548143Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5196273294890166826 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
10382025-02-23T09:07:06.863ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1740301624.3245647, correction: 0.019479299 } file = sled-agent/src/rack_setup/service.rs:743
10392025-02-23T09:07:06.863ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1378
10402025-02-23T09:07:06.893ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 54837768-c843-4ec9-bd3b-c9b189b1b07e (service), filesystem_pool: Some(ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4eed87a-fe22-4a1d-8d93-25bee968f9d1 (service), filesystem_pool: Some(ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: d681d220-bdd0-4ed7-bcd5-3445bfe35e44 (service), filesystem_pool: Some(ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f1ab904-d03a-4587-b425-904f2d0e950b (service), filesystem_pool: Some(ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 243f288a-7a0d-4875-b9a9-69ce1d872f9e, kind: Service { id: 4f1ab904-d03a-4587-b425-904f2d0e950b }, name: Name("ntp-4f1ab904-d03a-4587-b425-904f2d0e950b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 238])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2e471dc2-b534-4cc3-ac13-b8bb43941a47 (service), filesystem_pool: Some(ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37070eb1-4c3b-4d4f-b73e-57d181194c5f (service), filesystem_pool: Some(ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ca42af1c-1014-4024-96e2-eac140d8a0d4 (service), filesystem_pool: Some(ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 14839530-e21c-483a-917b-beebc2b467df (service), filesystem_pool: Some(ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a54b0b48-8807-449a-ac1c-29440f35ca14 (service), filesystem_pool: Some(ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10412025-02-23T09:07:06.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60750
10422025-02-23T09:07:06.893ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10432025-02-23T09:07:06.893ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10442025-02-23T09:07:06.906ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10452025-02-23T09:07:06.906ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: InternalDns }, responder: ... }
10462025-02-23T09:07:06.917ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10472025-02-23T09:07:06.917ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: InternalDns }, responder: ... }
10482025-02-23T09:07:06.926ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10492025-02-23T09:07:06.926ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10502025-02-23T09:07:06.935ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10512025-02-23T09:07:06.935ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10522025-02-23T09:07:06.945ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10532025-02-23T09:07:06.945ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Cockroach }, responder: ... }
10542025-02-23T09:07:06.953ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10552025-02-23T09:07:06.953ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10562025-02-23T09:07:06.963ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10572025-02-23T09:07:06.963ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10582025-02-23T09:07:06.972ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10592025-02-23T09:07:06.972ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-zones.json file = common/src/ledger.rs:177
10602025-02-23T09:07:06.972ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-zones.json file = common/src/ledger.rs:177
10612025-02-23T09:07:06.973ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4918 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
10622025-02-23T09:07:06.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10632025-02-23T09:07:07.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10642025-02-23T09:07:07.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10652025-02-23T09:07:07.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10662025-02-23T09:07:07.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10672025-02-23T09:07:07.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10682025-02-23T09:07:07.149ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f file = illumos-utils/src/zone.rs:325
10692025-02-23T09:07:07.153ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df file = illumos-utils/src/zone.rs:325
10702025-02-23T09:07:07.158ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4 file = illumos-utils/src/zone.rs:325
10712025-02-23T09:07:07.162ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14 file = illumos-utils/src/zone.rs:325
10722025-02-23T09:07:07.167ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47 file = illumos-utils/src/zone.rs:325
10732025-02-23T09:07:07.172ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f file = illumos-utils/src/zone.rs:363
10742025-02-23T09:07:07.176ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df file = illumos-utils/src/zone.rs:363
10752025-02-23T09:07:07.181ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4 file = illumos-utils/src/zone.rs:363
10762025-02-23T09:07:07.186ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14 file = illumos-utils/src/zone.rs:363
10772025-02-23T09:07:07.191ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47 file = illumos-utils/src/zone.rs:363
10782025-02-23T09:07:11.126ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a54b0b48-8807-449a-ac1c-29440f35ca14'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10792025-02-23T09:07:11.126ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
10802025-02-23T09:07:11.172ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='37070eb1-4c3b-4d4f-b73e-57d181194c5f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10812025-02-23T09:07:11.172ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
10822025-02-23T09:07:11.187ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='14839530-e21c-483a-917b-beebc2b467df'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10832025-02-23T09:07:11.188ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
10842025-02-23T09:07:11.212ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2e471dc2-b534-4cc3-ac13-b8bb43941a47'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10852025-02-23T09:07:11.212ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
10862025-02-23T09:07:11.229ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ca42af1c-1014-4024-96e2-eac140d8a0d4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10872025-02-23T09:07:11.229ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
10882025-02-23T09:07:11.284ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 40.423029ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
10892025-02-23T09:07:11.321ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 66.846212ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
10902025-02-23T09:07:11.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 92.971188ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
10912025-02-23T09:07:11.342ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 35.19618ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
10922025-02-23T09:07:11.351ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 68.542927ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
10932025-02-23T09:07:11.367ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 49.475492ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
10942025-02-23T09:07:11.390ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 145.741758ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
10952025-02-23T09:07:11.417ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 142.512805ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
10962025-02-23T09:07:11.612ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 85.510461ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
10972025-02-23T09:07:11.776ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 266.757356ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
10982025-02-23T09:07:11.794ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 137.876752ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
10992025-02-23T09:07:11.817ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 118.781772ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11002025-02-23T09:07:11.838ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 64.586594ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11012025-02-23T09:07:11.851ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 281.580427ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11022025-02-23T09:07:11.916ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 233.829672ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11032025-02-23T09:07:11.943ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 273.52389ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11042025-02-23T09:07:11.951ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 491.103641ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11052025-02-23T09:07:12.058ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 447.133117ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11062025-02-23T09:07:12.145ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 313.132108ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11072025-02-23T09:07:12.162ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 363.629071ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11082025-02-23T09:07:12.228ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 400.497353ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11092025-02-23T09:07:12.456ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 528.9513ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11102025-02-23T09:07:12.469ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 418.095777ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11112025-02-23T09:07:12.516ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 1.146703695s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11122025-02-23T09:07:12.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 447.973534ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11132025-02-23T09:07:12.642ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 612.18459ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11142025-02-23T09:07:12.898ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 1.049845737s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11152025-02-23T09:07:12.993ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 570.897908ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11162025-02-23T09:07:13.001ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 1.483835241s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11172025-02-23T09:07:13.265ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 1.447828042s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11182025-02-23T09:07:13.578ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 1.095948277s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11192025-02-23T09:07:13.678ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 750.985439ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11202025-02-23T09:07:13.960ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 650.118182ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11212025-02-23T09:07:14.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 1.208412904s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11222025-02-23T09:07:14.497ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 846.60333ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11232025-02-23T09:07:14.619ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 881.227352ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11242025-02-23T09:07:14.684ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 1.00521776s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11252025-02-23T09:07:14.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 1.119057287s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11262025-02-23T09:07:15.355ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 1.143588928s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11272025-02-23T09:07:15.511ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 1.009847164s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11282025-02-23T09:07:15.657ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 1.417678573s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11292025-02-23T09:07:15.699ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 1.390813013s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11302025-02-23T09:07:15.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 564.77025ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11312025-02-23T09:07:16.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 754.16224ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11322025-02-23T09:07:16.511ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 805.32503ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11332025-02-23T09:07:16.532ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 1.291598467s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11342025-02-23T09:07:17.086ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 531.914927ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11352025-02-23T09:07:17.100ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 833.505213ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11362025-02-23T09:07:17.191ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 993.997738ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11372025-02-23T09:07:17.327ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 873.988231ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11382025-02-23T09:07:17.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 546.406641ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11392025-02-23T09:07:17.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 1.173648195s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11402025-02-23T09:07:17.943ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 1.265980892s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11412025-02-23T09:07:18.186ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 596.632604ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11422025-02-23T09:07:18.194ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 588.929585ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11432025-02-23T09:07:18.211ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 1.491421187s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11442025-02-23T09:07:18.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 946.363771ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11452025-02-23T09:07:18.800ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 1.383591448s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11462025-02-23T09:07:19.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 1.321084002s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11472025-02-23T09:07:19.218ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 684.563829ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11482025-02-23T09:07:19.713ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 534.419471ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11492025-02-23T09:07:19.748ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 639.579965ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11502025-02-23T09:07:19.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 640.729955ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11512025-02-23T09:07:20.194ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df") failed: Property not found. retry in 1.156727432s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11522025-02-23T09:07:20.248ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.093545728s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
11532025-02-23T09:07:20.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14") failed: Property not found. retry in 1.234028823s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11542025-02-23T09:07:20.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4") failed: Property not found. retry in 1.483061983s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11552025-02-23T09:07:20.398ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f") failed: Property not found. retry in 835.792511ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11562025-02-23T09:07:20.563ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47") failed: Property not found. retry in 1.330732119s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11572025-02-23T09:07:21.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_cockroachdb_37070eb1-4c3b-4d4f-b73e-57d181194c5f
11582025-02-23T09:07:21.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df
11592025-02-23T09:07:21.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_cockroachdb_ca42af1c-1014-4024-96e2-eac140d8a0d4
11602025-02-23T09:07:21.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_cockroachdb_a54b0b48-8807-449a-ac1c-29440f35ca14
11612025-02-23T09:07:21.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_cockroachdb_2e471dc2-b534-4cc3-ac13-b8bb43941a47
11622025-02-23T09:07:21.915ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11632025-02-23T09:07:21.915ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11642025-02-23T09:07:21.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 15002333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60750 req_id = 11db8319-cf6f-4675-a07c-5c11c9e91281 response_code = 204 uri = /omicron-zones
11652025-02-23T09:07:21.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47916
11662025-02-23T09:07:21.980ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 29492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = 3bda0843-4b91-4c8b-8180-252e231b639c response_code = 500 uri = /cockroachdb
11672025-02-23T09:07:21.980ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3bda0843-4b91-4c8b-8180-252e231b639c", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3bda0843-4b91-4c8b-8180-252e231b639c" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 139.609131ms
11682025-02-23T09:07:22.148ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 27757 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = bf5c6b64-2d7e-4064-9958-ecb8b7c1b6fd response_code = 500 uri = /cockroachdb
11692025-02-23T09:07:22.148ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bf5c6b64-2d7e-4064-9958-ecb8b7c1b6fd", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bf5c6b64-2d7e-4064-9958-ecb8b7c1b6fd" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 103.719671ms
11702025-02-23T09:07:22.279ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 26994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = 36efd8bd-13bc-4b82-b9f6-b505d2a93d58 response_code = 500 uri = /cockroachdb
11712025-02-23T09:07:22.280ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "36efd8bd-13bc-4b82-b9f6-b505d2a93d58", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "36efd8bd-13bc-4b82-b9f6-b505d2a93d58" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 162.046233ms
11722025-02-23T09:07:22.470ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 26871 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = 6aff104e-2f3a-4596-a974-85d5ada69d6c response_code = 500 uri = /cockroachdb
11732025-02-23T09:07:22.470ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6aff104e-2f3a-4596-a974-85d5ada69d6c", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6aff104e-2f3a-4596-a974-85d5ada69d6c" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 208.57838ms
11742025-02-23T09:07:22.707ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 28067 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = 29efed01-59a0-4359-83c4-3a1bc141461c response_code = 500 uri = /cockroachdb
11752025-02-23T09:07:22.708ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "29efed01-59a0-4359-83c4-3a1bc141461c", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "29efed01-59a0-4359-83c4-3a1bc141461c" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 214.970043ms
11762025-02-23T09:07:22.950ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 26824 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = c02583cb-833d-4e3a-8e87-22f63c184f7b response_code = 500 uri = /cockroachdb
11772025-02-23T09:07:22.951ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c02583cb-833d-4e3a-8e87-22f63c184f7b", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c02583cb-833d-4e3a-8e87-22f63c184f7b" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 332.596721ms
11782025-02-23T09:07:23.311ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 25736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = 0a795918-03ec-447a-80d3-023db20ff32a response_code = 500 uri = /cockroachdb
11792025-02-23T09:07:23.311ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0a795918-03ec-447a-80d3-023db20ff32a", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0a795918-03ec-447a-80d3-023db20ff32a" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 351.929252ms
11802025-02-23T09:07:23.689ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 26087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = c83160dd-5ec8-4f70-a111-2401b78071a8 response_code = 500 uri = /cockroachdb
11812025-02-23T09:07:23.690ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c83160dd-5ec8-4f70-a111-2401b78071a8", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c83160dd-5ec8-4f70-a111-2401b78071a8" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 461.634066ms
11822025-02-23T09:07:24.179ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 26327 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = 1b622aa6-ea66-4a85-9251-5f6a6a14e586 response_code = 500 uri = /cockroachdb
11832025-02-23T09:07:24.179ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1b622aa6-ea66-4a85-9251-5f6a6a14e586", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1b622aa6-ea66-4a85-9251-5f6a6a14e586" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 443.151758ms
11842025-02-23T09:07:24.650ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 25905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = e9813ec4-08c6-455e-8e5c-4b33d531df81 response_code = 500 uri = /cockroachdb
11852025-02-23T09:07:24.650ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e9813ec4-08c6-455e-8e5c-4b33d531df81", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:24 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e9813ec4-08c6-455e-8e5c-4b33d531df81" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 567.198922ms
11862025-02-23T09:07:25.244ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_14839530-e21c-483a-917b-beebc2b467df /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 25769 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = 7d69ba4d-2046-4b9f-92da-f8cdf077921b response_code = 500 uri = /cockroachdb
11872025-02-23T09:07:25.244ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7d69ba4d-2046-4b9f-92da-f8cdf077921b", "content-length": "124", "date": "Sun, 23 Feb 2025 09:07:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7d69ba4d-2046-4b9f-92da-f8cdf077921b" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 559.376324ms
11882025-02-23T09:07:25.837ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3814
11892025-02-23T09:07:49.836ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3832
11902025-02-23T09:07:57.084ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3855
11912025-02-23T09:07:57.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 31282330 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47916 req_id = 4a2b5c5f-5474-4cf1-8aeb-048031b7c203 response_code = 204 uri = /cockroachdb
11922025-02-23T09:07:57.160ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 54837768-c843-4ec9-bd3b-c9b189b1b07e (service), filesystem_pool: Some(ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4eed87a-fe22-4a1d-8d93-25bee968f9d1 (service), filesystem_pool: Some(ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: d681d220-bdd0-4ed7-bcd5-3445bfe35e44 (service), filesystem_pool: Some(ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f1ab904-d03a-4587-b425-904f2d0e950b (service), filesystem_pool: Some(ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 243f288a-7a0d-4875-b9a9-69ce1d872f9e, kind: Service { id: 4f1ab904-d03a-4587-b425-904f2d0e950b }, name: Name("ntp-4f1ab904-d03a-4587-b425-904f2d0e950b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 238])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2e471dc2-b534-4cc3-ac13-b8bb43941a47 (service), filesystem_pool: Some(ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37070eb1-4c3b-4d4f-b73e-57d181194c5f (service), filesystem_pool: Some(ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ca42af1c-1014-4024-96e2-eac140d8a0d4 (service), filesystem_pool: Some(ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 14839530-e21c-483a-917b-beebc2b467df (service), filesystem_pool: Some(ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a54b0b48-8807-449a-ac1c-29440f35ca14 (service), filesystem_pool: Some(ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c (service), filesystem_pool: Some(ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc (service), filesystem_pool: Some(ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 (service), filesystem_pool: Some(ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 (service), filesystem_pool: Some(ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 (service), filesystem_pool: Some(ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: de6ca227-55b1-420b-b454-b4242aff85c9 (service), filesystem_pool: Some(ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: 256c63c3-fc8d-48a4-9282-aa3ababc4d95 (service), filesystem_pool: Some(ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 07331f78-4826-4329-8666-0dc66b4ba7ee (service), filesystem_pool: Some(ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 1ceb50da-d056-40c7-8232-044b7361fa45 (service), filesystem_pool: Some(ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 7add957a-88c2-444a-bbb7-11832744f36e (service), filesystem_pool: Some(ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 70464b9d-8658-401f-8157-5d899e662209 (service), filesystem_pool: Some(ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: dd3216a6-351f-475f-866e-f9d04e626071 (service), filesystem_pool: Some(ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 255a196a-bc37-4c03-b3ed-d5573d7394f1 (service), filesystem_pool: Some(ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 647df4ee-46b3-47b2-bf9d-33bb5fbe7fff (service), filesystem_pool: Some(ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: adb94c3c-2449-4adf-aa84-8e199195d87b (service), filesystem_pool: Some(ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 41a9d5be-ba7a-40ff-a43f-60bb4408f3b9 (service), filesystem_pool: Some(ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8a0d12a9-490d-4da8-8eea-9a9d46e465e8 (service), filesystem_pool: Some(ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 02021462-a94e-462f-bcdf-9bb70c3c02ca (service), filesystem_pool: Some(ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2c3fc2c3-8eb9-4bf2-86af-57858edf66f4 (service), filesystem_pool: Some(ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11932025-02-23T09:07:57.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58278
11942025-02-23T09:07:57.163ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11952025-02-23T09:07:57.163ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11962025-02-23T09:07:57.177ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11972025-02-23T09:07:57.177ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: InternalDns }, responder: ... }
11982025-02-23T09:07:57.189ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11992025-02-23T09:07:57.189ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: InternalDns }, responder: ... }
12002025-02-23T09:07:57.199ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12012025-02-23T09:07:57.199ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12022025-02-23T09:07:57.210ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12032025-02-23T09:07:57.210ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Cockroach }, responder: ... }
12042025-02-23T09:07:57.220ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12052025-02-23T09:07:57.220ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Cockroach }, responder: ... }
12062025-02-23T09:07:57.229ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12072025-02-23T09:07:57.229ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12082025-02-23T09:07:57.238ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12092025-02-23T09:07:57.238ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12102025-02-23T09:07:57.247ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12112025-02-23T09:07:57.247ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12122025-02-23T09:07:57.259ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12132025-02-23T09:07:57.259ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12142025-02-23T09:07:57.269ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12152025-02-23T09:07:57.269ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12162025-02-23T09:07:57.279ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12172025-02-23T09:07:57.279ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, kind: Crucible }, responder: ... }
12182025-02-23T09:07:57.288ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12192025-02-23T09:07:57.288ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, kind: Crucible }, responder: ... }
12202025-02-23T09:07:57.297ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12212025-02-23T09:07:57.297ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, kind: Crucible }, responder: ... }
12222025-02-23T09:07:57.307ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12232025-02-23T09:07:57.307ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, kind: Crucible }, responder: ... }
12242025-02-23T09:07:57.316ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12252025-02-23T09:07:57.316ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, kind: Crucible }, responder: ... }
12262025-02-23T09:07:57.333ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12272025-02-23T09:07:57.333ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, kind: Crucible }, responder: ... }
12282025-02-23T09:07:57.348ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12292025-02-23T09:07:57.349ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, kind: Crucible }, responder: ... }
12302025-02-23T09:07:57.359ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12312025-02-23T09:07:57.359ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, kind: Crucible }, responder: ... }
12322025-02-23T09:07:57.376ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12332025-02-23T09:07:57.376ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, kind: Crucible }, responder: ... }
12342025-02-23T09:07:57.390ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12352025-02-23T09:07:57.390ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-zones.json file = common/src/ledger.rs:177
12362025-02-23T09:07:57.390ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-zones.json file = common/src/ledger.rs:177
12372025-02-23T09:07:57.391ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4918 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
12382025-02-23T09:07:57.391ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12392025-02-23T09:07:57.537ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12402025-02-23T09:07:57.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12412025-02-23T09:07:57.579ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12422025-02-23T09:07:57.579ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12432025-02-23T09:07:57.579ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12442025-02-23T09:07:57.579ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12452025-02-23T09:07:57.579ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12462025-02-23T09:07:57.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12472025-02-23T09:07:57.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12482025-02-23T09:07:57.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12492025-02-23T09:07:57.765ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12502025-02-23T09:07:57.767ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12512025-02-23T09:07:57.780ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12522025-02-23T09:07:57.781ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12532025-02-23T09:07:57.828ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12542025-02-23T09:07:57.828ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12552025-02-23T09:07:57.828ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12562025-02-23T09:07:57.828ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12572025-02-23T09:07:57.828ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12582025-02-23T09:07:57.828ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_70464b9d-8658-401f-8157-5d899e662209 file = illumos-utils/src/zone.rs:325
12592025-02-23T09:07:57.837ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95 file = illumos-utils/src/zone.rs:325
12602025-02-23T09:07:57.842ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee file = illumos-utils/src/zone.rs:325
12612025-02-23T09:07:57.848ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071 file = illumos-utils/src/zone.rs:325
12622025-02-23T09:07:57.853ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e file = illumos-utils/src/zone.rs:325
12632025-02-23T09:07:57.859ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca file = illumos-utils/src/zone.rs:325
12642025-02-23T09:07:57.864ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45 file = illumos-utils/src/zone.rs:325
12652025-02-23T09:07:57.868ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4 file = illumos-utils/src/zone.rs:325
12662025-02-23T09:07:57.990ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_70464b9d-8658-401f-8157-5d899e662209 file = illumos-utils/src/zone.rs:363
12672025-02-23T09:07:57.994ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95 file = illumos-utils/src/zone.rs:363
12682025-02-23T09:07:57.999ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee file = illumos-utils/src/zone.rs:363
12692025-02-23T09:07:58.003ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071 file = illumos-utils/src/zone.rs:363
12702025-02-23T09:07:58.007ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e file = illumos-utils/src/zone.rs:363
12712025-02-23T09:07:58.012ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca file = illumos-utils/src/zone.rs:363
12722025-02-23T09:07:58.018ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45 file = illumos-utils/src/zone.rs:363
12732025-02-23T09:07:58.023ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4 file = illumos-utils/src/zone.rs:363
12742025-02-23T09:07:58.029ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9 file = illumos-utils/src/zone.rs:325
12752025-02-23T09:07:58.034ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1 file = illumos-utils/src/zone.rs:325
12762025-02-23T09:07:58.040ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b file = illumos-utils/src/zone.rs:325
12772025-02-23T09:07:58.047ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff file = illumos-utils/src/zone.rs:325
12782025-02-23T09:07:58.053ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8 file = illumos-utils/src/zone.rs:325
12792025-02-23T09:07:58.059ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9 file = illumos-utils/src/zone.rs:325
12802025-02-23T09:07:58.127ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12812025-02-23T09:07:58.128ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9 file = illumos-utils/src/zone.rs:363
12822025-02-23T09:07:58.138ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1 file = illumos-utils/src/zone.rs:363
12832025-02-23T09:07:58.149ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b file = illumos-utils/src/zone.rs:363
12842025-02-23T09:07:58.157ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff file = illumos-utils/src/zone.rs:363
12852025-02-23T09:07:58.168ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8 file = illumos-utils/src/zone.rs:363
12862025-02-23T09:07:58.172ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9 file = illumos-utils/src/zone.rs:363
12872025-02-23T09:07:58.241ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12882025-02-23T09:07:58.324ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12892025-02-23T09:07:58.414ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12902025-02-23T09:07:58.487ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12912025-02-23T09:07:58.491ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12922025-02-23T09:07:58.491ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12932025-02-23T09:07:58.602ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 154, 31]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12942025-02-23T09:07:58.602ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1320 zone_type = external_dns
12952025-02-23T09:07:58.609ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12962025-02-23T09:07:58.609ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12972025-02-23T09:07:58.737ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 223, 60]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12982025-02-23T09:07:58.737ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1320 zone_type = external_dns
12992025-02-23T09:07:58.743ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13002025-02-23T09:07:58.743ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13012025-02-23T09:07:58.797ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 250, 237]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13022025-02-23T09:07:58.797ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1320 zone_type = nexus
13032025-02-23T09:07:58.799ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13042025-02-23T09:07:58.799ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13052025-02-23T09:07:58.799ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
13062025-02-23T09:07:58.799ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
13072025-02-23T09:07:58.801ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13082025-02-23T09:07:58.801ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13092025-02-23T09:07:58.857ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 238, 38]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13102025-02-23T09:07:58.857ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1320 zone_type = nexus
13112025-02-23T09:07:58.859ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13122025-02-23T09:07:58.859ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13132025-02-23T09:07:58.916ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 240, 114]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13142025-02-23T09:07:58.916ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1320 zone_type = nexus
13152025-02-23T09:07:58.916ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13162025-02-23T09:07:58.918ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13172025-02-23T09:07:58.920ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13182025-02-23T09:07:58.920ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13192025-02-23T09:07:59.081ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13202025-02-23T09:07:59.081ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13212025-02-23T09:07:59.084ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc file = illumos-utils/src/zone.rs:325
13222025-02-23T09:07:59.095ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13232025-02-23T09:07:59.095ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13242025-02-23T09:07:59.095ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13252025-02-23T09:07:59.095ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13262025-02-23T09:07:59.095ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13272025-02-23T09:07:59.099ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13282025-02-23T09:07:59.099ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13292025-02-23T09:07:59.104ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13302025-02-23T09:07:59.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13312025-02-23T09:07:59.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13322025-02-23T09:07:59.161ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc file = illumos-utils/src/zone.rs:363
13332025-02-23T09:07:59.170ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c file = illumos-utils/src/zone.rs:325
13342025-02-23T09:07:59.267ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05 file = illumos-utils/src/zone.rs:325
13352025-02-23T09:07:59.277ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c file = illumos-utils/src/zone.rs:363
13362025-02-23T09:07:59.288ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3 file = illumos-utils/src/zone.rs:325
13372025-02-23T09:07:59.297ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42 file = illumos-utils/src/zone.rs:325
13382025-02-23T09:07:59.307ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05 file = illumos-utils/src/zone.rs:363
13392025-02-23T09:07:59.324ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3 file = illumos-utils/src/zone.rs:363
13402025-02-23T09:07:59.331ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42 file = illumos-utils/src/zone.rs:363
13412025-02-23T09:08:07.845ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422025-02-23T09:08:07.848ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13432025-02-23T09:08:07.851ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13442025-02-23T09:08:07.851ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
13452025-02-23T09:08:07.866ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
13462025-02-23T09:08:07.873ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
13472025-02-23T09:08:07.962ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_70464b9d-8658-401f-8157-5d899e662209: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b1071f02-e3de-41d8-adbb-ff667ec8ff62'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13482025-02-23T09:08:07.963ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='832208cc-7ef7-4902-b315-4b6ea618f972'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13492025-02-23T09:08:07.963ZINFOSledAgent (ServiceManager): Booting oxz_crucible_70464b9d-8658-401f-8157-5d899e662209 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
13502025-02-23T09:08:07.971ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7f9f3d10-8155-4511-8c83-34282eab634b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0996109a-6110-4798-8c50-aab010483e25'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13512025-02-23T09:08:07.972ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_dd28684b-0582-4159-82e0-305747c1d637/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c632f637-a42c-4132-a867-b38988b676bf'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13522025-02-23T09:08:07.972ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_52c0a5e3-b03e-446e-9e20-336c4f905023/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cb2e80e0-9eb7-41cd-a96f-67dc1c7f9e73'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13532025-02-23T09:08:07.973ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b04b1013-1fd4-4342-9735-04e35a199534/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e977ffff-67e0-48c8-9466-d5b77a83d7b1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13542025-02-23T09:08:07.974ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4680170d-0909-42ea-b36b-4e83b22320f8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552025-02-23T09:08:07.974ZINFOSledAgent (ServiceManager): Booting oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
13562025-02-23T09:08:07.981ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_32f1e829-361d-464b-83d6-3092853cc1e7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e5851d6c-9f58-446d-b42d-743d816129ab'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13572025-02-23T09:08:07.982ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9e960c69-de8b-458e-900f-827df5fd1555/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='86561ea7-2a3e-4fd4-9736-586e85192444'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13582025-02-23T09:08:07.982ZINFOSledAgent (ServiceManager): Booting oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
13592025-02-23T09:08:07.989ZINFOSledAgent (ServiceManager): Booting oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
13602025-02-23T09:08:07.994ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
13612025-02-23T09:08:08.002ZINFOSledAgent (ServiceManager): Booting oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
13622025-02-23T09:08:08.012ZINFOSledAgent (ServiceManager): Booting oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
13632025-02-23T09:08:08.021ZINFOSledAgent (ServiceManager): Booting oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
13642025-02-23T09:08:08.030ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
13652025-02-23T09:08:08.236ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 41.876427ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
13662025-02-23T09:08:08.291ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 26.774201ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
13672025-02-23T09:08:08.342ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 63.256741ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
13682025-02-23T09:08:08.458ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 60.819318ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
13692025-02-23T09:08:08.540ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 64.751086ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
13702025-02-23T09:08:08.614ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 51.510505ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
13712025-02-23T09:08:08.656ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 52.817582ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
13722025-02-23T09:08:08.699ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 136.53823ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
13732025-02-23T09:08:08.759ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 48.480008ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
13742025-02-23T09:08:08.849ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 107.575053ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
13752025-02-23T09:08:09.091ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 33.902683ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
13762025-02-23T09:08:09.154ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 51.15135ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
13772025-02-23T09:08:09.377ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 47.729228ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
13782025-02-23T09:08:09.449ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 50.821081ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
13792025-02-23T09:08:09.469ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 33.732176ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
13802025-02-23T09:08:09.497ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 32.103892ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
13812025-02-23T09:08:09.522ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 238.889279ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
13822025-02-23T09:08:09.551ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 224.543712ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
13832025-02-23T09:08:09.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 98.417796ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
13842025-02-23T09:08:09.588ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 253.714609ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
13852025-02-23T09:08:09.606ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 132.574841ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
13862025-02-23T09:08:09.622ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 201.398077ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
13872025-02-23T09:08:09.638ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 139.704512ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
13882025-02-23T09:08:09.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 80.252029ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
13892025-02-23T09:08:09.664ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 89.521986ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
13902025-02-23T09:08:09.677ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 138.003391ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
13912025-02-23T09:08:09.692ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 71.508711ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
13922025-02-23T09:08:09.704ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 111.074068ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
13932025-02-23T09:08:09.715ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 100.083776ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
13942025-02-23T09:08:09.719ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='de6ca227-55b1-420b-b454-b4242aff85c9'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13952025-02-23T09:08:09.720ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
13962025-02-23T09:08:09.745ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 277.99472ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
13972025-02-23T09:08:09.757ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 204.915116ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
13982025-02-23T09:08:09.769ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 186.169786ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
13992025-02-23T09:08:09.781ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 207.339485ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
14002025-02-23T09:08:09.793ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 274.030088ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
14012025-02-23T09:08:09.806ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 569.123468ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
14022025-02-23T09:08:09.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 230.316178ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
14032025-02-23T09:08:09.827ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 306.772089ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
14042025-02-23T09:08:09.838ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 172.76742ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
14052025-02-23T09:08:09.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 213.136661ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
14062025-02-23T09:08:09.859ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60826
14072025-02-23T09:08:09.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 302.382366ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
14082025-02-23T09:08:09.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 386.813399ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
14092025-02-23T09:08:09.888ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 18383 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60826 req_id = 68c4b4e4-277e-4153-b6f5-b3fb5830a0d0 response_code = 200 uri = /baseboard
14102025-02-23T09:08:09.962ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 37.310293ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
14112025-02-23T09:08:09.977ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 588.828606ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
14122025-02-23T09:08:09.990ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 379.580894ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
14132025-02-23T09:08:10.004ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 586.469708ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
14142025-02-23T09:08:10.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 146.762829ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
14152025-02-23T09:08:10.031ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 225.308214ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
14162025-02-23T09:08:10.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 509.629444ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
14172025-02-23T09:08:10.050ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14182025-02-23T09:08:10.065ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 346.978741ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
14192025-02-23T09:08:10.065ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
14202025-02-23T09:08:10.076ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14212025-02-23T09:08:10.093ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 521.269407ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
14222025-02-23T09:08:10.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 459.944272ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
14232025-02-23T09:08:10.107ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
14242025-02-23T09:08:10.151ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 1.151938192s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
14252025-02-23T09:08:10.178ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 256.169403ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
14262025-02-23T09:08:10.192ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 870.812736ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
14272025-02-23T09:08:10.273ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 1.172918677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
14282025-02-23T09:08:10.286ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 460.267793ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
14292025-02-23T09:08:10.332ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 33.192791ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
14302025-02-23T09:08:10.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 37.221645ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
14312025-02-23T09:08:10.380ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 119.813119ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
14322025-02-23T09:08:10.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 1.11208698s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
14332025-02-23T09:08:10.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 1.18126798s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
14342025-02-23T09:08:10.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 67.73383ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
14352025-02-23T09:08:10.434ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 560.094753ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
14362025-02-23T09:08:10.452ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 564.210955ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
14372025-02-23T09:08:10.497ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 288.089714ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
14382025-02-23T09:08:10.511ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 261.71315ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
14392025-02-23T09:08:10.572ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 814.936145ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
14402025-02-23T09:08:10.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 730.378309ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
14412025-02-23T09:08:10.600ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 1.184524565s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
14422025-02-23T09:08:10.623ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 702.3008ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
14432025-02-23T09:08:10.638ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 426.031692ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
14442025-02-23T09:08:10.763ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 1.134033747s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
14452025-02-23T09:08:10.791ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 332.037146ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
14462025-02-23T09:08:10.811ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 539.708171ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
14472025-02-23T09:08:11.032ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 1.3202901s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
14482025-02-23T09:08:11.053ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 477.649077ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
14492025-02-23T09:08:11.109ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 1.304692122s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
14502025-02-23T09:08:11.192ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 736.911008ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
14512025-02-23T09:08:11.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 935.510504ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
14522025-02-23T09:08:11.325ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 633.912743ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
14532025-02-23T09:08:11.346ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 764.26616ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
14542025-02-23T09:08:11.367ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 1.373199774s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
14552025-02-23T09:08:11.387ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 1.166897863s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
14562025-02-23T09:08:11.410ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 1.039842334s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
14572025-02-23T09:08:11.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 1.07668953s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
14582025-02-23T09:08:11.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 603.518497ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
14592025-02-23T09:08:11.548ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 558.352773ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
14602025-02-23T09:08:11.606ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 1.262999128s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
14612025-02-23T09:08:11.804ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 1.458004413s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
14622025-02-23T09:08:11.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 780.26775ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
14632025-02-23T09:08:11.946ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 766.850493ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
14642025-02-23T09:08:11.952ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14652025-02-23T09:08:11.952ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14662025-02-23T09:08:11.953ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14672025-02-23T09:08:11.953ZINFOSledAgent (ServiceManager): Booting oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
14682025-02-23T09:08:11.975ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 517.435366ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
14692025-02-23T09:08:11.975ZINFOSledAgent (ServiceManager): Booting oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
14702025-02-23T09:08:11.983ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
14712025-02-23T09:08:12.125ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 1.059903543s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
14722025-02-23T09:08:12.141ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 589.354195ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
14732025-02-23T09:08:12.159ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 1.19368393s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
14742025-02-23T09:08:12.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 1.405787208s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
14752025-02-23T09:08:12.280ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 73.673003ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
14762025-02-23T09:08:12.299ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 14.018527971s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
14772025-02-23T09:08:12.301ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 36.617653ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
14782025-02-23T09:08:12.436ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 145.91262ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
14792025-02-23T09:08:12.503ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 808.080056ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
14802025-02-23T09:08:12.580ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 875.379177ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
14812025-02-23T09:08:12.619ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 42.480131ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
14822025-02-23T09:08:12.636ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 84.419698ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
14832025-02-23T09:08:12.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 1.404704536s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
14842025-02-23T09:08:12.668ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 502.189285ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
14852025-02-23T09:08:12.680ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 165.355212ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
14862025-02-23T09:08:12.697ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 139.337354ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
14872025-02-23T09:08:12.711ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 1.249697998s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
14882025-02-23T09:08:12.726ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 1.31736485s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
14892025-02-23T09:08:12.740ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 1.177773923s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
14902025-02-23T09:08:12.755ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 1.319521161s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
14912025-02-23T09:08:12.769ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 210.042376ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
14922025-02-23T09:08:12.783ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 1.44024155s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
14932025-02-23T09:08:12.796ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 1.241726765s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
14942025-02-23T09:08:12.853ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 286.354318ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
14952025-02-23T09:08:12.868ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 405.478098ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
14962025-02-23T09:08:12.883ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 1.308252113s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
14972025-02-23T09:08:12.996ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 316.525138ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
14982025-02-23T09:08:13.154ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 402.139831ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
14992025-02-23T09:08:13.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 1.425261775s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
15002025-02-23T09:08:13.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 1.253503621s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
15012025-02-23T09:08:13.278ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 600.693324ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
15022025-02-23T09:08:13.292ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 534.882382ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
15032025-02-23T09:08:13.324ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 885.614437ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
15042025-02-23T09:08:13.335ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 459.107391ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
15052025-02-23T09:08:13.367ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 536.012867ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
15062025-02-23T09:08:13.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 534.310126ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
15072025-02-23T09:08:13.572ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 1.064822799s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
15082025-02-23T09:08:13.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 1.204857121s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
15092025-02-23T09:08:13.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 570.162896ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
15102025-02-23T09:08:13.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 1.370429656s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
15112025-02-23T09:08:13.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 743.471132ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
15122025-02-23T09:08:13.925ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 552.952784ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
15132025-02-23T09:08:13.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 1.440231929s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
15142025-02-23T09:08:13.990ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 1.457231627s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
15152025-02-23T09:08:14.031ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 881.192894ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
15162025-02-23T09:08:14.075ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 1.424533761s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
15172025-02-23T09:08:14.113ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 884.664039ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
15182025-02-23T09:08:14.133ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 1.258353624s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
15192025-02-23T09:08:14.156ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 1.410087363s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
15202025-02-23T09:08:14.212ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 1.195160759s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
15212025-02-23T09:08:14.233ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 1.376213649s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
15222025-02-23T09:08:14.256ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 1.32592085s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
15232025-02-23T09:08:14.406ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 1.272924857s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
15242025-02-23T09:08:14.481ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 1.198090958s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
15252025-02-23T09:08:14.510ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 1.236559232s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
15262025-02-23T09:08:14.628ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 717.47683ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
15272025-02-23T09:08:14.657ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 1.131575476s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
15282025-02-23T09:08:14.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 877.646623ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
15292025-02-23T09:08:14.827ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 1.428142824s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
15302025-02-23T09:08:14.934ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 1.467135572s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
15312025-02-23T09:08:15.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 514.956552ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
15322025-02-23T09:08:15.237ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 1.121401808s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
15332025-02-23T09:08:15.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 700.713425ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
15342025-02-23T09:08:15.404ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 1.410663575s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
15352025-02-23T09:08:15.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 1.495516855s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
15362025-02-23T09:08:15.430ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 1.001062785s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
15372025-02-23T09:08:15.462ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 715.21629ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
15382025-02-23T09:08:15.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 897.598546ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
15392025-02-23T09:08:15.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 1.354723354s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
15402025-02-23T09:08:15.564ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 1.405090799s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
15412025-02-23T09:08:15.578ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 900.748492ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
15422025-02-23T09:08:15.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 753.189104ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
15432025-02-23T09:08:15.623ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 1.293963651s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
15442025-02-23T09:08:15.692ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 1.452271191s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
15452025-02-23T09:08:15.704ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 1.44152155s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
15462025-02-23T09:08:15.760ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 1.275773307s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
15472025-02-23T09:08:15.801ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 1.477714434s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
15482025-02-23T09:08:16.105ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 988.257762ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
15492025-02-23T09:08:16.225ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 1.387632567s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
15502025-02-23T09:08:16.270ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 1.435438339s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
15512025-02-23T09:08:16.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 577.402191ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
15522025-02-23T09:08:16.375ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 1.16809401s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
15532025-02-23T09:08:16.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 546.651698ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
15542025-02-23T09:08:16.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 1.196517551s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
15552025-02-23T09:08:16.442ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 795.499059ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
15562025-02-23T09:08:16.492ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 1.220267402s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
15572025-02-23T09:08:16.803ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15582025-02-23T09:08:16.803ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
15592025-02-23T09:08:16.827ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 556.985665ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
15602025-02-23T09:08:16.916ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 1.196971221s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
15612025-02-23T09:08:16.929ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 837.123449ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
15622025-02-23T09:08:16.943ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e") failed: Property not found. retry in 1.454617825s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
15632025-02-23T09:08:16.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 849.764748ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
15642025-02-23T09:08:16.971ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 1.41002419s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
15652025-02-23T09:08:16.985ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 1.079556588s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
15662025-02-23T09:08:17.054ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 783.466875ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
15672025-02-23T09:08:17.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 51.742699ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
15682025-02-23T09:08:17.108ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 709.778531ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
15692025-02-23T09:08:17.138ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 127.476204ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
15702025-02-23T09:08:17.160ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 1.20790357s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
15712025-02-23T09:08:17.184ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 1.108073175s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
15722025-02-23T09:08:17.253ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 635.310735ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
15732025-02-23T09:08:17.277ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 211.665845ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
15742025-02-23T09:08:17.292ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 987.33709ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
15752025-02-23T09:08:17.401ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 747.357476ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
15762025-02-23T09:08:17.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 361.55868ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
15772025-02-23T09:08:17.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 1.385625108s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
15782025-02-23T09:08:17.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9") failed: Property not found. retry in 1.263001204s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
15792025-02-23T09:08:17.643ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 557.721544ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
15802025-02-23T09:08:17.719ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 1.16918214s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
15812025-02-23T09:08:17.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 556.680074ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
15822025-02-23T09:08:17.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 1.165343579s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
15832025-02-23T09:08:17.820ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 1.491113534s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
15842025-02-23T09:08:17.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 717.306797ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
15852025-02-23T09:08:17.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 890.623132ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
15862025-02-23T09:08:17.880ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 916.001621ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
15872025-02-23T09:08:17.903ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 707.489214ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
15882025-02-23T09:08:18.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 810.51505ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
15892025-02-23T09:08:18.128ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 773.370703ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
15902025-02-23T09:08:18.163ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 1.449746664s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
15912025-02-23T09:08:18.213ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 1.165137568s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
15922025-02-23T09:08:18.292ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 933.115868ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
15932025-02-23T09:08:18.307ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 1.25193168s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
15942025-02-23T09:08:18.320ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 792.55381ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
15952025-02-23T09:08:18.386ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 784.131195ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
15962025-02-23T09:08:18.400ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 517.051516ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
15972025-02-23T09:08:18.568ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 1.012504259s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
15982025-02-23T09:08:18.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 1.111991838s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
15992025-02-23T09:08:18.759ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee") failed: Property not found. retry in 1.260885905s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
16002025-02-23T09:08:18.810ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 631.301245ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
16012025-02-23T09:08:18.903ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 1.255602672s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
16022025-02-23T09:08:18.919ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071") failed: Property not found. retry in 1.400281659s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
16032025-02-23T09:08:18.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 634.490536ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
16042025-02-23T09:08:18.972ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 1.131781313s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
16052025-02-23T09:08:18.992ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 886.55447ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
16062025-02-23T09:08:19.010ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff") failed: Property not found. retry in 1.097888747s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
16072025-02-23T09:08:19.129ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 928.133444ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
16082025-02-23T09:08:19.189ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 974.911506ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
16092025-02-23T09:08:19.248ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 1.401063382s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
16102025-02-23T09:08:19.329ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1") failed: Property not found. retry in 1.179074468s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
16112025-02-23T09:08:19.394ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 1.454150429s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
16122025-02-23T09:08:19.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 1.187522911s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
16132025-02-23T09:08:19.582ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b") failed: Property not found. retry in 1.233461196s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
16142025-02-23T09:08:19.602ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 1.281794312s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
16152025-02-23T09:08:19.622ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8") failed: Property not found. retry in 877.584402ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
16162025-02-23T09:08:19.638ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45") failed: Property not found. retry in 502.13059ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
16172025-02-23T09:08:19.763ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca") failed: Property not found. retry in 1.39563584s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
16182025-02-23T09:08:19.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 645.297433ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
16192025-02-23T09:08:20.078ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9") failed: Property not found. retry in 615.293058ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
16202025-02-23T09:08:20.126ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4") failed: Property not found. retry in 1.02860859s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
16212025-02-23T09:08:20.195ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc") failed: Property not found. retry in 1.48811541s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
16222025-02-23T09:08:20.213ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 1.449749343s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
16232025-02-23T09:08:20.582ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 930.710459ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
16242025-02-23T09:08:20.670ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 948.043374ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
16252025-02-23T09:08:20.690ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 957.401906ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
16262025-02-23T09:08:20.872ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_70464b9d-8658-401f-8157-5d899e662209") failed: Property not found. retry in 1.273154684s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
16272025-02-23T09:08:20.909ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c") failed: Property not found. retry in 948.451806ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
16282025-02-23T09:08:21.534ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 1.11110056s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
16292025-02-23T09:08:21.642ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 641.486542ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
16302025-02-23T09:08:21.670ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 1.185663789s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
16312025-02-23T09:08:21.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 705.25741ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
16322025-02-23T09:08:22.303ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42") failed: Property not found. retry in 772.374904ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
16332025-02-23T09:08:22.419ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05") failed: Property not found. retry in 610.663498ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
16342025-02-23T09:08:22.665ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3") failed: Property not found. retry in 776.745296ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
16352025-02-23T09:08:22.874ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 1.064412249s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
16362025-02-23T09:08:23.951ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 1.097395275s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
16372025-02-23T09:08:25.062ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95") failed: Property not found. retry in 1.483864237s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
16382025-02-23T09:08:26.381ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.823316811s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
16392025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_70464b9d-8658-401f-8157-5d899e662209
16402025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_external_dns_2a04c699-57fd-4088-9fd0-fe8bfd6f8efc
16412025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_clickhouse_256c63c3-fc8d-48a4-9282-aa3ababc4d95
16422025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_pantry_07331f78-4826-4329-8666-0dc66b4ba7ee
16432025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_dd3216a6-351f-475f-866e-f9d04e626071
16442025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_pantry_7add957a-88c2-444a-bbb7-11832744f36e
16452025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_external_dns_f3ffb120-bf15-43b5-89a1-5c5964c0413c
16462025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_02021462-a94e-462f-bcdf-9bb70c3c02ca
16472025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_pantry_1ceb50da-d056-40c7-8232-044b7361fa45
16482025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_2c3fc2c3-8eb9-4bf2-86af-57858edf66f4
16492025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_nexus_1c608ad8-8827-4c81-ba57-e92e029dcde3
16502025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_nexus_8fbc9147-85c4-4227-a40c-e65d635ffa42
16512025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_41a9d5be-ba7a-40ff-a43f-60bb4408f3b9
16522025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_nexus_0edf32a7-089c-41ca-a008-be55b6f78c05
16532025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_255a196a-bc37-4c03-b3ed-d5573d7394f1
16542025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_adb94c3c-2449-4adf-aa84-8e199195d87b
16552025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_647df4ee-46b3-47b2-bf9d-33bb5fbe7fff
16562025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_crucible_8a0d12a9-490d-4da8-8eea-9a9d46e465e8
16572025-02-23T09:08:26.577ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3377 zone = oxz_oximeter_de6ca227-55b1-420b-b454-b4242aff85c9
16582025-02-23T09:08:26.578ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16592025-02-23T09:08:26.772ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16602025-02-23T09:08:26.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 29638117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58278 req_id = 82db53d9-bb29-406f-ad7e-f54a68786fc2 response_code = 204 uri = /omicron-zones
16612025-02-23T09:08:26.817ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1401
16622025-02-23T09:08:26.837ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16632025-02-23T09:08:26.843ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
16642025-02-23T09:08:26.894ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1003
16652025-02-23T09:08:26.901ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16662025-02-23T09:08:27.006ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16672025-02-23T09:08:27.141ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16682025-02-23T09:08:27.258ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16692025-02-23T09:08:27.412ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16702025-02-23T09:08:27.588ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16712025-02-23T09:08:27.902ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16722025-02-23T09:08:28.099ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16732025-02-23T09:08:28.522ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16742025-02-23T09:08:29.070ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16752025-02-23T09:08:29.563ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16762025-02-23T09:08:29.993ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/38f3d9f8-4c95-4159-994a-e2f97a9a0026/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16772025-02-23T09:08:32.669ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8e5d0c1c-8696-4295-b516-a6c95b66f950", "content-length": "173", "date": "Sun, 23 Feb 2025 09:08:32 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"38f3d9f8-4c95-4159-994a-e2f97a9a0026\"", request_id: "8e5d0c1c-8696-4295-b516-a6c95b66f950" } file = sled-agent/src/rack_setup/service.rs:1065
16782025-02-23T09:08:33.569ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5950239a-e1f7-4bca-ace9-f6b1d3ae8e7d", "content-length": "173", "date": "Sun, 23 Feb 2025 09:08:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"38f3d9f8-4c95-4159-994a-e2f97a9a0026\"", request_id: "5950239a-e1f7-4bca-ace9-f6b1d3ae8e7d" } file = sled-agent/src/rack_setup/service.rs:1065
16792025-02-23T09:08:36.358ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4113ed5f-b6a3-44f4-8925-1122ff0b2949", "content-length": "173", "date": "Sun, 23 Feb 2025 09:08:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b\"", request_id: "4113ed5f-b6a3-44f4-8925-1122ff0b2949" } file = sled-agent/src/rack_setup/service.rs:1065
16802025-02-23T09:08:38.929ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e296b6ef-2c47-469a-9b00-b2efadfdd7a4", "content-length": "173", "date": "Sun, 23 Feb 2025 09:08:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b\"", request_id: "e296b6ef-2c47-469a-9b00-b2efadfdd7a4" } file = sled-agent/src/rack_setup/service.rs:1065
16812025-02-23T09:08:39.932ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39549
16822025-02-23T09:08:39.932ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39549 req_id = b768ea9f-c02d-41a9-891e-fc20d6879cc1 response_code = 200 uri = /baseboard
16832025-02-23T09:08:41.348ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e7feaae8-46dc-4853-816f-3baf3aa75059", "content-length": "173", "date": "Sun, 23 Feb 2025 09:08:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b\"", request_id: "e7feaae8-46dc-4853-816f-3baf3aa75059" } file = sled-agent/src/rack_setup/service.rs:1065
16842025-02-23T09:08:43.276ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f05b59ab-0cd2-461a-a900-0830cfd331bc", "content-length": "173", "date": "Sun, 23 Feb 2025 09:08:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b\"", request_id: "f05b59ab-0cd2-461a-a900-0830cfd331bc" } file = sled-agent/src/rack_setup/service.rs:1065
16852025-02-23T09:08:46.186ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "776be5f3-22fc-4ccb-8dda-585dba930cf0", "content-length": "173", "date": "Sun, 23 Feb 2025 09:08:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b\"", request_id: "776be5f3-22fc-4ccb-8dda-585dba930cf0" } file = sled-agent/src/rack_setup/service.rs:1065
16862025-02-23T09:08:49.955ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f18a9c99-5397-4d3b-bece-db9eefc91c97", "content-length": "173", "date": "Sun, 23 Feb 2025 09:08:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b\"", request_id: "f18a9c99-5397-4d3b-bece-db9eefc91c97" } file = sled-agent/src/rack_setup/service.rs:1065
16872025-02-23T09:08:53.427ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
16882025-02-23T09:08:53.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47817
16892025-02-23T09:08:53.550ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16902025-02-23T09:08:53.550ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16912025-02-23T09:08:53.550ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-zones.json file = common/src/ledger.rs:177
16922025-02-23T09:08:53.555ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-zones.json file = common/src/ledger.rs:177
16932025-02-23T09:08:53.568ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16942025-02-23T09:08:53.568ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff
16952025-02-23T09:08:53.595ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16962025-02-23T09:08:53.595ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9e960c69-de8b-458e-900f-827df5fd1555
16972025-02-23T09:08:53.619ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16982025-02-23T09:08:53.619ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b04b1013-1fd4-4342-9735-04e35a199534
16992025-02-23T09:08:53.641ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17002025-02-23T09:08:53.641ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7f9f3d10-8155-4511-8c83-34282eab634b
17012025-02-23T09:08:53.664ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17022025-02-23T09:08:53.664ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7
17032025-02-23T09:08:53.686ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17042025-02-23T09:08:53.686ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dd28684b-0582-4159-82e0-305747c1d637
17052025-02-23T09:08:53.710ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17062025-02-23T09:08:53.710ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_52c0a5e3-b03e-446e-9e20-336c4f905023
17072025-02-23T09:08:53.733ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17082025-02-23T09:08:53.733ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32f1e829-361d-464b-83d6-3092853cc1e7
17092025-02-23T09:08:53.756ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17102025-02-23T09:08:53.756ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4
17112025-02-23T09:08:53.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 223163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47817 req_id = 91508ecd-28e9-4a81-918c-604c88d9e0cf response_code = 200 uri = /inventory
17122025-02-23T09:08:54.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43382
17132025-02-23T09:08:54.748ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17142025-02-23T09:08:54.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17152025-02-23T09:08:54.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17162025-02-23T09:08:54.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17172025-02-23T09:08:54.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17182025-02-23T09:08:54.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17192025-02-23T09:08:54.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17202025-02-23T09:08:54.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5826 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43382 req_id = 354c4453-e70d-484c-9edf-702fa01d57aa response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17212025-02-23T09:08:54.750ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1075
17222025-02-23T09:08:54.755ZINFOSledAgent (RSS): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17232025-02-23T09:08:54.756ZINFOSledAgent (RSS): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17242025-02-23T09:08:55.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62749
17252025-02-23T09:08:55.238ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17262025-02-23T09:08:55.238ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17272025-02-23T09:08:55.238ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-zones.json file = common/src/ledger.rs:177
17282025-02-23T09:08:55.238ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-zones.json file = common/src/ledger.rs:177
17292025-02-23T09:08:55.251ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17302025-02-23T09:08:55.251ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff
17312025-02-23T09:08:55.281ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17322025-02-23T09:08:55.281ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9e960c69-de8b-458e-900f-827df5fd1555
17332025-02-23T09:08:55.310ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17342025-02-23T09:08:55.310ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b04b1013-1fd4-4342-9735-04e35a199534
17352025-02-23T09:08:55.337ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17362025-02-23T09:08:55.337ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7f9f3d10-8155-4511-8c83-34282eab634b
17372025-02-23T09:08:55.364ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17382025-02-23T09:08:55.364ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7
17392025-02-23T09:08:55.391ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17402025-02-23T09:08:55.391ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dd28684b-0582-4159-82e0-305747c1d637
17412025-02-23T09:08:55.415ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17422025-02-23T09:08:55.415ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_52c0a5e3-b03e-446e-9e20-336c4f905023
17432025-02-23T09:08:55.441ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17442025-02-23T09:08:55.441ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32f1e829-361d-464b-83d6-3092853cc1e7
17452025-02-23T09:08:55.468ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17462025-02-23T09:08:55.468ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4
17472025-02-23T09:08:55.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 251254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62749 req_id = 3aba95d0-6c10-4223-a031-dd8a8f77d205 response_code = 200 uri = /inventory
17482025-02-23T09:08:55.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48042
17492025-02-23T09:08:55.667ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17502025-02-23T09:08:55.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17512025-02-23T09:08:55.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17522025-02-23T09:08:55.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17532025-02-23T09:08:55.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17542025-02-23T09:08:55.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17552025-02-23T09:08:55.667ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17562025-02-23T09:08:55.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48042 req_id = 2a49f855-67b4-48dd-86b5-6e8189916da7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17572025-02-23T09:08:56.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58700
17582025-02-23T09:08:56.115ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17592025-02-23T09:08:56.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17602025-02-23T09:08:56.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17612025-02-23T09:08:56.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17622025-02-23T09:08:56.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17632025-02-23T09:08:56.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17642025-02-23T09:08:56.115ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17652025-02-23T09:08:56.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58700 req_id = 91562dd3-0040-4e9d-ac00-11479bfbb8c5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17662025-02-23T09:08:56.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53163
17672025-02-23T09:08:56.625ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17682025-02-23T09:08:56.625ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17692025-02-23T09:08:56.625ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17702025-02-23T09:08:56.625ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17712025-02-23T09:08:56.625ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17722025-02-23T09:08:56.625ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17732025-02-23T09:08:56.625ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17742025-02-23T09:08:56.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53163 req_id = 7eba8692-b32f-4011-8225-06ad02af0268 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17752025-02-23T09:09:04.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50910
17762025-02-23T09:09:04.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50910 req_id = 7a6a31e4-1612-4705-ad3f-e17c9803e22c response_code = 200 uri = /vpc-routes
17772025-02-23T09:09:04.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61936
17782025-02-23T09:09:04.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61936 req_id = 7b7457bf-3898-4f1e-90f1-40dc6c08d89e response_code = 200 uri = /vpc-routes
17792025-02-23T09:09:04.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48278
17802025-02-23T09:09:04.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48278 req_id = 3d22cb08-8ef1-4d09-8ab2-15d845534c0f response_code = 200 uri = /vpc-routes
17812025-02-23T09:09:04.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44579
17822025-02-23T09:09:04.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44579 req_id = a5fdc515-1682-468d-897c-faf2e4f9f898 response_code = 200 uri = /v2p
17832025-02-23T09:09:04.845ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
17842025-02-23T09:09:04.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 947 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50910 req_id = aa3680f2-7cfe-4e2d-8d27-217c1a6bcd8f response_code = 204 uri = /eip-gateways
17852025-02-23T09:09:04.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64404
17862025-02-23T09:09:04.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64404 req_id = 50a0335c-9835-404a-a290-bdf664282030 response_code = 200 uri = /v2p
17872025-02-23T09:09:04.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34063
17882025-02-23T09:09:04.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34063 req_id = 63ed0538-1d0f-4cc9-b6d4-fa07e9728036 response_code = 200 uri = /v2p
17892025-02-23T09:09:05.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
17902025-02-23T09:09:05.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61936 req_id = f8a6bf0a-1728-48fc-aca3-f47af903c1cb response_code = 204 uri = /eip-gateways
17912025-02-23T09:09:05.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61936 req_id = d27568a5-88cf-48e0-bc50-07bc63af3ba5 response_code = 204 uri = /vpc-routes
17922025-02-23T09:09:05.185ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
17932025-02-23T09:09:05.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 398 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50910 req_id = fcbd3336-8e36-4880-b49c-b94be95c6b15 response_code = 204 uri = /vpc-routes
17942025-02-23T09:09:05.243ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
17952025-02-23T09:09:05.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48278 req_id = e08d0b27-53cd-4385-b237-460d02dfa559 response_code = 204 uri = /eip-gateways
17962025-02-23T09:09:05.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40895
17972025-02-23T09:09:05.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
17982025-02-23T09:09:05.712ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
17992025-02-23T09:09:05.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 477146 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40895 req_id = a685760f-8b3a-4af6-880f-d216f6fef0d5 response_code = 204 uri = /switch-ports
18002025-02-23T09:09:05.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35265
18012025-02-23T09:09:05.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46560
18022025-02-23T09:09:05.789ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
18032025-02-23T09:09:05.789ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18042025-02-23T09:09:05.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40895 req_id = 48be85c2-6c06-4c7a-9578-d45f4cc4e7bd response_code = 200 uri = /network-bootstore-config
18052025-02-23T09:09:05.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4401 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48278 req_id = 9a9cf1b0-3f0e-4438-a399-85fc03670dc1 response_code = 204 uri = /vpc-routes
18062025-02-23T09:09:05.847ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
18072025-02-23T09:09:05.921ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
18082025-02-23T09:09:05.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 135067 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35265 req_id = 30206078-99a5-4a79-9a93-c54b428ceefa response_code = 204 uri = /switch-ports
18092025-02-23T09:09:05.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35265 req_id = c69e0a49-c994-4835-8082-4fc847a101d8 response_code = 200 uri = /network-bootstore-config
18102025-02-23T09:09:05.980ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
18112025-02-23T09:09:06.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 287384 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46560 req_id = 6e5dcb3a-5de2-4cd0-a018-70238c9a16a7 response_code = 204 uri = /switch-ports
18122025-02-23T09:09:06.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46560 req_id = 1e1e6003-6af5-4565-9f01-e0ffb8ac8e76 response_code = 200 uri = /network-bootstore-config
18132025-02-23T09:09:06.092ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
18142025-02-23T09:09:06.092ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18152025-02-23T09:09:06.093ZINFOSledAgent (bootstore): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18162025-02-23T09:09:06.094ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
18172025-02-23T09:09:06.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2783 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40895 req_id = 18379fa2-e3d5-4d90-882e-2f06bbd5a7b5 response_code = 204 uri = /network-bootstore-config
18182025-02-23T09:09:06.253ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
18192025-02-23T09:09:06.253ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18202025-02-23T09:09:06.253ZINFOSledAgent (bootstore): Writing ledger to /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18212025-02-23T09:09:06.253ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
18222025-02-23T09:09:06.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 579 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35265 req_id = d69783d7-3297-4fab-afc1-af2a0166c8a0 response_code = 204 uri = /network-bootstore-config
18232025-02-23T09:09:08.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49171
18242025-02-23T09:09:08.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49171 req_id = b6354f2a-64de-46f2-b4d7-1a72810b47a9 response_code = 200 uri = /vpc-routes
18252025-02-23T09:09:08.579ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
18262025-02-23T09:09:08.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49171 req_id = 477d66e6-7db8-4600-b2f4-2ee9cb63d9c0 response_code = 204 uri = /eip-gateways
18272025-02-23T09:09:08.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49171 req_id = 127b44a2-6015-4dc1-9357-9e1c9882bd75 response_code = 204 uri = /vpc-routes
18282025-02-23T09:09:09.966ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35143
18292025-02-23T09:09:09.966ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35143 req_id = 29eba0a1-7968-4250-8928-05a7934991b1 response_code = 200 uri = /baseboard
18302025-02-23T09:09:17.300ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:58504 remote_addr = [fd00:1122:3344:101::d]:56998 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18312025-02-23T09:09:17.338ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 36567 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 64267bf9-c333-4e81-a006-cde51fbb20bc response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18322025-02-23T09:09:34.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59944
18332025-02-23T09:09:34.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59944 req_id = e68e2ac8-d342-48b8-aaad-3f4b2e3b1b52 response_code = 200 uri = /vpc-routes
18342025-02-23T09:09:34.825ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
18352025-02-23T09:09:34.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59944 req_id = 4dcf7775-617c-4ca0-bcc0-54c45da32d12 response_code = 204 uri = /eip-gateways
18362025-02-23T09:09:34.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59944 req_id = 974d5a59-3783-4be2-a367-932dae5d793a response_code = 204 uri = /vpc-routes
18372025-02-23T09:09:34.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39931
18382025-02-23T09:09:34.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39931 req_id = b2b38fcb-10ec-444a-bd2b-36d67b58fced response_code = 200 uri = /vpc-routes
18392025-02-23T09:09:34.958ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
18402025-02-23T09:09:34.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39931 req_id = 559286f0-e068-4167-8c1a-fc6dff2b08eb response_code = 204 uri = /eip-gateways
18412025-02-23T09:09:34.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 380 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39931 req_id = 117a76cf-9655-4581-b16f-b8719ac83dce response_code = 204 uri = /vpc-routes
18422025-02-23T09:09:34.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43814
18432025-02-23T09:09:34.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43814 req_id = 3786b88e-33ee-4884-8fc3-2bbb557bebed response_code = 200 uri = /vpc-routes
18442025-02-23T09:09:35.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52035
18452025-02-23T09:09:35.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52035 req_id = 81610e50-aa32-49f2-bf4f-64083724d74d response_code = 200 uri = /v2p
18462025-02-23T09:09:35.069ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
18472025-02-23T09:09:35.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43814 req_id = b4ccaca9-9abd-4bae-8383-23fcc950b4d9 response_code = 204 uri = /eip-gateways
18482025-02-23T09:09:35.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43814 req_id = 3a71411c-7f94-4b95-9f4a-02964fddf0cc response_code = 204 uri = /vpc-routes
18492025-02-23T09:09:35.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32848
18502025-02-23T09:09:35.101ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
18512025-02-23T09:09:35.143ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
18522025-02-23T09:09:35.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 108046 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32848 req_id = 46fa3d9e-1e6f-4826-bdbf-f1f30c74f801 response_code = 204 uri = /switch-ports
18532025-02-23T09:09:35.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38540
18542025-02-23T09:09:35.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35682
18552025-02-23T09:09:35.210ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
18562025-02-23T09:09:35.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3920 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38540 req_id = a862bce7-2094-4885-bc2e-0a654ce9069c response_code = 200 uri = /v2p
18572025-02-23T09:09:35.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4082 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32848 req_id = a119da00-d27f-4495-9ffe-23b8913ca712 response_code = 200 uri = /network-bootstore-config
18582025-02-23T09:09:35.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51161
18592025-02-23T09:09:35.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51161 req_id = 857f27d8-3c3f-4957-8425-e6d3c9a2d94a response_code = 200 uri = /v2p
18602025-02-23T09:09:35.249ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
18612025-02-23T09:09:35.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 97134 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35682 req_id = 5d506b18-9bf9-428d-8777-577e45d38094 response_code = 204 uri = /switch-ports
18622025-02-23T09:09:35.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35682 req_id = 2f1e1313-19b8-43cc-969b-41ca06b70ad6 response_code = 200 uri = /network-bootstore-config
18632025-02-23T09:09:35.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51318
18642025-02-23T09:09:35.359ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
18652025-02-23T09:09:35.396ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
18662025-02-23T09:09:35.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 95386 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51318 req_id = 213e7d71-9aca-4b18-a1e3-0f05793d33cd response_code = 204 uri = /switch-ports
18672025-02-23T09:09:35.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51318 req_id = 5ae539bd-93ff-4ab0-ab4f-5c3238cd4a14 response_code = 200 uri = /network-bootstore-config
18682025-02-23T09:09:40.003ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53205
18692025-02-23T09:09:40.003ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53205 req_id = 690544b2-b2f0-4220-be8d-373fc11c3d15 response_code = 200 uri = /baseboard
18702025-02-23T09:09:47.307ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5279 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 2217af21-054e-44e0-9d4e-d17d7cfe62c2 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
18712025-02-23T09:10:04.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63218
18722025-02-23T09:10:04.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63218 req_id = 1b1be7ec-29ee-4c06-851a-b91778de992e response_code = 200 uri = /vpc-routes
18732025-02-23T09:10:04.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64836
18742025-02-23T09:10:04.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64836 req_id = 8c03d57f-7c00-4596-be5c-569ff303aaaf response_code = 200 uri = /vpc-routes
18752025-02-23T09:10:04.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
18762025-02-23T09:10:04.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64836 req_id = b964ac03-abea-4620-9729-7d1745142642 response_code = 204 uri = /eip-gateways
18772025-02-23T09:10:04.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64290
18782025-02-23T09:10:04.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64290 req_id = f2e47440-c007-4419-a028-9103d2ed4050 response_code = 200 uri = /vpc-routes
18792025-02-23T09:10:04.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64836 req_id = 4fccb32b-5b89-4148-8306-2479bcf5ea87 response_code = 204 uri = /vpc-routes
18802025-02-23T09:10:04.806ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
18812025-02-23T09:10:04.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63218 req_id = 1fce3c3c-33e7-4ed9-90a4-b65a9c6716ec response_code = 204 uri = /eip-gateways
18822025-02-23T09:10:04.814ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
18832025-02-23T09:10:04.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64290 req_id = ea937a46-d143-4d47-89e1-1d7f75f38b47 response_code = 204 uri = /eip-gateways
18842025-02-23T09:10:04.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63218 req_id = c8bbe0cb-7cab-4754-9c17-8729d6f7bfcd response_code = 204 uri = /vpc-routes
18852025-02-23T09:10:04.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64290 req_id = a66ed03c-e55d-429d-b69d-20c7f6c254e1 response_code = 204 uri = /vpc-routes
18862025-02-23T09:10:04.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60652
18872025-02-23T09:10:04.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60652 req_id = efd4daf0-7ef6-482b-9bc8-498c00547373 response_code = 200 uri = /v2p
18882025-02-23T09:10:04.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60990
18892025-02-23T09:10:04.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60990 req_id = 358e8d7c-95c5-4720-9a16-eb3055781d31 response_code = 200 uri = /v2p
18902025-02-23T09:10:04.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63350
18912025-02-23T09:10:04.880ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
18922025-02-23T09:10:04.920ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
18932025-02-23T09:10:04.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 100556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63350 req_id = 153c2a2e-f413-41ca-a786-6b189002b439 response_code = 204 uri = /switch-ports
18942025-02-23T09:10:04.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43084
18952025-02-23T09:10:04.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53539
18962025-02-23T09:10:04.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51443
18972025-02-23T09:10:04.981ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
18982025-02-23T09:10:04.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3613 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63350 req_id = 9b8e543f-7322-44a9-b4a9-b6aef333360a response_code = 200 uri = /network-bootstore-config
18992025-02-23T09:10:04.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3723 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53539 req_id = 6772a8bb-7b0a-4544-a3bd-d7d4d8de1f97 response_code = 200 uri = /v2p
19002025-02-23T09:10:05.018ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
19012025-02-23T09:10:05.077ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
19022025-02-23T09:10:05.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 95915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51443 req_id = d5a1310c-4ed1-44ce-bb68-8822bde070d9 response_code = 204 uri = /switch-ports
19032025-02-23T09:10:05.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 378 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51443 req_id = 3ca34d81-e967-4aae-b148-3f92baf270bf response_code = 200 uri = /network-bootstore-config
19042025-02-23T09:10:05.111ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
19052025-02-23T09:10:05.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 185990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43084 req_id = c83cecf3-d1de-4ff0-bad3-d83498201bd3 response_code = 204 uri = /switch-ports
19062025-02-23T09:10:05.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43084 req_id = 9b149ac8-381b-4cf3-b344-92707a505574 response_code = 200 uri = /network-bootstore-config
19072025-02-23T09:10:10.036ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35773
19082025-02-23T09:10:10.036ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35773 req_id = d10632ee-c9ed-4782-acd9-4fd9d3d2126a response_code = 200 uri = /baseboard
19092025-02-23T09:10:17.307ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6234 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 37224f05-a7fe-4eb1-85c0-935c71e0efed response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
19102025-02-23T09:10:25.859ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19112025-02-23T09:10:34.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38175
19122025-02-23T09:10:34.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38175 req_id = e3565d7c-5bc2-4a66-be94-8078b9aa7907 response_code = 200 uri = /vpc-routes
19132025-02-23T09:10:34.845ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
19142025-02-23T09:10:34.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38175 req_id = c4ce230f-8923-470c-bead-ebebcff2188f response_code = 204 uri = /eip-gateways
19152025-02-23T09:10:34.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38175 req_id = 20479a57-8545-4c43-a6c0-550f96d44c73 response_code = 204 uri = /vpc-routes
19162025-02-23T09:10:34.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35529
19172025-02-23T09:10:34.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35529 req_id = d816ae75-e01a-46d0-a4c1-13618e29014b response_code = 200 uri = /vpc-routes
19182025-02-23T09:10:34.910ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
19192025-02-23T09:10:34.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35529 req_id = c475fad1-63e8-4be9-a243-fd6ac6a5463f response_code = 204 uri = /eip-gateways
19202025-02-23T09:10:34.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35529 req_id = d1f3f230-9ec4-4d2f-9129-2cc2e6ccb15e response_code = 204 uri = /vpc-routes
19212025-02-23T09:10:34.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58892
19222025-02-23T09:10:34.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58892 req_id = 5b2f12ad-48e6-489d-a0b9-fa1907fa8838 response_code = 200 uri = /vpc-routes
19232025-02-23T09:10:34.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48778
19242025-02-23T09:10:34.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48778 req_id = e63bd724-a553-401b-a7c1-eca9249a81c3 response_code = 200 uri = /v2p
19252025-02-23T09:10:34.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34535
19262025-02-23T09:10:34.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34535 req_id = b3f2fde9-1f2d-4af5-a460-eb1351d3facc response_code = 200 uri = /v2p
19272025-02-23T09:10:35.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
19282025-02-23T09:10:35.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58892 req_id = ae7a5c4f-3be7-42ef-8c4a-3db4fff220f3 response_code = 204 uri = /eip-gateways
19292025-02-23T09:10:35.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58892 req_id = c9e5a887-99ea-4c10-b08b-8d326c38c64c response_code = 204 uri = /vpc-routes
19302025-02-23T09:10:35.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62194
19312025-02-23T09:10:35.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62194 req_id = 2f56f01d-8d48-412d-9c54-c7d6d1d389f8 response_code = 200 uri = /v2p
19322025-02-23T09:10:35.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54629
19332025-02-23T09:10:35.196ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
19342025-02-23T09:10:35.232ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
19352025-02-23T09:10:35.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 91647 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54629 req_id = bfed2c70-c4ac-48c5-af5b-500219ed5e5d response_code = 204 uri = /switch-ports
19362025-02-23T09:10:35.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61358
19372025-02-23T09:10:35.288ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
19382025-02-23T09:10:35.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54629 req_id = 305f3377-acad-4116-91f6-c492a4c8db50 response_code = 200 uri = /network-bootstore-config
19392025-02-23T09:10:35.326ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
19402025-02-23T09:10:35.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 90001 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61358 req_id = 55bc733f-83ec-48e8-b276-ef0c5f9f70c1 response_code = 204 uri = /switch-ports
19412025-02-23T09:10:35.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61358 req_id = 92136cc1-97de-4bb7-88ca-0ad7e3f82f49 response_code = 200 uri = /network-bootstore-config
19422025-02-23T09:10:35.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48751
19432025-02-23T09:10:35.390ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
19442025-02-23T09:10:35.424ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
19452025-02-23T09:10:35.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 88344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48751 req_id = f8de2d4c-c6e2-46ef-9cab-5c4f8e3f805e response_code = 204 uri = /switch-ports
19462025-02-23T09:10:35.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48751 req_id = d633a9a0-ae23-47a5-a7b3-6c4600b4310d response_code = 200 uri = /network-bootstore-config
19472025-02-23T09:10:40.068ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60039
19482025-02-23T09:10:40.069ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60039 req_id = d5e30ecd-0f7e-44a3-85da-27ec08b698f6 response_code = 200 uri = /baseboard
19492025-02-23T09:10:47.305ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4896 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = df2fe1a4-011b-4db0-94bb-a4af29cfbecd response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
19502025-02-23T09:11:04.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55043
19512025-02-23T09:11:04.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55043 req_id = c57db669-67a0-4755-bd20-a3848f98d7a8 response_code = 200 uri = /vpc-routes
19522025-02-23T09:11:04.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47116
19532025-02-23T09:11:04.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47116 req_id = 34db4fb5-6acb-4d84-8622-279470b84571 response_code = 200 uri = /vpc-routes
19542025-02-23T09:11:04.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38229
19552025-02-23T09:11:04.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38229 req_id = b69a1343-ede2-4a7a-a076-708db3ed646e response_code = 200 uri = /vpc-routes
19562025-02-23T09:11:04.798ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
19572025-02-23T09:11:04.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55043 req_id = 52d95b22-be69-458c-a28e-4a2489f4e905 response_code = 204 uri = /eip-gateways
19582025-02-23T09:11:04.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54037
19592025-02-23T09:11:04.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54037 req_id = 17527793-8021-44ee-9561-b905cb697f44 response_code = 200 uri = /v2p
19602025-02-23T09:11:04.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55043 req_id = 8224d3cb-32d8-4efd-b7e5-f63c566f1a1e response_code = 204 uri = /vpc-routes
19612025-02-23T09:11:04.840ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
19622025-02-23T09:11:04.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38229 req_id = dd7449d6-d10e-4d43-bcec-198fe279788e response_code = 204 uri = /eip-gateways
19632025-02-23T09:11:04.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38229 req_id = f9b0cb2e-35d0-43b5-ac81-4f2d0897798d response_code = 204 uri = /vpc-routes
19642025-02-23T09:11:04.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40475
19652025-02-23T09:11:04.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
19662025-02-23T09:11:04.892ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
19672025-02-23T09:11:04.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 94156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40475 req_id = f6a1c6ec-6d0c-4fee-825d-fe59e6a43d51 response_code = 204 uri = /switch-ports
19682025-02-23T09:11:04.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55649
19692025-02-23T09:11:04.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39817
19702025-02-23T09:11:04.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43411
19712025-02-23T09:11:04.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
19722025-02-23T09:11:04.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47116 req_id = f6ec484e-c84f-40d1-9948-9b55cc7d2e73 response_code = 204 uri = /eip-gateways
19732025-02-23T09:11:04.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40475 req_id = 7c2c9ab8-7ee7-4f2b-a99b-97241c3ca999 response_code = 200 uri = /network-bootstore-config
19742025-02-23T09:11:04.950ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
19752025-02-23T09:11:04.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63682
19762025-02-23T09:11:04.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8828 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43411 req_id = c23ae551-d6d4-4763-b066-6e4f5d3753e1 response_code = 200 uri = /v2p
19772025-02-23T09:11:04.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63682 req_id = fc4d8525-f0ed-4cbc-a9ff-9df73f29d4a1 response_code = 200 uri = /v2p
19782025-02-23T09:11:04.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 514 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47116 req_id = 80763237-fca1-43eb-81bd-aadad3b5a6fb response_code = 204 uri = /vpc-routes
19792025-02-23T09:11:04.988ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
19802025-02-23T09:11:05.044ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
19812025-02-23T09:11:05.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 94359 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55649 req_id = c0b2a4a2-07a2-4b06-8fc2-bc5fc1559a5d response_code = 204 uri = /switch-ports
19822025-02-23T09:11:05.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55649 req_id = 565f6083-ff75-4fa8-9a02-c934e3f83ef1 response_code = 200 uri = /network-bootstore-config
19832025-02-23T09:11:05.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
19842025-02-23T09:11:05.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 182333 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39817 req_id = f9005ccb-6ce7-489d-a277-908622d92dc1 response_code = 204 uri = /switch-ports
19852025-02-23T09:11:05.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39817 req_id = 3bba0900-0ed1-4348-ba3e-26b8645d5f7b response_code = 200 uri = /network-bootstore-config
19862025-02-23T09:11:10.102ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54506
19872025-02-23T09:11:10.103ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54506 req_id = deafef62-6c27-4e0d-a7cc-4bff2647c902 response_code = 200 uri = /baseboard
19882025-02-23T09:11:17.306ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5088 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = b867c745-9d9e-4aad-8ded-cbfdc68efaac response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
19892025-02-23T09:11:34.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59494
19902025-02-23T09:11:34.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59494 req_id = ff610917-46c5-43a3-8aec-47a70f455177 response_code = 200 uri = /vpc-routes
19912025-02-23T09:11:34.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43380
19922025-02-23T09:11:34.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43380 req_id = 8381a98c-7ed6-43b9-9b5f-3571419cb509 response_code = 200 uri = /vpc-routes
19932025-02-23T09:11:34.943ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
19942025-02-23T09:11:34.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59494 req_id = 5efff967-f581-4d31-bc2e-fc94210cb4d4 response_code = 204 uri = /eip-gateways
19952025-02-23T09:11:34.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64725
19962025-02-23T09:11:34.953ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
19972025-02-23T09:11:34.997ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
19982025-02-23T09:11:35.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 106197 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64725 req_id = 99597c2f-55e7-46ae-8a03-e56e9d5c739b response_code = 204 uri = /switch-ports
19992025-02-23T09:11:35.059ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
20002025-02-23T09:11:35.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57148
20012025-02-23T09:11:35.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43380 req_id = b8b5bec7-fdbd-435e-b2e0-35aa09a6a67e response_code = 204 uri = /eip-gateways
20022025-02-23T09:11:35.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33871
20032025-02-23T09:11:35.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57154
20042025-02-23T09:11:35.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64725 req_id = 7a570859-7f9a-4891-96b5-bda77afb38ae response_code = 200 uri = /network-bootstore-config
20052025-02-23T09:11:35.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 664 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59494 req_id = 344143e7-ba8b-4833-b576-cc9d6a1f6d2e response_code = 204 uri = /vpc-routes
20062025-02-23T09:11:35.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57148 req_id = 59b37dd2-188e-4673-a159-2fb74690928d response_code = 200 uri = /vpc-routes
20072025-02-23T09:11:35.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33871 req_id = ed3df706-1f90-4027-bcb8-43f8f1e3feb3 response_code = 200 uri = /v2p
20082025-02-23T09:11:35.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57154 req_id = a69bd46a-dd55-4d51-be40-e8d7e0f0e18d response_code = 200 uri = /v2p
20092025-02-23T09:11:35.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51786
20102025-02-23T09:11:35.068ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
20112025-02-23T09:11:35.106ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
20122025-02-23T09:11:35.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 93515 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51786 req_id = ade6ffff-b267-49b7-84d6-2eccd0f5a301 response_code = 204 uri = /switch-ports
20132025-02-23T09:11:35.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40401
20142025-02-23T09:11:35.161ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
20152025-02-23T09:11:35.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57148 req_id = 66996da0-fc5c-44a5-aaea-99e9ce4550ec response_code = 204 uri = /eip-gateways
20162025-02-23T09:11:35.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51786 req_id = d3abe464-7d58-496f-bac2-6161c2aaa395 response_code = 200 uri = /network-bootstore-config
20172025-02-23T09:11:35.162ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
20182025-02-23T09:11:35.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5068 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43380 req_id = 59592436-6a5b-4830-b19a-a71efc3832af response_code = 204 uri = /vpc-routes
20192025-02-23T09:11:35.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39900
20202025-02-23T09:11:35.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39900 req_id = 92018064-ff4a-4d0d-a353-cc69ef4f4f71 response_code = 200 uri = /v2p
20212025-02-23T09:11:35.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57148 req_id = 48c0c1dd-0cec-4b29-8588-dfbb069f635c response_code = 204 uri = /vpc-routes
20222025-02-23T09:11:35.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
20232025-02-23T09:11:35.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 92897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40401 req_id = e79fcd11-a0dd-45d2-825e-74e026372cc7 response_code = 204 uri = /switch-ports
20242025-02-23T09:11:35.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40401 req_id = 6481a22c-9625-4a5b-b751-0629c8efb125 response_code = 200 uri = /network-bootstore-config
20252025-02-23T09:11:40.136ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57355
20262025-02-23T09:11:40.136ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57355 req_id = a4ca5e34-9ea0-4d86-8175-033d1b2e739b response_code = 200 uri = /baseboard
20272025-02-23T09:11:47.307ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5691 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 7d5e6024-809b-489a-8d81-0334ce6b7db4 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
20282025-02-23T09:12:04.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47219
20292025-02-23T09:12:04.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 664 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47219 req_id = 6a01b4eb-eb39-4063-a604-0e07bcac496c response_code = 200 uri = /vpc-routes
20302025-02-23T09:12:04.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61408
20312025-02-23T09:12:04.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61408 req_id = 3af0043f-3e0e-499e-a9d5-b62505e604f1 response_code = 200 uri = /vpc-routes
20322025-02-23T09:12:04.740ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
20332025-02-23T09:12:04.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47219 req_id = 7de1b0a7-7079-44f7-ab27-0a3c2a2a47c2 response_code = 204 uri = /eip-gateways
20342025-02-23T09:12:04.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40884
20352025-02-23T09:12:04.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40884 req_id = cdc55c59-e16a-4884-a7d8-16913c7f5f83 response_code = 200 uri = /v2p
20362025-02-23T09:12:04.746ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
20372025-02-23T09:12:04.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61408 req_id = 8be799b8-7b72-44fa-ba3a-d771c8d02359 response_code = 204 uri = /eip-gateways
20382025-02-23T09:12:04.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47219 req_id = 2884539d-266c-4975-9caa-1260665abca3 response_code = 204 uri = /vpc-routes
20392025-02-23T09:12:04.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 699 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61408 req_id = 12bccbdf-9d1a-4582-8dbd-26bfd427ea97 response_code = 204 uri = /vpc-routes
20402025-02-23T09:12:04.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64347
20412025-02-23T09:12:04.762ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
20422025-02-23T09:12:04.797ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
20432025-02-23T09:12:04.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 81453 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64347 req_id = 4bda6f31-cba3-4341-8530-63b3b2bbdd65 response_code = 204 uri = /switch-ports
20442025-02-23T09:12:04.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36445
20452025-02-23T09:12:04.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51485
20462025-02-23T09:12:04.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46642
20472025-02-23T09:12:04.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46642 req_id = 8158ae09-4fce-44f0-9dbb-67c343845177 response_code = 200 uri = /vpc-routes
20482025-02-23T09:12:04.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64347 req_id = 4d4e4a39-96e8-466e-9a68-426e24b661dc response_code = 200 uri = /network-bootstore-config
20492025-02-23T09:12:04.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
20502025-02-23T09:12:04.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36445 req_id = 5363298a-6661-4e40-b88b-fea30d1f14d7 response_code = 200 uri = /v2p
20512025-02-23T09:12:04.862ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
20522025-02-23T09:12:04.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 539 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46642 req_id = 4a143bff-9ace-4ca8-9b94-394cc8267a21 response_code = 204 uri = /eip-gateways
20532025-02-23T09:12:04.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46642 req_id = ca1c985f-6537-4c94-9de9-1a3928b26313 response_code = 204 uri = /vpc-routes
20542025-02-23T09:12:04.885ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
20552025-02-23T09:12:04.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65067
20562025-02-23T09:12:04.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65067 req_id = c85f0844-1b5e-4183-9517-5a734dc1e018 response_code = 200 uri = /v2p
20572025-02-23T09:12:04.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42990
20582025-02-23T09:12:04.943ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
20592025-02-23T09:12:04.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 98940 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51485 req_id = c9106e2c-2a08-42f5-a8d1-1d95ac36f37c response_code = 204 uri = /switch-ports
20602025-02-23T09:12:04.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 756 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51485 req_id = a81c1c9b-677c-4739-a851-00d9be7bafaa response_code = 200 uri = /network-bootstore-config
20612025-02-23T09:12:04.979ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
20622025-02-23T09:12:05.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 88484 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42990 req_id = dd662c37-a87b-4812-866b-3ecd4f8a800b response_code = 204 uri = /switch-ports
20632025-02-23T09:12:05.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42990 req_id = fb46436a-e19c-418a-9426-9d5d92bcb7ea response_code = 200 uri = /network-bootstore-config
20642025-02-23T09:12:10.174ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39325
20652025-02-23T09:12:10.174ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39325 req_id = 2f38043b-e26b-439b-8a83-f1f258f53a83 response_code = 200 uri = /baseboard
20662025-02-23T09:12:17.307ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5634 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 84e2c6f1-7c06-4882-a4a2-a9c1bbd26660 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
20672025-02-23T09:12:34.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58412
20682025-02-23T09:12:34.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58412 req_id = bb004bd2-bc90-45d9-b80e-db87694d08ac response_code = 200 uri = /vpc-routes
20692025-02-23T09:12:34.864ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
20702025-02-23T09:12:34.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58412 req_id = 1487129e-55ad-4a19-97ba-ac2557506e4b response_code = 204 uri = /eip-gateways
20712025-02-23T09:12:34.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58412 req_id = 1ff4cb85-2108-4ed9-b532-2191c6fd7f73 response_code = 204 uri = /vpc-routes
20722025-02-23T09:12:34.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46752
20732025-02-23T09:12:34.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55501
20742025-02-23T09:12:34.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55501 req_id = 1e70d4cb-c51f-4dc6-a269-29b82193b742 response_code = 200 uri = /vpc-routes
20752025-02-23T09:12:34.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46752 req_id = d9b9df1d-7846-44d5-b6b5-67aa71eb9a0d response_code = 200 uri = /v2p
20762025-02-23T09:12:34.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50526
20772025-02-23T09:12:34.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50526 req_id = b9e2f4a9-5114-49b4-aea9-4018e2b52623 response_code = 200 uri = /vpc-routes
20782025-02-23T09:12:34.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46659
20792025-02-23T09:12:34.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46659 req_id = e3c9d310-0457-4306-bc09-c2ee1474e9ae response_code = 200 uri = /v2p
20802025-02-23T09:12:34.996ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
20812025-02-23T09:12:34.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50526 req_id = 3f99a9db-42de-4b20-b256-686444693d77 response_code = 204 uri = /eip-gateways
20822025-02-23T09:12:35.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50526 req_id = 55418901-f357-4096-9f67-a738a85d7a07 response_code = 204 uri = /vpc-routes
20832025-02-23T09:12:35.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
20842025-02-23T09:12:35.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55501 req_id = a1450e64-8d28-4cef-9329-ea6c6099cba7 response_code = 204 uri = /eip-gateways
20852025-02-23T09:12:35.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37401
20862025-02-23T09:12:35.033ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
20872025-02-23T09:12:35.070ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
20882025-02-23T09:12:35.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 94372 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37401 req_id = 9eae930e-b6cd-4e54-a01a-04c43ae74a04 response_code = 204 uri = /switch-ports
20892025-02-23T09:12:35.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39708
20902025-02-23T09:12:35.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56067
20912025-02-23T09:12:35.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39708 req_id = 0a774fa1-17d4-4b51-9367-92ed9f2cbd11 response_code = 200 uri = /v2p
20922025-02-23T09:12:35.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37401 req_id = bf122ec4-2f27-46e6-bb27-860ffdd658d3 response_code = 200 uri = /network-bootstore-config
20932025-02-23T09:12:35.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 438 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55501 req_id = 88b8f3a2-a4f2-4dc1-a47a-e093390b680e response_code = 204 uri = /vpc-routes
20942025-02-23T09:12:35.129ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
20952025-02-23T09:12:35.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36010
20962025-02-23T09:12:35.165ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
20972025-02-23T09:12:35.218ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
20982025-02-23T09:12:35.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 89401 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56067 req_id = 859947c9-4383-4715-909b-101a24b32da9 response_code = 204 uri = /switch-ports
20992025-02-23T09:12:35.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 743 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56067 req_id = 2e38d4e0-fc5a-4be2-808a-fb44dc05677b response_code = 200 uri = /network-bootstore-config
21002025-02-23T09:12:35.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
21012025-02-23T09:12:35.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 156826 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36010 req_id = ca43528c-23a7-4bb3-8f88-69a38d948446 response_code = 204 uri = /switch-ports
21022025-02-23T09:12:35.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36010 req_id = 84c3cfb9-9ef2-4ec7-80e0-779c92f96a25 response_code = 200 uri = /network-bootstore-config
21032025-02-23T09:12:40.207ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51477
21042025-02-23T09:12:40.207ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51477 req_id = 2a9e8d51-10c1-434c-a41b-64cb0ebf8c56 response_code = 200 uri = /baseboard
21052025-02-23T09:12:47.310ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7395 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 2321b425-8b9f-442f-9b3d-b9fb16a55d77 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21062025-02-23T09:13:04.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58835
21072025-02-23T09:13:04.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58835 req_id = 362f303e-b2a8-4a3f-9e2c-ed582afac963 response_code = 200 uri = /vpc-routes
21082025-02-23T09:13:04.674ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
21092025-02-23T09:13:04.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58835 req_id = 4413bb7f-23f2-4162-bd44-3c60d0a27fdb response_code = 204 uri = /eip-gateways
21102025-02-23T09:13:04.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42709
21112025-02-23T09:13:04.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42709 req_id = 67b89d9d-50ca-48b3-84c9-9d81e00303ec response_code = 200 uri = /vpc-routes
21122025-02-23T09:13:04.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58835 req_id = c09a75ba-5557-4715-911b-3efe7d82c0de response_code = 204 uri = /vpc-routes
21132025-02-23T09:13:04.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41929
21142025-02-23T09:13:04.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41929 req_id = e385b93b-6c49-4c43-aef5-e3fa94f1ae26 response_code = 200 uri = /vpc-routes
21152025-02-23T09:13:04.706ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
21162025-02-23T09:13:04.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42709 req_id = b8d446c0-9f3f-456a-bb07-24ab59285623 response_code = 204 uri = /eip-gateways
21172025-02-23T09:13:04.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42709 req_id = beab9c74-9f2c-4189-9873-39477db5d07e response_code = 204 uri = /vpc-routes
21182025-02-23T09:13:04.740ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
21192025-02-23T09:13:04.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41929 req_id = 3938a385-bb0c-4722-b8d0-6a8b51581aa0 response_code = 204 uri = /eip-gateways
21202025-02-23T09:13:04.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41929 req_id = 7ac7fbb8-7649-42ad-8a39-2866f713fdce response_code = 204 uri = /vpc-routes
21212025-02-23T09:13:04.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47730
21222025-02-23T09:13:04.782ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
21232025-02-23T09:13:04.821ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
21242025-02-23T09:13:04.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 95990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47730 req_id = bf417287-22a3-4c1f-b4ad-5dccf67253d4 response_code = 204 uri = /switch-ports
21252025-02-23T09:13:04.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39460
21262025-02-23T09:13:04.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34624
21272025-02-23T09:13:04.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63855
21282025-02-23T09:13:04.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47874
21292025-02-23T09:13:04.878ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
21302025-02-23T09:13:04.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34624 req_id = 01ce36ac-6b30-47a3-b378-a4256b418b86 response_code = 200 uri = /v2p
21312025-02-23T09:13:04.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39460 req_id = b4dce5cb-5d2e-4dc0-be5d-fbc643e3d4d2 response_code = 200 uri = /v2p
21322025-02-23T09:13:04.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47730 req_id = ddf58242-8972-424b-95bd-5be50e1ee8b7 response_code = 200 uri = /network-bootstore-config
21332025-02-23T09:13:04.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4071 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63855 req_id = 72a9ef54-1f4c-416a-8ccd-fa5735be3c10 response_code = 200 uri = /v2p
21342025-02-23T09:13:04.912ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
21352025-02-23T09:13:04.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43682
21362025-02-23T09:13:04.966ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
21372025-02-23T09:13:04.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 87655 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47874 req_id = 5cfb2b1e-f4e7-43ed-9125-1de0e75b223a response_code = 204 uri = /switch-ports
21382025-02-23T09:13:04.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47874 req_id = dfbe16a5-b0d0-455a-b6a8-78f93c2c8392 response_code = 200 uri = /network-bootstore-config
21392025-02-23T09:13:04.999ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
21402025-02-23T09:13:05.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 121521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43682 req_id = 48e2c24b-4b16-45a5-b0ff-c83780555b7f response_code = 204 uri = /switch-ports
21412025-02-23T09:13:05.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43682 req_id = 195fdaf6-1f83-4e28-84d1-61cf4636bc27 response_code = 200 uri = /network-bootstore-config
21422025-02-23T09:13:10.240ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44590
21432025-02-23T09:13:10.240ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44590 req_id = cd68ac63-7df8-412e-a034-96aebe898d1c response_code = 200 uri = /baseboard
21442025-02-23T09:13:17.309ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6628 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 990011b2-ef0c-4e65-9a1d-9926e350e950 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
21452025-02-23T09:13:34.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47578
21462025-02-23T09:13:34.880ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21472025-02-23T09:13:34.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7591 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47578 req_id = 42d7d931-6108-42c9-aa8a-14ee4c440ab8 response_code = 200 uri = /artifacts
21482025-02-23T09:13:34.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60720
21492025-02-23T09:13:34.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60720 req_id = 5b19fd9b-adfb-4b8c-bc0d-1b7b07c899e8 response_code = 200 uri = /vpc-routes
21502025-02-23T09:13:34.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59599
21512025-02-23T09:13:34.956ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21522025-02-23T09:13:34.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59599 req_id = 920fa394-5ce9-4e8f-bf2a-aa593bad7355 response_code = 200 uri = /artifacts
21532025-02-23T09:13:34.980ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
21542025-02-23T09:13:34.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60720 req_id = 8fb54ebc-442b-4b54-a697-9d49b3047ff1 response_code = 204 uri = /eip-gateways
21552025-02-23T09:13:34.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 382 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60720 req_id = 4766dd93-0108-4d1f-9abe-2629754a9f5c response_code = 204 uri = /vpc-routes
21562025-02-23T09:13:35.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61035
21572025-02-23T09:13:35.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61035 req_id = cb8862f4-4df8-4b3c-b067-fe10ef600243 response_code = 200 uri = /vpc-routes
21582025-02-23T09:13:35.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65091
21592025-02-23T09:13:35.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65091 req_id = b88de7b8-2e5a-4a6d-b6a4-5bf0cf9de656 response_code = 200 uri = /vpc-routes
21602025-02-23T09:13:35.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34434
21612025-02-23T09:13:35.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34434 req_id = 185b1217-6da1-4b77-aac6-2bad02686501 response_code = 200 uri = /v2p
21622025-02-23T09:13:35.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57131
21632025-02-23T09:13:35.060ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
21642025-02-23T09:13:35.106ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
21652025-02-23T09:13:35.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 119820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57131 req_id = 8c3fb6e7-70f3-4d53-9f01-aaf09c2174b1 response_code = 204 uri = /switch-ports
21662025-02-23T09:13:35.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49863
21672025-02-23T09:13:35.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52830
21682025-02-23T09:13:35.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55247
21692025-02-23T09:13:35.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52734
21702025-02-23T09:13:35.180ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
21712025-02-23T09:13:35.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21722025-02-23T09:13:35.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61035 req_id = efac8960-d423-4a07-93aa-a3ddad0b5372 response_code = 204 uri = /eip-gateways
21732025-02-23T09:13:35.180ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
21742025-02-23T09:13:35.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49863 req_id = 0e5fcb21-add4-45ba-bcae-4bc4d477747f response_code = 200 uri = /v2p
21752025-02-23T09:13:35.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57131 req_id = fe9bf123-46e5-4f31-833d-4f3393e5aea2 response_code = 200 uri = /network-bootstore-config
21762025-02-23T09:13:35.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55247 req_id = e70528ec-d099-4d41-a92e-226a9681b107 response_code = 200 uri = /v2p
21772025-02-23T09:13:35.187ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
21782025-02-23T09:13:35.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6693 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52734 req_id = 663d4bcd-af39-4336-af41-29ca1c99167e response_code = 200 uri = /artifacts
21792025-02-23T09:13:35.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6954 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65091 req_id = 6d039738-068b-4160-893f-6ccaa304aa83 response_code = 204 uri = /eip-gateways
21802025-02-23T09:13:35.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61035 req_id = b4837b82-6015-4499-a035-f828620693f2 response_code = 204 uri = /vpc-routes
21812025-02-23T09:13:35.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33344
21822025-02-23T09:13:35.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1086 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65091 req_id = a5bf7c60-78b6-4f1b-9246-e862d5eb86dc response_code = 204 uri = /vpc-routes
21832025-02-23T09:13:35.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
21842025-02-23T09:13:35.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53691
21852025-02-23T09:13:35.253ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21862025-02-23T09:13:35.253ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21872025-02-23T09:13:35.253ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21882025-02-23T09:13:35.253ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21892025-02-23T09:13:35.253ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21902025-02-23T09:13:35.253ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21912025-02-23T09:13:35.253ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21922025-02-23T09:13:35.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53691 req_id = 49c147ef-7cf0-49c5-83d2-b73ad6a25a1a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21932025-02-23T09:13:35.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48297
21942025-02-23T09:13:35.279ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21952025-02-23T09:13:35.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21962025-02-23T09:13:35.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21972025-02-23T09:13:35.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21982025-02-23T09:13:35.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21992025-02-23T09:13:35.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22002025-02-23T09:13:35.279ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22012025-02-23T09:13:35.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48297 req_id = f2819d9d-208a-426f-8ab6-21b234cecc0c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22022025-02-23T09:13:35.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 100616 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52830 req_id = 9012eb55-c2f0-4d9e-91a9-4e49594883b7 response_code = 204 uri = /switch-ports
22032025-02-23T09:13:35.281ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
22042025-02-23T09:13:35.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52830 req_id = 2c4dd1d8-1c1d-4a02-8a7e-feb797f8ea27 response_code = 200 uri = /network-bootstore-config
22052025-02-23T09:13:35.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42411
22062025-02-23T09:13:35.293ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22072025-02-23T09:13:35.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
22082025-02-23T09:13:35.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22092025-02-23T09:13:35.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22102025-02-23T09:13:35.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22112025-02-23T09:13:35.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22122025-02-23T09:13:35.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22132025-02-23T09:13:35.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 385 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42411 req_id = 30e4bc25-ab0c-4c7f-846d-7987761e9a8c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22142025-02-23T09:13:35.315ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
22152025-02-23T09:13:35.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 181108 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33344 req_id = feab2e21-8b8a-49bf-8951-550cc7683daf response_code = 204 uri = /switch-ports
22162025-02-23T09:13:35.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33344 req_id = 6195d812-740d-4e9e-b875-cc3abef9e365 response_code = 200 uri = /network-bootstore-config
22172025-02-23T09:13:40.273ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52559
22182025-02-23T09:13:40.273ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52559 req_id = 19f7f91a-d79e-46d1-8ec1-c3e8c8faf04e response_code = 200 uri = /baseboard
22192025-02-23T09:13:47.310ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7441 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 3963d0ee-c5f3-422d-9009-3722928e26b3 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22202025-02-23T09:14:04.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57124
22212025-02-23T09:14:04.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57124 req_id = 63bbf655-9f79-436b-9fef-38c20b479fab response_code = 200 uri = /vpc-routes
22222025-02-23T09:14:04.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62212
22232025-02-23T09:14:04.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62212 req_id = d080a630-2238-459d-98f9-826960d27be6 response_code = 200 uri = /vpc-routes
22242025-02-23T09:14:04.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52228
22252025-02-23T09:14:04.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52228 req_id = b7279b3f-d79a-46d8-b5e3-423e5e3b878c response_code = 200 uri = /vpc-routes
22262025-02-23T09:14:04.785ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
22272025-02-23T09:14:04.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57124 req_id = 9ef21880-26f7-47a7-a716-80bd1ec1a045 response_code = 204 uri = /eip-gateways
22282025-02-23T09:14:04.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57124 req_id = 6a56321b-a30f-496c-9c40-00c1d1bdfbb0 response_code = 204 uri = /vpc-routes
22292025-02-23T09:14:04.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60975
22302025-02-23T09:14:04.817ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
22312025-02-23T09:14:04.859ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
22322025-02-23T09:14:04.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 106695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60975 req_id = 36281ed4-4634-4d4f-8614-e3b8570aa9f5 response_code = 204 uri = /switch-ports
22332025-02-23T09:14:04.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60668
22342025-02-23T09:14:04.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50328
22352025-02-23T09:14:04.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57769
22362025-02-23T09:14:04.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
22372025-02-23T09:14:04.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
22382025-02-23T09:14:04.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33515
22392025-02-23T09:14:04.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52228 req_id = 6de6c538-4014-44c8-a34d-9dc85a99a73a response_code = 204 uri = /eip-gateways
22402025-02-23T09:14:04.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62212 req_id = a5eb1bbb-f5ed-44b2-ba67-2f7b621214c9 response_code = 204 uri = /eip-gateways
22412025-02-23T09:14:04.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48736
22422025-02-23T09:14:04.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60975 req_id = 79040ef4-77b9-4343-af6b-ffe781589852 response_code = 200 uri = /network-bootstore-config
22432025-02-23T09:14:04.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60668 req_id = 9b569304-f879-4dde-acb6-3e9ad81fb1c7 response_code = 200 uri = /v2p
22442025-02-23T09:14:04.925ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
22452025-02-23T09:14:04.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33515 req_id = ef3f8a3f-87c5-46bc-91e8-cda072386bb6 response_code = 200 uri = /v2p
22462025-02-23T09:14:04.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5673 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50328 req_id = b1becc1f-3fe1-45e0-b66e-2f1b8aefac0a response_code = 200 uri = /v2p
22472025-02-23T09:14:04.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 729 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52228 req_id = 74308aac-1124-4854-8f73-ba58186c1606 response_code = 204 uri = /vpc-routes
22482025-02-23T09:14:04.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 886 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62212 req_id = 763dfdd3-d5b3-4f89-a9b4-031243af3647 response_code = 204 uri = /vpc-routes
22492025-02-23T09:14:04.963ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
22502025-02-23T09:14:05.019ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
22512025-02-23T09:14:05.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 94498 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48736 req_id = 67b9c1da-e434-4e83-9f7d-8e194f632991 response_code = 204 uri = /switch-ports
22522025-02-23T09:14:05.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 598 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48736 req_id = de37861c-3380-4e23-8b59-fb82849e53f1 response_code = 200 uri = /network-bootstore-config
22532025-02-23T09:14:05.053ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
22542025-02-23T09:14:05.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 185357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57769 req_id = cc00b998-613d-44cb-bc8c-8510feb22c82 response_code = 204 uri = /switch-ports
22552025-02-23T09:14:05.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57769 req_id = 15525493-f2b3-4423-9a38-76140b113532 response_code = 200 uri = /network-bootstore-config
22562025-02-23T09:14:10.305ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47444
22572025-02-23T09:14:10.305ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47444 req_id = e335725e-4dfb-4b98-acbf-2f89800467c8 response_code = 200 uri = /baseboard
22582025-02-23T09:14:17.310ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7461 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 28de4eb8-f62a-469f-8928-1d8fc6732fb6 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22592025-02-23T09:14:34.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40112
22602025-02-23T09:14:34.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40112 req_id = f52314f5-337c-4d3e-92c5-514d77c06da3 response_code = 200 uri = /v2p
22612025-02-23T09:14:34.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56434
22622025-02-23T09:14:34.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56434 req_id = 6648e4a4-58ec-4b82-8a25-eca4a3af1665 response_code = 200 uri = /vpc-routes
22632025-02-23T09:14:34.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37814
22642025-02-23T09:14:34.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37814 req_id = b0cd8f01-6499-4302-8722-cd3e1bd40f3e response_code = 200 uri = /vpc-routes
22652025-02-23T09:14:34.937ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
22662025-02-23T09:14:34.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56434 req_id = 406d8416-7800-4f2b-a9bb-0a58c621fc61 response_code = 204 uri = /eip-gateways
22672025-02-23T09:14:34.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56434 req_id = 08de3341-698d-4396-bbeb-b86dd43b8e34 response_code = 204 uri = /vpc-routes
22682025-02-23T09:14:34.957ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
22692025-02-23T09:14:34.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37814 req_id = 18a46784-40d0-4dc3-a74b-51f541d4d30f response_code = 204 uri = /eip-gateways
22702025-02-23T09:14:34.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37814 req_id = 6a9a59a4-f699-4d09-8936-98fd7c2911f7 response_code = 204 uri = /vpc-routes
22712025-02-23T09:14:35.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48233
22722025-02-23T09:14:35.064ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
22732025-02-23T09:14:35.102ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
22742025-02-23T09:14:35.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 102809 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48233 req_id = 61c16ac4-58e7-495b-a2e8-9cfd9f5eb61d response_code = 204 uri = /switch-ports
22752025-02-23T09:14:35.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46827
22762025-02-23T09:14:35.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42559
22772025-02-23T09:14:35.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42559 req_id = 85810f59-eb07-44dd-83f6-5adc17cb5cff response_code = 200 uri = /v2p
22782025-02-23T09:14:35.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46827 req_id = 66aec66b-513e-4942-92aa-7984944382ee response_code = 200 uri = /vpc-routes
22792025-02-23T09:14:35.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48233 req_id = 5675df9a-c5f6-4285-b1b2-48ec14f0d907 response_code = 200 uri = /network-bootstore-config
22802025-02-23T09:14:35.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43178
22812025-02-23T09:14:35.168ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
22822025-02-23T09:14:35.210ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
22832025-02-23T09:14:35.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 99034 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43178 req_id = 73250796-fc13-4541-b784-00d2e570e3db response_code = 204 uri = /switch-ports
22842025-02-23T09:14:35.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59433
22852025-02-23T09:14:35.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55830
22862025-02-23T09:14:35.268ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
22872025-02-23T09:14:35.268ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
22882025-02-23T09:14:35.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46827 req_id = 571c1ae9-8e11-406b-aac3-a3efab578a9e response_code = 204 uri = /eip-gateways
22892025-02-23T09:14:35.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3844 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59433 req_id = 8c5459a8-382a-4c69-960a-a5ee5bcdce04 response_code = 200 uri = /v2p
22902025-02-23T09:14:35.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3985 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43178 req_id = 3cb3536e-fd20-4750-91d4-81f8f285aebb response_code = 200 uri = /network-bootstore-config
22912025-02-23T09:14:35.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 407 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46827 req_id = 87198b6b-4489-467f-ba8b-a5739e055964 response_code = 204 uri = /vpc-routes
22922025-02-23T09:14:35.305ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
22932025-02-23T09:14:35.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 93399 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55830 req_id = ad2e0691-fdc9-4ded-8e3a-0dc0e72d87d1 response_code = 204 uri = /switch-ports
22942025-02-23T09:14:35.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55830 req_id = 74fbee5f-a0d1-40b0-b255-dc79956adb04 response_code = 200 uri = /network-bootstore-config
22952025-02-23T09:14:40.338ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61038
22962025-02-23T09:14:40.338ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61038 req_id = 6ef93184-acd3-40c2-b05a-6cca3f0ac55c response_code = 200 uri = /baseboard
22972025-02-23T09:14:47.310ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6623 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 835f6696-1e57-446f-ae76-db463c6f97b5 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
22982025-02-23T09:15:04.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60763
22992025-02-23T09:15:04.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60763 req_id = 432f0364-4924-4fd5-9092-51a13cb2b3aa response_code = 200 uri = /vpc-routes
23002025-02-23T09:15:04.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59606
23012025-02-23T09:15:04.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59606 req_id = e28f5dfc-8b32-44d0-a021-55e49c46c5aa response_code = 200 uri = /vpc-routes
23022025-02-23T09:15:04.740ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
23032025-02-23T09:15:04.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60763 req_id = 5487e08b-2ef8-4979-bfe0-d120d7c0e62b response_code = 204 uri = /eip-gateways
23042025-02-23T09:15:04.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33763
23052025-02-23T09:15:04.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33763 req_id = 1063a954-3bbf-4afd-aba1-0c063c54f9a0 response_code = 200 uri = /vpc-routes
23062025-02-23T09:15:04.791ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
23072025-02-23T09:15:04.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59606 req_id = 8aac4881-417d-4a64-81f1-46dd189bf3e5 response_code = 204 uri = /eip-gateways
23082025-02-23T09:15:04.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47250
23092025-02-23T09:15:04.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47250 req_id = 98914247-13dc-4cdb-8cde-2d423247039e response_code = 200 uri = /v2p
23102025-02-23T09:15:04.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60763 req_id = 6dcc7b5e-ccea-4c83-ae9f-d82be7101864 response_code = 204 uri = /vpc-routes
23112025-02-23T09:15:04.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59606 req_id = a613de69-c770-47ef-b3f8-e8e43b1dc147 response_code = 204 uri = /vpc-routes
23122025-02-23T09:15:04.826ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
23132025-02-23T09:15:04.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33763 req_id = c3966b46-872b-4b6f-81c9-72a50b9b868a response_code = 204 uri = /eip-gateways
23142025-02-23T09:15:04.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39574
23152025-02-23T09:15:04.829ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
23162025-02-23T09:15:04.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
23172025-02-23T09:15:04.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 102666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39574 req_id = 2bfe90a3-7c8a-4c3d-97de-66d97b1f69d3 response_code = 204 uri = /switch-ports
23182025-02-23T09:15:04.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33693
23192025-02-23T09:15:04.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48813
23202025-02-23T09:15:04.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61782
23212025-02-23T09:15:04.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46479
23222025-02-23T09:15:04.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 457 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39574 req_id = 0087fae5-bef1-4183-ab7d-5ac2802cb4d0 response_code = 200 uri = /network-bootstore-config
23232025-02-23T09:15:04.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33693 req_id = 71247522-8799-4f45-9301-1da85229c73d response_code = 200 uri = /v2p
23242025-02-23T09:15:04.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 742 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33763 req_id = 5e938a9c-f78c-44bb-a0c4-904712177464 response_code = 204 uri = /vpc-routes
23252025-02-23T09:15:04.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46479 req_id = f101385a-98d3-4c2b-83ee-137f571a7454 response_code = 200 uri = /v2p
23262025-02-23T09:15:04.933ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
23272025-02-23T09:15:04.972ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
23282025-02-23T09:15:05.028ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
23292025-02-23T09:15:05.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 94997 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61782 req_id = b806bffe-d930-47dc-abf1-b741499314fb response_code = 204 uri = /switch-ports
23302025-02-23T09:15:05.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61782 req_id = e092223b-3190-49fe-953c-5e6b5296a5d0 response_code = 200 uri = /network-bootstore-config
23312025-02-23T09:15:05.065ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
23322025-02-23T09:15:05.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 185789 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48813 req_id = 05823f29-df6c-4f1d-9cff-756a3f88be02 response_code = 204 uri = /switch-ports
23332025-02-23T09:15:05.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48813 req_id = 221f1815-fe95-4097-af99-fe2074b14238 response_code = 200 uri = /network-bootstore-config
23342025-02-23T09:15:10.370ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61346
23352025-02-23T09:15:10.370ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61346 req_id = 7b7eaa27-36ed-419a-9225-2f36cddeb258 response_code = 200 uri = /baseboard
23362025-02-23T09:15:11.568ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23372025-02-23T09:15:11.568ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23382025-02-23T09:15:11.598ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 36527, tv_nsec: 299228630 } time_to_next_cleanup = 599.99999792s
23392025-02-23T09:15:17.310ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6795 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 05200a47-4dd7-41c1-8fd2-b99bacc9f710 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
23402025-02-23T09:15:25.862ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23412025-02-23T09:15:34.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60135
23422025-02-23T09:15:34.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60135 req_id = 3354a3b6-a731-4fdd-aacc-07a4b819ffcf response_code = 200 uri = /vpc-routes
23432025-02-23T09:15:34.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39140
23442025-02-23T09:15:34.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39140 req_id = efd6270b-1bc8-4284-ba24-729504e3f601 response_code = 200 uri = /vpc-routes
23452025-02-23T09:15:34.934ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
23462025-02-23T09:15:34.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39140 req_id = 160717dd-f25e-4ab7-a7fa-5f4f7478ccb3 response_code = 204 uri = /eip-gateways
23472025-02-23T09:15:34.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
23482025-02-23T09:15:34.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60135 req_id = 6c859f6d-9b81-4354-8ac6-e5842ee7e9e6 response_code = 204 uri = /eip-gateways
23492025-02-23T09:15:34.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39140 req_id = 8304d583-a230-4a38-b28f-9994c90326e6 response_code = 204 uri = /vpc-routes
23502025-02-23T09:15:34.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60135 req_id = 7d7f036a-55cf-4ea5-9212-2e556221e517 response_code = 204 uri = /vpc-routes
23512025-02-23T09:15:34.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33114
23522025-02-23T09:15:34.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33114 req_id = 6d0a9aa7-fc9d-4757-b514-464e9412d7b2 response_code = 200 uri = /vpc-routes
23532025-02-23T09:15:35.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
23542025-02-23T09:15:35.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33114 req_id = 7aab3d0f-ce67-4ec0-a205-416adf714c85 response_code = 204 uri = /eip-gateways
23552025-02-23T09:15:35.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42427
23562025-02-23T09:15:35.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42427 req_id = 08f50e8f-5e6b-4daf-8ede-d0de4c3d75ab response_code = 200 uri = /v2p
23572025-02-23T09:15:35.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54009
23582025-02-23T09:15:35.050ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
23592025-02-23T09:15:35.091ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
23602025-02-23T09:15:35.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 106269 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54009 req_id = 2c21de2b-d46c-408d-aeaf-21ac9ab09785 response_code = 204 uri = /switch-ports
23612025-02-23T09:15:35.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63492
23622025-02-23T09:15:35.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45630
23632025-02-23T09:15:35.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54009 req_id = 34da8bc1-55fd-497c-a01e-920b5021faee response_code = 200 uri = /network-bootstore-config
23642025-02-23T09:15:35.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63492 req_id = 49cea7f9-2346-4452-96ee-7dd1ba09022d response_code = 200 uri = /v2p
23652025-02-23T09:15:35.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45630 req_id = 78e7db7a-b7d8-4764-b666-9f06d490f702 response_code = 200 uri = /v2p
23662025-02-23T09:15:35.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 582 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33114 req_id = e192e0ef-4577-4202-8edd-d0de73a59654 response_code = 204 uri = /vpc-routes
23672025-02-23T09:15:35.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40716
23682025-02-23T09:15:35.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
23692025-02-23T09:15:35.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49135
23702025-02-23T09:15:35.197ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
23712025-02-23T09:15:35.253ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
23722025-02-23T09:15:35.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 94083 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40716 req_id = c6a456af-d8c6-43dd-8c58-11e0b57fa5ef response_code = 204 uri = /switch-ports
23732025-02-23T09:15:35.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 709 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40716 req_id = 396ce289-3690-4b3e-a525-07d8d06ecd95 response_code = 200 uri = /network-bootstore-config
23742025-02-23T09:15:35.288ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
23752025-02-23T09:15:35.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 171005 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49135 req_id = cda93dc5-84b6-4825-a405-352f91c855c8 response_code = 204 uri = /switch-ports
23762025-02-23T09:15:35.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49135 req_id = 976ce01d-9a4a-49da-8777-968d4ee462ac response_code = 200 uri = /network-bootstore-config
23772025-02-23T09:15:40.410ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63486
23782025-02-23T09:15:40.410ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63486 req_id = b432ec40-d48b-4e9f-bb8a-426a096eac3c response_code = 200 uri = /baseboard
23792025-02-23T09:15:47.311ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6995 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 5af68dad-9afc-4277-bc82-56bcb4d176a5 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
23802025-02-23T09:16:04.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40035
23812025-02-23T09:16:04.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40035 req_id = c66b9669-b6a9-41cc-999e-865a64b06b49 response_code = 200 uri = /vpc-routes
23822025-02-23T09:16:04.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49051
23832025-02-23T09:16:04.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49051 req_id = c6a582ac-5195-4328-9df4-af9c9d2e1b9f response_code = 200 uri = /vpc-routes
23842025-02-23T09:16:04.737ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
23852025-02-23T09:16:04.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40035 req_id = b8fbd243-74bf-409e-a039-4ef5c8c6e40f response_code = 204 uri = /eip-gateways
23862025-02-23T09:16:04.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40035 req_id = d4ae6176-a5a3-4bfe-a8ff-5d6b2a7de52d response_code = 204 uri = /vpc-routes
23872025-02-23T09:16:04.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32842
23882025-02-23T09:16:04.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32842 req_id = 07829da4-30e1-4f9c-b2f1-0230a1982464 response_code = 200 uri = /v2p
23892025-02-23T09:16:04.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56434
23902025-02-23T09:16:04.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56434 req_id = a6e77e3d-e570-4893-adb8-24e30bbd671c response_code = 200 uri = /vpc-routes
23912025-02-23T09:16:04.773ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
23922025-02-23T09:16:04.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56434 req_id = 463143f4-76e2-4dec-962a-5d90bfc60146 response_code = 204 uri = /eip-gateways
23932025-02-23T09:16:04.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48836
23942025-02-23T09:16:04.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48836 req_id = da964795-25a9-4046-bc5d-bd090524397e response_code = 200 uri = /v2p
23952025-02-23T09:16:04.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40819
23962025-02-23T09:16:04.779ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
23972025-02-23T09:16:04.820ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
23982025-02-23T09:16:04.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 101227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40819 req_id = c36a4798-3626-4197-938d-26ad17ae7b8a response_code = 204 uri = /switch-ports
23992025-02-23T09:16:04.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57119
24002025-02-23T09:16:04.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43670
24012025-02-23T09:16:04.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56819
24022025-02-23T09:16:04.881ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
24032025-02-23T09:16:04.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49051 req_id = 67fbce03-51ca-4127-87e6-3155b602af36 response_code = 204 uri = /eip-gateways
24042025-02-23T09:16:04.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43670 req_id = e775873d-01fe-4d88-b5c3-9ac40d2ba468 response_code = 200 uri = /v2p
24052025-02-23T09:16:04.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40819 req_id = 2278f52b-3c18-46a0-93d0-5fe4c3e2484c response_code = 200 uri = /network-bootstore-config
24062025-02-23T09:16:04.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
24072025-02-23T09:16:04.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56434 req_id = b0bd1173-616b-463f-adba-652b82abd168 response_code = 204 uri = /vpc-routes
24082025-02-23T09:16:04.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49051 req_id = 9305fba2-e7da-460c-93e4-4da46e8b8ef4 response_code = 204 uri = /vpc-routes
24092025-02-23T09:16:04.918ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
24102025-02-23T09:16:04.973ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
24112025-02-23T09:16:04.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 92562 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56819 req_id = ec6d71c2-105c-412b-9a4a-8e5c87ef0125 response_code = 204 uri = /switch-ports
24122025-02-23T09:16:04.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 760 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56819 req_id = ad925676-a80e-47c5-951f-6e9ba974688c response_code = 200 uri = /network-bootstore-config
24132025-02-23T09:16:05.009ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
24142025-02-23T09:16:05.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 184265 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57119 req_id = 6de6bf28-9bf6-48df-a821-bd1450154b4d response_code = 204 uri = /switch-ports
24152025-02-23T09:16:05.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57119 req_id = ec1085ed-7d96-41c6-bd78-4872837cabf2 response_code = 200 uri = /network-bootstore-config
24162025-02-23T09:16:10.443ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55013
24172025-02-23T09:16:10.443ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55013 req_id = 71744d07-6165-4cd6-ad54-c9d32f3200e0 response_code = 200 uri = /baseboard
24182025-02-23T09:16:17.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7473 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 9a66d7ea-287b-4c62-9440-1bb32da42645 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
24192025-02-23T09:16:34.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58278
24202025-02-23T09:16:34.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58278 req_id = 41e654c5-7392-41ca-ab01-16b38206b164 response_code = 200 uri = /vpc-routes
24212025-02-23T09:16:34.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60717
24222025-02-23T09:16:34.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60717 req_id = 2e1f55e9-1d82-44ab-9c5c-8e8142190d93 response_code = 200 uri = /vpc-routes
24232025-02-23T09:16:34.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
24242025-02-23T09:16:34.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60717 req_id = 9c9211d9-1d02-4b1a-ac2f-56cca8336d4f response_code = 204 uri = /eip-gateways
24252025-02-23T09:16:34.926ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
24262025-02-23T09:16:34.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58278 req_id = d03aae11-f328-4588-8788-9079cb654d3b response_code = 204 uri = /eip-gateways
24272025-02-23T09:16:34.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58278 req_id = ec7ab17e-5a34-4479-8285-8f669519a2c6 response_code = 204 uri = /vpc-routes
24282025-02-23T09:16:34.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46784
24292025-02-23T09:16:34.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46784 req_id = 2ed61242-3e72-4f52-9367-9eb215b7044f response_code = 200 uri = /v2p
24302025-02-23T09:16:34.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51425
24312025-02-23T09:16:34.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51425 req_id = 4a3e8b24-c8c2-4013-baf3-d34634938f9a response_code = 200 uri = /vpc-routes
24322025-02-23T09:16:34.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45553
24332025-02-23T09:16:34.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45553 req_id = 62ca1185-077c-4be2-92c8-9c72c3f48dbf response_code = 200 uri = /v2p
24342025-02-23T09:16:34.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60717 req_id = f3ecfda4-a5a9-4c3b-87e9-147dad6fd2a3 response_code = 204 uri = /vpc-routes
24352025-02-23T09:16:34.984ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
24362025-02-23T09:16:34.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51425 req_id = 5fdc4abf-e9ca-43f3-ad28-6aa60bd5616a response_code = 204 uri = /eip-gateways
24372025-02-23T09:16:34.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51425 req_id = f3eb298b-ac55-4321-9ce2-c5910a4027a1 response_code = 204 uri = /vpc-routes
24382025-02-23T09:16:35.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38978
24392025-02-23T09:16:35.020ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
24402025-02-23T09:16:35.063ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
24412025-02-23T09:16:35.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 102509 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38978 req_id = 0e5b40ea-139e-406a-951d-2a190bba0a86 response_code = 204 uri = /switch-ports
24422025-02-23T09:16:35.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49571
24432025-02-23T09:16:35.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63686
24442025-02-23T09:16:35.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34022
24452025-02-23T09:16:35.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
24462025-02-23T09:16:35.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3457 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49571 req_id = 52158bf2-634f-44b8-968a-f416ede66d46 response_code = 200 uri = /v2p
24472025-02-23T09:16:35.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3607 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38978 req_id = eb6f4705-c03d-4b11-ae16-55ff7cb771a4 response_code = 200 uri = /network-bootstore-config
24482025-02-23T09:16:35.159ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
24492025-02-23T09:16:35.217ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
24502025-02-23T09:16:35.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 94627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34022 req_id = 68dcd7d9-97ce-40cd-82a3-7fe0719e24bf response_code = 204 uri = /switch-ports
24512025-02-23T09:16:35.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 642 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34022 req_id = 41ea84fa-5220-4090-b6c4-128ec98a9b63 response_code = 200 uri = /network-bootstore-config
24522025-02-23T09:16:35.253ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
24532025-02-23T09:16:35.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 182241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63686 req_id = 42402960-1809-4076-9cf1-83bc6ff72d72 response_code = 204 uri = /switch-ports
24542025-02-23T09:16:35.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63686 req_id = c892d87e-b02d-45fe-b6d1-802372896468 response_code = 200 uri = /network-bootstore-config
24552025-02-23T09:16:40.477ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42307
24562025-02-23T09:16:40.477ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42307 req_id = b4205dab-6a76-4980-a700-e42875263ba8 response_code = 200 uri = /baseboard
24572025-02-23T09:16:47.311ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6198 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 08e6edd9-bf55-49de-8050-f722715b8dc2 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
24582025-02-23T09:17:04.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62664
24592025-02-23T09:17:04.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62664 req_id = 41595f72-733a-4771-abc9-f7e1b4d00f70 response_code = 200 uri = /vpc-routes
24602025-02-23T09:17:04.711ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
24612025-02-23T09:17:04.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62664 req_id = bb46f2a7-3a34-4199-9afd-1045a4213c10 response_code = 204 uri = /eip-gateways
24622025-02-23T09:17:04.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39078
24632025-02-23T09:17:04.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39078 req_id = 934e2ae9-937c-4c21-aebb-fba800c4f4c9 response_code = 200 uri = /vpc-routes
24642025-02-23T09:17:04.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52871
24652025-02-23T09:17:04.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52871 req_id = 391f29b1-7aa9-444a-9285-535798a176c7 response_code = 200 uri = /vpc-routes
24662025-02-23T09:17:04.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41790
24672025-02-23T09:17:04.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41790 req_id = 47c930da-5cfd-4980-b17b-41e3659d1817 response_code = 200 uri = /v2p
24682025-02-23T09:17:04.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62664 req_id = 4b0fd05a-1f0d-4a01-bae7-5e3e992fefd7 response_code = 204 uri = /vpc-routes
24692025-02-23T09:17:04.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
24702025-02-23T09:17:04.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39078 req_id = be33d018-2177-46d1-9deb-afd60a88dc4f response_code = 204 uri = /eip-gateways
24712025-02-23T09:17:04.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55445
24722025-02-23T09:17:04.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55445 req_id = 1700f672-6c82-4eb3-a30e-335a1cfd044c response_code = 200 uri = /v2p
24732025-02-23T09:17:04.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63640
24742025-02-23T09:17:04.779ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
24752025-02-23T09:17:04.824ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
24762025-02-23T09:17:04.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 107413 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63640 req_id = 9f804f84-07a8-4427-a9dd-79167870fc4f response_code = 204 uri = /switch-ports
24772025-02-23T09:17:04.886ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
24782025-02-23T09:17:04.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58482
24792025-02-23T09:17:04.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52871 req_id = 21df0808-22f7-488b-9b4a-eafc42f7d367 response_code = 204 uri = /eip-gateways
24802025-02-23T09:17:04.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49550
24812025-02-23T09:17:04.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63640 req_id = 8746e8fa-4452-4e6a-8bb4-aa6773870ffd response_code = 200 uri = /network-bootstore-config
24822025-02-23T09:17:04.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58482 req_id = 0910aaa2-c3a4-4192-ae13-2094b92bc920 response_code = 200 uri = /v2p
24832025-02-23T09:17:04.887ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
24842025-02-23T09:17:04.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39078 req_id = d48b4705-ff3e-4a36-8004-c038c5a348d9 response_code = 204 uri = /vpc-routes
24852025-02-23T09:17:04.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52871 req_id = 8dbb8d3e-851b-457f-9ad9-cc78c9c38b85 response_code = 204 uri = /vpc-routes
24862025-02-23T09:17:04.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52510
24872025-02-23T09:17:04.926ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
24882025-02-23T09:17:04.980ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
24892025-02-23T09:17:04.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 92906 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49550 req_id = 078abb47-5cb7-4c45-8c97-11a0d0cc4e36 response_code = 204 uri = /switch-ports
24902025-02-23T09:17:04.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 616 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49550 req_id = 420d9319-8575-49f3-bc04-c7908eca7b87 response_code = 200 uri = /network-bootstore-config
24912025-02-23T09:17:05.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
24922025-02-23T09:17:05.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 146598 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52510 req_id = 542bd181-a475-48dc-9aff-ab9de35c3a8b response_code = 204 uri = /switch-ports
24932025-02-23T09:17:05.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52510 req_id = 33db804c-0594-4d5e-bc03-beef93afb272 response_code = 200 uri = /network-bootstore-config
24942025-02-23T09:17:10.510ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56404
24952025-02-23T09:17:10.510ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56404 req_id = 22508c70-4d87-4083-8433-d17e3448a74b response_code = 200 uri = /baseboard
24962025-02-23T09:17:17.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7298 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 2467a044-94c1-4766-9071-7dbacff63c1a response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
24972025-02-23T09:17:34.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58714
24982025-02-23T09:17:34.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58714 req_id = 96deb59d-b8e3-4ae1-adb5-ece86e55bba6 response_code = 200 uri = /vpc-routes
24992025-02-23T09:17:34.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36529
25002025-02-23T09:17:34.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36529 req_id = 407a5f58-f63e-463e-bf06-b28417413b04 response_code = 200 uri = /vpc-routes
25012025-02-23T09:17:34.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61988
25022025-02-23T09:17:34.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61988 req_id = a0a9013b-c068-43e5-a2a1-47eaad5a190c response_code = 200 uri = /v2p
25032025-02-23T09:17:34.900ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
25042025-02-23T09:17:34.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58714 req_id = 3eb206f8-c866-43ae-903d-227de21f17df response_code = 204 uri = /eip-gateways
25052025-02-23T09:17:34.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58714 req_id = c69d73ac-b803-4787-81f0-7f98a5b2206e response_code = 204 uri = /vpc-routes
25062025-02-23T09:17:34.928ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
25072025-02-23T09:17:34.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36529 req_id = fd58b390-6ab9-4c32-a84b-a223c631b35c response_code = 204 uri = /eip-gateways
25082025-02-23T09:17:34.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36529 req_id = 8cd58b2f-066e-46e0-bde3-345453f399d7 response_code = 204 uri = /vpc-routes
25092025-02-23T09:17:34.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50294
25102025-02-23T09:17:34.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50294 req_id = e4b4ae2f-8cbb-4cde-9186-b93fb7a6d1dd response_code = 200 uri = /vpc-routes
25112025-02-23T09:17:35.042ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
25122025-02-23T09:17:35.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50294 req_id = 3e21d6a5-7d28-4980-9eb1-5e654c4497e6 response_code = 204 uri = /eip-gateways
25132025-02-23T09:17:35.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50294 req_id = cc360848-5476-49fd-a70b-7ad99ba91636 response_code = 204 uri = /vpc-routes
25142025-02-23T09:17:35.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58679
25152025-02-23T09:17:35.062ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
25162025-02-23T09:17:35.101ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
25172025-02-23T09:17:35.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 104411 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58679 req_id = bd2cc7ad-3295-4954-be73-7350bd56368b response_code = 204 uri = /switch-ports
25182025-02-23T09:17:35.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63551
25192025-02-23T09:17:35.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49061
25202025-02-23T09:17:35.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56620
25212025-02-23T09:17:35.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58679 req_id = 82ac57b9-1a24-481a-a2d1-3c0955e7f320 response_code = 200 uri = /network-bootstore-config
25222025-02-23T09:17:35.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56620 req_id = afe99dfd-9755-4d8f-a782-db2b6f721a5b response_code = 200 uri = /v2p
25232025-02-23T09:17:35.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49061 req_id = 18223c32-2cee-4a08-832f-f0541c7de0f2 response_code = 200 uri = /v2p
25242025-02-23T09:17:35.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
25252025-02-23T09:17:35.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48426
25262025-02-23T09:17:35.209ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
25272025-02-23T09:17:35.270ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
25282025-02-23T09:17:35.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 103341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63551 req_id = 7b927077-5006-46c6-8b2d-3a71133053fa response_code = 204 uri = /switch-ports
25292025-02-23T09:17:35.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 757 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63551 req_id = 16379c9b-4b50-4cd6-bee4-bb40af0ef69b response_code = 200 uri = /network-bootstore-config
25302025-02-23T09:17:35.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
25312025-02-23T09:17:35.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 167046 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48426 req_id = a45851e5-9491-49aa-a380-8979e5446ae4 response_code = 204 uri = /switch-ports
25322025-02-23T09:17:35.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48426 req_id = 566e9b24-22dc-416a-8223-bf21c917e9a2 response_code = 200 uri = /network-bootstore-config
25332025-02-23T09:17:40.553ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42606
25342025-02-23T09:17:40.554ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42606 req_id = 4111ed2b-7252-432a-b2bd-5e596e3bc6da response_code = 200 uri = /baseboard
25352025-02-23T09:17:47.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7262 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 447ecb2e-e397-4c92-a659-d264f37438d5 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
25362025-02-23T09:18:04.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37699
25372025-02-23T09:18:04.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37699 req_id = 20ad98ab-c01b-446e-802d-b760f59447ce response_code = 200 uri = /vpc-routes
25382025-02-23T09:18:04.721ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
25392025-02-23T09:18:04.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37699 req_id = 364a8657-2694-4b7f-b3f2-0b52ca2ee172 response_code = 204 uri = /eip-gateways
25402025-02-23T09:18:04.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37699 req_id = 23c6d5b4-1bed-4c78-88cb-02aad8afbd58 response_code = 204 uri = /vpc-routes
25412025-02-23T09:18:04.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47656
25422025-02-23T09:18:04.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47656 req_id = 8fef05a0-cbae-4513-8480-eae51740f668 response_code = 200 uri = /vpc-routes
25432025-02-23T09:18:04.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
25442025-02-23T09:18:04.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47656 req_id = 1c01f412-cb52-4692-9197-487d01e9b7f9 response_code = 204 uri = /eip-gateways
25452025-02-23T09:18:04.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47656 req_id = 4e56b73d-df6d-43dc-abe1-31b266a523a8 response_code = 204 uri = /vpc-routes
25462025-02-23T09:18:04.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63629
25472025-02-23T09:18:04.845ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
25482025-02-23T09:18:04.897ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
25492025-02-23T09:18:04.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 136189 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63629 req_id = c0475958-e3c3-44e5-9d56-26060065fa4b response_code = 204 uri = /switch-ports
25502025-02-23T09:18:04.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51289
25512025-02-23T09:18:04.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40321
25522025-02-23T09:18:04.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62594
25532025-02-23T09:18:04.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38435
25542025-02-23T09:18:04.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46759
25552025-02-23T09:18:04.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57587
25562025-02-23T09:18:04.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51289 req_id = e6620f90-5654-4be4-a2ca-a26e3e586f14 response_code = 200 uri = /vpc-routes
25572025-02-23T09:18:04.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46759 req_id = 517bd61a-0dd0-40a6-9bce-331a48c8dc5b response_code = 200 uri = /v2p
25582025-02-23T09:18:04.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40321 req_id = 63b7e8db-e4b7-42e4-b308-62878e3e3d09 response_code = 200 uri = /v2p
25592025-02-23T09:18:04.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 549 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63629 req_id = 32b348e5-7a6a-47df-a594-e111c7dd74a0 response_code = 200 uri = /network-bootstore-config
25602025-02-23T09:18:04.982ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
25612025-02-23T09:18:04.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38435 req_id = 2d6799a8-fe91-45e8-9b0a-b83a13821663 response_code = 200 uri = /v2p
25622025-02-23T09:18:05.005ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
25632025-02-23T09:18:05.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 717 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51289 req_id = 699155b4-19b3-4d89-9d7b-768e0284395b response_code = 204 uri = /eip-gateways
25642025-02-23T09:18:05.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1026 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51289 req_id = 72d27034-8066-4a40-9a39-9f447e5f6d04 response_code = 204 uri = /vpc-routes
25652025-02-23T09:18:05.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
25662025-02-23T09:18:05.119ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
25672025-02-23T09:18:05.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 136683 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62594 req_id = 0bd41ce3-02f1-4151-9508-87ecf7ac999a response_code = 204 uri = /switch-ports
25682025-02-23T09:18:05.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 909 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62594 req_id = db93ff69-b7b5-4aa3-bfa2-19e5138c1c37 response_code = 200 uri = /network-bootstore-config
25692025-02-23T09:18:05.169ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
25702025-02-23T09:18:05.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 262189 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57587 req_id = 17975bec-4f9f-416c-8daa-a5f77dd43d20 response_code = 204 uri = /switch-ports
25712025-02-23T09:18:05.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57587 req_id = 627dbb2f-b144-4985-af28-28fea49441e4 response_code = 200 uri = /network-bootstore-config
25722025-02-23T09:18:10.588ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37853
25732025-02-23T09:18:10.588ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37853 req_id = 48cbe9df-7c63-4adb-84c9-8d32aa14c916 response_code = 200 uri = /baseboard
25742025-02-23T09:18:17.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6511 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = fb197236-fed2-4061-bd01-e7f4c9c4cd26 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
25752025-02-23T09:18:34.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53918
25762025-02-23T09:18:34.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53918 req_id = f17e6f1e-a7c2-4f20-bb14-f61f692a9347 response_code = 200 uri = /vpc-routes
25772025-02-23T09:18:34.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54229
25782025-02-23T09:18:34.978ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25792025-02-23T09:18:34.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 456 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54229 req_id = 2a9229ac-90f3-420b-9ba2-4f6a436ed130 response_code = 200 uri = /artifacts
25802025-02-23T09:18:35.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34497
25812025-02-23T09:18:35.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34497 req_id = 8b7a057a-d5a3-4e56-a147-632f049914b5 response_code = 200 uri = /vpc-routes
25822025-02-23T09:18:35.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
25832025-02-23T09:18:35.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53918 req_id = 971c3931-11c3-450e-afc8-5a3132222c65 response_code = 204 uri = /eip-gateways
25842025-02-23T09:18:35.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48288
25852025-02-23T09:18:35.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48288 req_id = ba1689a8-c64c-4a14-9623-7e7aa5d0f06e response_code = 200 uri = /vpc-routes
25862025-02-23T09:18:35.087ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
25872025-02-23T09:18:35.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34497 req_id = 10942e79-ee73-4b33-9ca4-eaedb6577c48 response_code = 204 uri = /eip-gateways
25882025-02-23T09:18:35.129ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
25892025-02-23T09:18:35.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48288 req_id = 97c56ed2-0575-4e9d-a4fd-860c21fef6eb response_code = 204 uri = /eip-gateways
25902025-02-23T09:18:35.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49061
25912025-02-23T09:18:35.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25922025-02-23T09:18:35.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49061 req_id = 33d147a0-ac67-4150-93c8-8e2f020cb03f response_code = 200 uri = /artifacts
25932025-02-23T09:18:35.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43354
25942025-02-23T09:18:35.133ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
25952025-02-23T09:18:35.177ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
25962025-02-23T09:18:35.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 113828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43354 req_id = 4e84d856-89cb-48b7-97b8-1f1a1bcb57b1 response_code = 204 uri = /switch-ports
25972025-02-23T09:18:35.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59284
25982025-02-23T09:18:35.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38168
25992025-02-23T09:18:35.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44742
26002025-02-23T09:18:35.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62419
26012025-02-23T09:18:35.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 622 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34497 req_id = d555c37f-8195-46c6-8a13-bc0693a8e0d3 response_code = 204 uri = /vpc-routes
26022025-02-23T09:18:35.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52066
26032025-02-23T09:18:35.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37524
26042025-02-23T09:18:35.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 447 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43354 req_id = dc7ee189-065e-454e-8805-785d169f354e response_code = 200 uri = /network-bootstore-config
26052025-02-23T09:18:35.247ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26062025-02-23T09:18:35.248ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26072025-02-23T09:18:35.248ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26082025-02-23T09:18:35.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 675 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48288 req_id = 0e0b5e02-ad09-45b8-b41b-4e0f7e0132d2 response_code = 204 uri = /vpc-routes
26092025-02-23T09:18:35.248ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-zones.json file = common/src/ledger.rs:177
26102025-02-23T09:18:35.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1014 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53918 req_id = c4d1ec21-f75a-45c6-a702-036146022c5d response_code = 204 uri = /vpc-routes
26112025-02-23T09:18:35.248ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26122025-02-23T09:18:35.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38168 req_id = 97ead40d-b4e9-4e1c-8245-7a77a6cb9016 response_code = 200 uri = /artifacts
26132025-02-23T09:18:35.249ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-zones.json file = common/src/ledger.rs:177
26142025-02-23T09:18:35.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32830
26152025-02-23T09:18:35.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1411 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44742 req_id = 2d33b61e-fabd-444a-b66f-2e3910663ba0 response_code = 200 uri = /v2p
26162025-02-23T09:18:35.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37524 req_id = 5a5ea28e-06f1-4ecd-b8c4-6e3f5030558e response_code = 200 uri = /v2p
26172025-02-23T09:18:35.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52066 req_id = a08ae873-6b19-4257-bc03-4a5c394b99a9 response_code = 200 uri = /v2p
26182025-02-23T09:18:35.249ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
26192025-02-23T09:18:35.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45850
26202025-02-23T09:18:35.269ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26212025-02-23T09:18:35.270ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff
26222025-02-23T09:18:35.285ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26232025-02-23T09:18:35.285ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-zones.json file = common/src/ledger.rs:177
26242025-02-23T09:18:35.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63136
26252025-02-23T09:18:35.289ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-zones.json file = common/src/ledger.rs:177
26262025-02-23T09:18:35.290ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26272025-02-23T09:18:35.290ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26282025-02-23T09:18:35.290ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26292025-02-23T09:18:35.290ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26302025-02-23T09:18:35.290ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26312025-02-23T09:18:35.290ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26322025-02-23T09:18:35.290ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26332025-02-23T09:18:35.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1059 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63136 req_id = 85eb4a74-d067-47d8-8db6-36bc3ccfa3e6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26342025-02-23T09:18:35.297ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
26352025-02-23T09:18:35.302ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26362025-02-23T09:18:35.302ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9e960c69-de8b-458e-900f-827df5fd1555
26372025-02-23T09:18:35.317ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26382025-02-23T09:18:35.317ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff
26392025-02-23T09:18:35.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60238
26402025-02-23T09:18:35.332ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26412025-02-23T09:18:35.332ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26422025-02-23T09:18:35.332ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/config/omicron-zones.json file = common/src/ledger.rs:177
26432025-02-23T09:18:35.342ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/67cffe32-ab3a-41cf-b933-841677f02710/config/omicron-zones.json file = common/src/ledger.rs:177
26442025-02-23T09:18:35.346ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26452025-02-23T09:18:35.346ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b04b1013-1fd4-4342-9735-04e35a199534
26462025-02-23T09:18:35.361ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26472025-02-23T09:18:35.361ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9e960c69-de8b-458e-900f-827df5fd1555
26482025-02-23T09:18:35.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
26492025-02-23T09:18:35.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 119148 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32830 req_id = 2e63ce88-9cc9-41b4-90b3-d5ca20361b03 response_code = 204 uri = /switch-ports
26502025-02-23T09:18:35.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 698 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32830 req_id = 9e10cb06-4a5b-47d3-abc3-82e7266b67e5 response_code = 200 uri = /network-bootstore-config
26512025-02-23T09:18:35.374ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 082d2d6d-bfa6-4c91-9ee2-28a851a53dff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26522025-02-23T09:18:35.374ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_082d2d6d-bfa6-4c91-9ee2-28a851a53dff
26532025-02-23T09:18:35.392ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26542025-02-23T09:18:35.392ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7f9f3d10-8155-4511-8c83-34282eab634b
26552025-02-23T09:18:35.409ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9e960c69-de8b-458e-900f-827df5fd1555 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26562025-02-23T09:18:35.409ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9e960c69-de8b-458e-900f-827df5fd1555
26572025-02-23T09:18:35.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53524
26582025-02-23T09:18:35.417ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26592025-02-23T09:18:35.417ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26602025-02-23T09:18:35.417ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26612025-02-23T09:18:35.417ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26622025-02-23T09:18:35.417ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26632025-02-23T09:18:35.417ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26642025-02-23T09:18:35.417ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26652025-02-23T09:18:35.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 478 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53524 req_id = 378ac490-ebea-4363-8b7e-4a0920890c69 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26662025-02-23T09:18:35.418ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
26672025-02-23T09:18:35.422ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26682025-02-23T09:18:35.422ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b04b1013-1fd4-4342-9735-04e35a199534
26692025-02-23T09:18:35.438ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26702025-02-23T09:18:35.438ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7
26712025-02-23T09:18:35.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37056
26722025-02-23T09:18:35.450ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 72064d19-a4cd-462f-94d7-2f36f3f536de, kind: Service { id: f3ffb120-bf15-43b5-89a1-5c5964c0413c }, name: Name("external-dns-f3ffb120-bf15-43b5-89a1-5c5964c0413c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 223, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 996a4399-6cd1-4643-b3c3-a8ede47543c5, kind: Service { id: 2a04c699-57fd-4088-9fd0-fe8bfd6f8efc }, name: Name("external-dns-2a04c699-57fd-4088-9fd0-fe8bfd6f8efc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 31])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2c5144d0-63c7-413c-9f65-75e16be8f103, kind: Service { id: 1c608ad8-8827-4c81-ba57-e92e029dcde3 }, name: Name("nexus-1c608ad8-8827-4c81-ba57-e92e029dcde3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 38])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 57f7e754-43f5-42ad-9446-caa23c723019, kind: Service { id: 8fbc9147-85c4-4227-a40c-e65d635ffa42 }, name: Name("nexus-8fbc9147-85c4-4227-a40c-e65d635ffa42"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 114])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5f7b7e00-88c7-49e6-a3da-2a5ce71a16e9, kind: Service { id: 0edf32a7-089c-41ca-a008-be55b6f78c05 }, name: Name("nexus-0edf32a7-089c-41ca-a008-be55b6f78c05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26732025-02-23T09:18:35.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26742025-02-23T09:18:35.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26752025-02-23T09:18:35.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26762025-02-23T09:18:35.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26772025-02-23T09:18:35.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26782025-02-23T09:18:35.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26792025-02-23T09:18:35.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 753 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37056 req_id = 15d8155d-5ae0-43f2-9858-61a0fa73f2d4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26802025-02-23T09:18:35.452ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26812025-02-23T09:18:35.452ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7f9f3d10-8155-4511-8c83-34282eab634b
26822025-02-23T09:18:35.465ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b04b1013-1fd4-4342-9735-04e35a199534 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26832025-02-23T09:18:35.466ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b04b1013-1fd4-4342-9735-04e35a199534
26842025-02-23T09:18:35.480ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26852025-02-23T09:18:35.480ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dd28684b-0582-4159-82e0-305747c1d637
26862025-02-23T09:18:35.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 233956 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45850 req_id = e6b37e98-8ed4-487d-b57c-ca6181705a7f response_code = 204 uri = /switch-ports
26872025-02-23T09:18:35.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45850 req_id = 2690426a-46eb-46a3-9ee4-7616688717bb response_code = 200 uri = /network-bootstore-config
26882025-02-23T09:18:35.495ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7f9f3d10-8155-4511-8c83-34282eab634b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26892025-02-23T09:18:35.495ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7f9f3d10-8155-4511-8c83-34282eab634b
26902025-02-23T09:18:35.509ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26912025-02-23T09:18:35.509ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7
26922025-02-23T09:18:35.525ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26932025-02-23T09:18:35.526ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_52c0a5e3-b03e-446e-9e20-336c4f905023
26942025-02-23T09:18:35.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26952025-02-23T09:18:35.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dd28684b-0582-4159-82e0-305747c1d637
26962025-02-23T09:18:35.552ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2736dc46-9484-41a0-aed3-8b7963b1f6f7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26972025-02-23T09:18:35.552ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2736dc46-9484-41a0-aed3-8b7963b1f6f7
26982025-02-23T09:18:35.566ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26992025-02-23T09:18:35.567ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32f1e829-361d-464b-83d6-3092853cc1e7
27002025-02-23T09:18:35.580ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dd28684b-0582-4159-82e0-305747c1d637 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27012025-02-23T09:18:35.580ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dd28684b-0582-4159-82e0-305747c1d637
27022025-02-23T09:18:35.591ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27032025-02-23T09:18:35.591ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_52c0a5e3-b03e-446e-9e20-336c4f905023
27042025-02-23T09:18:35.606ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27052025-02-23T09:18:35.606ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4
27062025-02-23T09:18:35.621ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27072025-02-23T09:18:35.621ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32f1e829-361d-464b-83d6-3092853cc1e7
27082025-02-23T09:18:35.632ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52c0a5e3-b03e-446e-9e20-336c4f905023 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27092025-02-23T09:18:35.632ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_52c0a5e3-b03e-446e-9e20-336c4f905023
27102025-02-23T09:18:35.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 389064 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59284 req_id = 0ed1414b-9854-4e68-87bf-546047cff955 response_code = 200 uri = /inventory
27112025-02-23T09:18:35.654ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32f1e829-361d-464b-83d6-3092853cc1e7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27122025-02-23T09:18:35.654ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32f1e829-361d-464b-83d6-3092853cc1e7
27132025-02-23T09:18:35.666ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27142025-02-23T09:18:35.666ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4
27152025-02-23T09:18:35.679ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27162025-02-23T09:18:35.679ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4
27172025-02-23T09:18:35.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 436138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62419 req_id = 2b7c72c4-6bac-467c-8d9f-ad7ac27bb1fe response_code = 200 uri = /inventory
27182025-02-23T09:18:35.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 362308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60238 req_id = ca59bce8-e474-4fcc-bae4-38e0675a1f7a response_code = 200 uri = /inventory
27192025-02-23T09:18:40.622ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43745
27202025-02-23T09:18:40.622ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43745 req_id = 35bb60af-685e-46af-9a35-95267407b945 response_code = 200 uri = /baseboard
27212025-02-23T09:18:47.312ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6542 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = bcb9c655-e085-4d4b-8513-62ddd1f77632 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27222025-02-23T09:19:04.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61973
27232025-02-23T09:19:04.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61973 req_id = 34f9c48f-d1df-489c-88ae-6cd1bf0489a3 response_code = 200 uri = /v2p
27242025-02-23T09:19:04.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53114
27252025-02-23T09:19:04.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53114 req_id = efaf8910-598a-4878-96cd-c17bff36f455 response_code = 200 uri = /vpc-routes
27262025-02-23T09:19:04.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56420
27272025-02-23T09:19:04.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56420 req_id = f53f0a7e-6e00-4aab-b411-f5c1a8e13301 response_code = 200 uri = /vpc-routes
27282025-02-23T09:19:04.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34402
27292025-02-23T09:19:04.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34402 req_id = 337eee3d-a716-4432-af7f-e2a6ce45e910 response_code = 200 uri = /vpc-routes
27302025-02-23T09:19:04.796ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
27312025-02-23T09:19:04.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53114 req_id = 67ae983e-6689-419a-968b-bf3133bca3af response_code = 204 uri = /eip-gateways
27322025-02-23T09:19:04.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53114 req_id = ada014e4-3f22-40c1-8a01-66d1ef387eb7 response_code = 204 uri = /vpc-routes
27332025-02-23T09:19:04.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41834
27342025-02-23T09:19:04.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41834 req_id = 61819e22-5cb3-4530-bcfc-64e7347e930b response_code = 200 uri = /v2p
27352025-02-23T09:19:04.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37879
27362025-02-23T09:19:04.811ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
27372025-02-23T09:19:04.853ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
27382025-02-23T09:19:04.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 105436 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37879 req_id = 7ed6b4e0-d043-4172-b28c-0ef78b663c08 response_code = 204 uri = /switch-ports
27392025-02-23T09:19:04.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
27402025-02-23T09:19:04.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34402 req_id = 209c6903-a576-423e-bda0-d5c2ebde92d8 response_code = 204 uri = /eip-gateways
27412025-02-23T09:19:04.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50876
27422025-02-23T09:19:04.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44144
27432025-02-23T09:19:04.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50697
27442025-02-23T09:19:04.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
27452025-02-23T09:19:04.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37879 req_id = 8194cf21-a1dc-4fb9-8ea7-6065950de34f response_code = 200 uri = /network-bootstore-config
27462025-02-23T09:19:04.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56420 req_id = f99beb3a-4416-4863-96d8-93609ebf1295 response_code = 204 uri = /eip-gateways
27472025-02-23T09:19:04.917ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
27482025-02-23T09:19:04.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50876 req_id = 7071f245-ad63-427d-ae7b-90ed6ffb8ea9 response_code = 200 uri = /v2p
27492025-02-23T09:19:04.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34402 req_id = 91bf797e-ebae-4351-b76e-f639d20ea492 response_code = 204 uri = /vpc-routes
27502025-02-23T09:19:04.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56420 req_id = a2bfa2d3-ab70-400f-8248-fa6a739bf50f response_code = 204 uri = /vpc-routes
27512025-02-23T09:19:04.956ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
27522025-02-23T09:19:05.005ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
27532025-02-23T09:19:05.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 87945 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50697 req_id = d87d07b8-f278-49fb-802a-749ccc8a4d70 response_code = 204 uri = /switch-ports
27542025-02-23T09:19:05.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 753 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50697 req_id = 8d2cbceb-a7a7-45fc-b216-5811a7dfa993 response_code = 200 uri = /network-bootstore-config
27552025-02-23T09:19:05.041ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
27562025-02-23T09:19:05.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 172968 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44144 req_id = e473baed-a68b-4845-90e8-260cdf3c09f1 response_code = 204 uri = /switch-ports
27572025-02-23T09:19:05.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44144 req_id = 829b4129-07ea-4c1e-89d7-95737a8461b2 response_code = 200 uri = /network-bootstore-config
27582025-02-23T09:19:10.655ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38290
27592025-02-23T09:19:10.655ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38290 req_id = 555ad56c-24a7-4fa1-947e-6d38d138fda2 response_code = 200 uri = /baseboard
27602025-02-23T09:19:17.313ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6632 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 063d3b9b-9c8d-403f-87a3-b86714a43459 response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
27612025-02-23T09:19:30.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47247
27622025-02-23T09:19:30.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47247 req_id = 3a7f101c-e5f1-4992-b5b6-9be5bd6c7e8a response_code = 200 uri = /v2p
27632025-02-23T09:19:30.790ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(3629862) }
27642025-02-23T09:19:30.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 982 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47247 req_id = 43d93b9c-f175-4e5c-bdcd-f7e039f97153 response_code = 204 uri = /v2p
27652025-02-23T09:19:30.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58130
27662025-02-23T09:19:30.895ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 811bce30-4b1c-44f7-b977-ef3ad843ae0d, kind: Instance { id: f0be0cb4-fbd7-4108-a303-a66f178852ff }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3629862), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 811bce30-4b1c-44f7-b977-ef3ad843ae0d, kind: Instance { id: f0be0cb4-fbd7-4108-a303-a66f178852ff }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3629862), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 811bce30-4b1c-44f7-b977-ef3ad843ae0d, kind: Instance { id: f0be0cb4-fbd7-4108-a303-a66f178852ff }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3629862), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(3629862))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 811bce30-4b1c-44f7-b977-ef3ad843ae0d, kind: Instance { id: f0be0cb4-fbd7-4108-a303-a66f178852ff }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3629862), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 5673a362-637f-452e-8232-668411970d3e, slot: 0, read_only: false, vcr_json: .., name: "disk-f58ce7e220d" }], boot_settings: Some(InstanceBootSettings { order: [5673a362-637f-452e-8232-668411970d3e] }), cloud_init_bytes: Some(..) } instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff metadata = InstanceMetadata { silo_id: e9f38e2e-3bd8-4187-a100-da5edd2fe30a, project_id: 821b2b06-0bf7-4afc-8957-c8893994aeac } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-23T09:19:30.886723491Z }
27672025-02-23T09:19:30.895ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff migration_id = None propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
27682025-02-23T09:19:30.895ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1565 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff migration_id = None propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 811bce30-4b1c-44f7-b977-ef3ad843ae0d, kind: Instance { id: f0be0cb4-fbd7-4108-a303-a66f178852ff }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3629862), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 811bce30-4b1c-44f7-b977-ef3ad843ae0d, kind: Instance { id: f0be0cb4-fbd7-4108-a303-a66f178852ff }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3629862), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 811bce30-4b1c-44f7-b977-ef3ad843ae0d, kind: Instance { id: f0be0cb4-fbd7-4108-a303-a66f178852ff }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3629862), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(3629862))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 811bce30-4b1c-44f7-b977-ef3ad843ae0d, kind: Instance { id: f0be0cb4-fbd7-4108-a303-a66f178852ff }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3629862), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 5673a362-637f-452e-8232-668411970d3e, slot: 0, read_only: false, vcr_json: .., name: "disk-f58ce7e220d" }], boot_settings: Some(InstanceBootSettings { order: [5673a362-637f-452e-8232-668411970d3e] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-23T09:19:30.886723491Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27692025-02-23T09:19:30.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 10714 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58130 req_id = ccc5ba5c-27ab-4a81-9211-f095d5f72207 response_code = 200 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07
27702025-02-23T09:19:31.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50069
27712025-02-23T09:19:31.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50069 req_id = 69752bdf-d5d9-4cab-adf9-6b9c7cffce38 response_code = 200 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07/state
27722025-02-23T09:19:31.030ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 3629862 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27732025-02-23T09:19:31.030ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27742025-02-23T09:19:31.073ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07 file = illumos-utils/src/zone.rs:325 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
27752025-02-23T09:19:31.100ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07 file = illumos-utils/src/zone.rs:363 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
27762025-02-23T09:19:31.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50890
27772025-02-23T09:19:31.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50890 req_id = f7e1c2b2-8e96-4c19-af1b-5a8f6e241b07 response_code = 200 uri = /vpc-routes
27782025-02-23T09:19:31.172ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {811bce30-4b1c-44f7-b977-ef3ad843ae0d: {10.151.1.176: {e62946f6-89b3-40be-a86f-d8150af7572b}, 10.151.1.175: {e62946f6-89b3-40be-a86f-d8150af7572b}}} }
27792025-02-23T09:19:32.731ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
27802025-02-23T09:19:32.731ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07 zone file = illumos-utils/src/running_zone.rs:489 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 zone = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
27812025-02-23T09:19:32.933ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07") failed: Property not found. retry in 41.302324ms file = illumos-utils/src/svc.rs:42 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 zone = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
27822025-02-23T09:19:32.982ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07") failed: Property not found. retry in 131.68408ms file = illumos-utils/src/svc.rs:42 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 zone = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
27832025-02-23T09:19:33.138ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07") failed: Property not found. retry in 185.29189ms file = illumos-utils/src/svc.rs:42 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 zone = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
27842025-02-23T09:19:33.337ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07") failed: Property not found. retry in 292.89134ms file = illumos-utils/src/svc.rs:42 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 zone = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
27852025-02-23T09:19:33.645ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07") failed: Property not found. retry in 862.021335ms file = illumos-utils/src/svc.rs:42 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 zone = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
27862025-02-23T09:19:34.524ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07") failed: Property not found. retry in 615.985933ms file = illumos-utils/src/svc.rs:42 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 zone = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
27872025-02-23T09:19:34.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48628
27882025-02-23T09:19:34.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56032
27892025-02-23T09:19:34.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53979
27902025-02-23T09:19:34.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38721
27912025-02-23T09:19:34.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38721 req_id = 6e538466-9905-490e-904b-2ebe513f5e6f response_code = 200 uri = /vpc-routes
27922025-02-23T09:19:34.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52356
27932025-02-23T09:19:34.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52356 req_id = fba16df0-81c8-4d33-a6b4-e42670d2fe25 response_code = 200 uri = /vpc-routes
27942025-02-23T09:19:34.971ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {811bce30-4b1c-44f7-b977-ef3ad843ae0d: {10.151.1.175: {e62946f6-89b3-40be-a86f-d8150af7572b}, 10.151.1.176: {e62946f6-89b3-40be-a86f-d8150af7572b}}} }
27952025-02-23T09:19:34.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38721 req_id = 5f2cf23a-4e47-470f-a564-f94dcf31ec86 response_code = 204 uri = /eip-gateways
27962025-02-23T09:19:34.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {811bce30-4b1c-44f7-b977-ef3ad843ae0d: {10.151.1.176: {e62946f6-89b3-40be-a86f-d8150af7572b}, 10.151.1.175: {e62946f6-89b3-40be-a86f-d8150af7572b}}} }
27972025-02-23T09:19:34.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52356 req_id = 2aafb01f-6b77-4109-8792-79dd0c221417 response_code = 204 uri = /eip-gateways
27982025-02-23T09:19:35.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49433
27992025-02-23T09:19:35.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49433 req_id = 3c1c3adf-25cc-44ff-8967-a63d29e9b182 response_code = 200 uri = /v2p
28002025-02-23T09:19:35.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38820
28012025-02-23T09:19:35.053ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
28022025-02-23T09:19:35.099ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
28032025-02-23T09:19:35.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 119843 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38820 req_id = 8db9f1a1-05e1-41ef-b3d0-6b18801df1fd response_code = 204 uri = /switch-ports
28042025-02-23T09:19:35.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55962
28052025-02-23T09:19:35.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56086
28062025-02-23T09:19:35.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50789
28072025-02-23T09:19:35.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 866 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38820 req_id = 49e082d9-1371-43f2-a0c0-2c7ad4f386e1 response_code = 200 uri = /network-bootstore-config
28082025-02-23T09:19:35.178ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
28092025-02-23T09:19:35.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33569
28102025-02-23T09:19:35.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55962 req_id = ba48f2a1-fe2d-44a4-bc36-6fd1cd0a4559 response_code = 200 uri = /v2p
28112025-02-23T09:19:35.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33569 req_id = dc05dd12-bb18-4539-9ed2-89eafd0e871e response_code = 200 uri = /v2p
28122025-02-23T09:19:35.186ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07") failed: Property not found. retry in 911.338119ms file = illumos-utils/src/svc.rs:42 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 zone = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
28132025-02-23T09:19:35.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38721 req_id = 13acf619-ef94-419f-8311-4b7b468cd3ad response_code = 204 uri = /vpc-routes
28142025-02-23T09:19:35.218ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
28152025-02-23T09:19:35.223ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: dcae4495-9e46-4681-9480-edd6fca66881, version: 3 } old_vers = RouterVersion { router_id: dcae4495-9e46-4681-9480-edd6fca66881, version: 3 } subnet = RouterId { vni: Vni(3629862), kind: System }
28162025-02-23T09:19:35.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52356 req_id = 714419a1-e549-4cff-a0b8-07672ceb7ee7 response_code = 204 uri = /vpc-routes
28172025-02-23T09:19:35.280ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4190
28182025-02-23T09:19:35.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 101744 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56086 req_id = aea2c15d-f4f7-4116-9791-48da29e3a76a response_code = 204 uri = /switch-ports
28192025-02-23T09:19:35.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 750 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56086 req_id = bf5f1951-2688-4c7b-b6ab-d3cbe45ffa79 response_code = 200 uri = /network-bootstore-config
28202025-02-23T09:19:35.317ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4214
28212025-02-23T09:19:35.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 193116 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50789 req_id = c0788aa0-150a-40be-ab2f-f7cd2ee2cbbc response_code = 204 uri = /switch-ports
28222025-02-23T09:19:35.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50789 req_id = 864ff3b6-d973-484d-83a0-a0e8bb8e8c47 response_code = 200 uri = /network-bootstore-config
28232025-02-23T09:19:36.108ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07") failed: Property not found. retry in 1.305541433s file = illumos-utils/src/svc.rs:42 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 zone = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
28242025-02-23T09:19:37.425ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07") failed: Property not found. retry in 1.244797713s file = illumos-utils/src/svc.rs:42 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 zone = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
28252025-02-23T09:19:38.696ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07 file = sled-agent/src/instance.rs:2073 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28262025-02-23T09:19:38.706ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2082 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28272025-02-23T09:19:38.744ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2106 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28282025-02-23T09:19:38.828ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1216 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28292025-02-23T09:19:38.829ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28302025-02-23T09:19:38.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3922889 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53979 req_id = f4c98ea8-3003-492c-b3cc-bcc8222527ef response_code = 200 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07/state
28312025-02-23T09:19:38.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4018371 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48628 req_id = 2a4c1337-7ba6-4ec3-9a4d-9b4cc0286b1b response_code = 200 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07/state
28322025-02-23T09:19:38.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3953672 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56032 req_id = 64fa3a3b-cc7c-4af1-94c0-a635f001d80e response_code = 200 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07/state
28332025-02-23T09:19:38.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7657763 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50890 req_id = 3db9bee3-15f7-4505-ad74-e54890227f07 response_code = 204 uri = /eip-gateways
28342025-02-23T09:19:38.829ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-02-23T09:19:38.829609465Z } file = sled-agent/src/instance.rs:782 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28352025-02-23T09:19:38.829ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-23T09:19:38.829609465Z } propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28362025-02-23T09:19:38.829ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-23T09:19:38.829609465Z }, migration_in: None, migration_out: None }
28372025-02-23T09:19:38.910ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-02-23T09:19:38.910809694Z } file = sled-agent/src/instance.rs:782 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28382025-02-23T09:19:38.910ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-23T09:19:38.910809694Z } propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28392025-02-23T09:19:38.910ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-23T09:19:38.910809694Z }, migration_in: None, migration_out: None }
28402025-02-23T09:19:38.963ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: dcae4495-9e46-4681-9480-edd6fca66881, version: 3 } old_vers = RouterVersion { router_id: dcae4495-9e46-4681-9480-edd6fca66881, version: 3 } subnet = RouterId { vni: Vni(3629862), kind: System }
28412025-02-23T09:19:38.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50890 req_id = 3354aa6c-637d-4433-a867-95576e5f11c8 response_code = 204 uri = /vpc-routes
28422025-02-23T09:19:39.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63290
28432025-02-23T09:19:39.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63290 req_id = bfa8feaa-b7a7-41e0-a4ac-9c0550425432 response_code = 200 uri = /vpc-routes
28442025-02-23T09:19:39.103ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {811bce30-4b1c-44f7-b977-ef3ad843ae0d: {10.151.1.175: {e62946f6-89b3-40be-a86f-d8150af7572b}, 10.151.1.176: {e62946f6-89b3-40be-a86f-d8150af7572b}}} }
28452025-02-23T09:19:39.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63290 req_id = 65130a27-fc96-4c68-8f30-f3ca523c1a22 response_code = 204 uri = /eip-gateways
28462025-02-23T09:19:39.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63290 req_id = e6c73835-3617-406c-be8b-5163e6379862 response_code = 204 uri = /vpc-routes
28472025-02-23T09:19:40.686ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38015
28482025-02-23T09:19:40.687ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38015 req_id = b1b042fb-164b-416f-b936-282340dc3484 response_code = 200 uri = /baseboard
28492025-02-23T09:19:47.313ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6305 local_addr = [fd00:1122:3344:101::1]:58504 method = GET remote_addr = [fd00:1122:3344:101::d]:56998 req_id = 0c6abf12-6328-46e3-990f-1c7549dd219e response_code = 200 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b uri = /367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28502025-02-23T09:19:48.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50655
28512025-02-23T09:19:48.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 619 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50655 req_id = 242d63aa-1a42-4fe7-bab1-ccd22c6c59b4 response_code = 200 uri = /vmms/5e1af37a-c8d1-40b1-9b90-66915c077e07/state
28522025-02-23T09:19:48.622ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-02-23T09:19:48.622383693Z } file = sled-agent/src/instance.rs:782 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28532025-02-23T09:19:48.622ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-23T09:19:48.622383693Z } propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28542025-02-23T09:19:48.622ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-23T09:19:48.622383693Z }, migration_in: None, migration_out: None }
28552025-02-23T09:19:48.667ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-02-23T09:19:48.667338525Z } file = sled-agent/src/instance.rs:782 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28562025-02-23T09:19:48.667ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-02-23T09:19:48.667338525Z } propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28572025-02-23T09:19:48.667ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:818 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28582025-02-23T09:19:48.667ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28592025-02-23T09:19:48.667ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28602025-02-23T09:19:48.667ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/67cffe32-ab3a-41cf-b933-841677f02710/debug/bundle/zone", "/pool/int/fd8d21b3-29c3-4d3c-958a-941ca0a566f2/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/082d2d6d-bfa6-4c91-9ee2-28a851a53dff/crypt/debug", "/pool/ext/9e960c69-de8b-458e-900f-827df5fd1555/crypt/debug", "/pool/ext/b04b1013-1fd4-4342-9735-04e35a199534/crypt/debug", "/pool/ext/7f9f3d10-8155-4511-8c83-34282eab634b/crypt/debug", "/pool/ext/2736dc46-9484-41a0-aed3-8b7963b1f6f7/crypt/debug", "/pool/ext/dd28684b-0582-4159-82e0-305747c1d637/crypt/debug", "/pool/ext/52c0a5e3-b03e-446e-9e20-336c4f905023/crypt/debug", "/pool/ext/32f1e829-361d-464b-83d6-3092853cc1e7/crypt/debug", "/pool/ext/ed8fba3a-857e-4ff6-b1df-ecf3e0cd30a4/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07
28612025-02-23T09:19:49.299ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07", bundle_id: b1556d1d-ed1a-46fd-92a2-31d57b02fe33 }, time_created: 2025-02-23T09:19:48.668182950Z, version: 0, cause: TerminatedInstance }
28622025-02-23T09:19:49.299ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_5e1af37a-c8d1-40b1-9b90-66915c077e07 file = sled-agent/src/instance.rs:1316 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28632025-02-23T09:19:51.042ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28642025-02-23T09:19:51.061ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(3629862), kind: System }
28652025-02-23T09:19:51.061ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(3629862), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28662025-02-23T09:19:51.061ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-23T09:19:51.061785549Z }, migration_in: None, migration_out: None }
28672025-02-23T09:19:51.111ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-23T09:19:51.061785549Z }, migration_in: None, migration_out: None }
28682025-02-23T09:19:51.115ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1253 instance_id = f0be0cb4-fbd7-4108-a303-a66f178852ff propolis_id = 5e1af37a-c8d1-40b1-9b90-66915c077e07
28692025-02-23T09:19:51.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60059
28702025-02-23T09:19:51.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60059 req_id = 5ee6c67a-16a1-4b16-a96a-d398560b0b40 response_code = 200 uri = /vpc-routes
28712025-02-23T09:19:51.666ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {811bce30-4b1c-44f7-b977-ef3ad843ae0d: {10.151.1.176: {e62946f6-89b3-40be-a86f-d8150af7572b}, 10.151.1.175: {e62946f6-89b3-40be-a86f-d8150af7572b}}} }
28722025-02-23T09:19:51.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60059 req_id = 27c50b38-e83a-4c2f-b05c-debaf37ec759 response_code = 204 uri = /eip-gateways
28732025-02-23T09:19:51.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60059 req_id = 119e1b03-3e95-403e-b50f-68981da7f973 response_code = 204 uri = /vpc-routes
28742025-02-23T09:19:51.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54030
28752025-02-23T09:19:51.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54030 req_id = 8557bb83-87b2-4394-802d-818c3af02185 response_code = 200 uri = /v2p
28762025-02-23T09:19:52.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48055
28772025-02-23T09:19:52.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48055 req_id = 39845966-0ffe-4512-af3b-71385c4d60e5 response_code = 200 uri = /v2p
28782025-02-23T09:19:52.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54138
28792025-02-23T09:19:52.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54138 req_id = cf68b0fc-ee6c-446e-ad20-7cb380339130 response_code = 200 uri = /vpc-routes
28802025-02-23T09:19:52.145ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
28812025-02-23T09:19:52.145ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b
28822025-02-23T09:19:52.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54138 req_id = 80b7f39e-dd9a-48e4-8795-973f8dcff87d response_code = 204 uri = /eip-gateways
28832025-02-23T09:19:52.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54138 req_id = 689bbc42-66d3-44d0-b70a-cb16cd17879c response_code = 204 uri = /vpc-routes
28842025-02-23T09:19:52.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51831
28852025-02-23T09:19:52.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51831 req_id = d6499ae0-6d10-4dc9-9437-b3e8c18a0374 response_code = 200 uri = /vpc-routes
28862025-02-23T09:19:52.891ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 367b3e3a-8a13-4c5b-bf48-6ff8fa54c48b values = ExternalIpGatewayMap { mappings: {} }
28872025-02-23T09:19:52.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51831 req_id = 33d2eb85-5e36-403a-a914-662a21c27743 response_code = 204 uri = /eip-gateways
28882025-02-23T09:19:52.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51831 req_id = 23da8b28-6b11-44b0-8c59-c72c1537f8eb response_code = 204 uri = /vpc-routes