Max level shown:
1 [ Feb 28 02:07:25 Enabled. ]
2 [ Feb 28 02:07:25 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Feb 28 02:07:25 Method "start" exited with status 0. ]
4 [ Feb 28 02:07:25 Rereading configuration. ]
5 [ Feb 28 02:07:25 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-02-28T02:07:25.192ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-02-28T02:07:25.192ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:294
92025-02-28T02:07:25.246ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:301
102025-02-28T02:07:25.246ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-02-28T02:07:25.360ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-02-28T02:07:25.369ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-02-28T02:07:25.377ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:311 path = /var/run/oxide/
142025-02-28T02:07:25.979ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/pre_server.rs:105 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-02-28T02:07:26.120ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-02-28T02:07:26.120ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-02-28T02:07:26.120ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-02-28T02:07:26.120ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-02-28T02:07:26.120ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-02-28T02:07:26.120ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-02-28T02:07:26.123ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-02-28T02:07:26.123ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-02-28T02:07:26.123ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-02-28T02:07:26.123ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-02-28T02:07:26.123ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-02-28T02:07:26.123ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-02-28T02:07:26.123ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-02-28T02:07:26.123ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-02-28T02:07:26.123ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-02-28T02:07:26.135ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-02-28T02:07:26.135ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool)
322025-02-28T02:07:26.235ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal }
332025-02-28T02:07:26.607ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-02-28T02:07:26.607ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-02-28T02:07:26.607ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-02-28T02:07:26.607ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-02-28T02:07:26.607ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-02-28T02:07:26.609ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-02-28T02:07:26.609ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-02-28T02:07:26.617ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-02-28T02:07:26.617ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = ca68e244-d998-48e2-aae1-cc4418d41537 (zpool)
422025-02-28T02:07:26.708ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal }
432025-02-28T02:07:27.070ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-02-28T02:07:27.070ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-02-28T02:07:27.070ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
472025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482025-02-28T02:07:27.070ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-02-28T02:07:27.070ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-02-28T02:07:27.070ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-02-28T02:07:27.070ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
522025-02-28T02:07:27.070ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552025-02-28T02:07:27.070ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-02-28T02:07:27.070ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-02-28T02:07:27.070ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
582025-02-28T02:07:27.070ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612025-02-28T02:07:27.070ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-02-28T02:07:27.070ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-02-28T02:07:27.070ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
652025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
662025-02-28T02:07:27.070ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-02-28T02:07:27.070ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-02-28T02:07:27.070ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-02-28T02:07:27.070ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
712025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
722025-02-28T02:07:27.070ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-02-28T02:07:27.070ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-02-28T02:07:27.070ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-02-28T02:07:27.070ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-02-28T02:07:27.071ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-02-28T02:07:27.071ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-02-28T02:07:27.071ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-02-28T02:07:27.071ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-02-28T02:07:27.071ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822025-02-28T02:07:27.071ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
832025-02-28T02:07:27.071ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-02-28T02:07:27.071ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-02-28T02:07:27.071ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-02-28T02:07:27.071ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872025-02-28T02:07:27.071ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882025-02-28T02:07:27.071ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892025-02-28T02:07:27.071ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
902025-02-28T02:07:27.071ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912025-02-28T02:07:27.071ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-02-28T02:07:27.071ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932025-02-28T02:07:27.071ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942025-02-28T02:07:27.071ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952025-02-28T02:07:27.071ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962025-02-28T02:07:27.071ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972025-02-28T02:07:27.071ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-02-28T02:07:27.071ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-02-28T02:07:27.071ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-02-28T02:07:27.071ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-02-28T02:07:27.071ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1022025-02-28T02:07:27.071ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-02-28T02:07:27.071ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-02-28T02:07:27.071ZINFOSledAgent (bootstore): No ledger in /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-02-28T02:07:27.071ZINFOSledAgent (bootstore): No ledger in /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-02-28T02:07:27.071ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-02-28T02:07:27.071ZINFOSledAgent (bootstore): No ledger in /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-02-28T02:07:27.071ZINFOSledAgent (bootstore): No ledger in /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-02-28T02:07:27.071ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-02-28T02:07:27.071ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-02-28T02:07:27.071ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-02-28T02:07:27.082ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:793
1132025-02-28T02:07:27.082ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1164, tv_nsec: 964260557 } time_to_next_cleanup = 599.999883209s
1142025-02-28T02:07:27.082ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1152025-02-28T02:07:27.082ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
1162025-02-28T02:07:27.082ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-02-28T02:07:27.085ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-02-28T02:07:27.085ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-02-28T02:07:27.087ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-02-28T02:07:27.087ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1190
1212025-02-28T02:07:27.087ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-02-28T02:07:27.087ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-02-28T02:07:27.087ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-02-28T02:07:27.087ZINFOSledAgent (RSS): No ledger in /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/rss-started.marker file = common/src/ledger.rs:188
1252025-02-28T02:07:27.087ZINFOSledAgent (RSS): No ledger in /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/rss-started.marker file = common/src/ledger.rs:188
1262025-02-28T02:07:27.087ZINFOSledAgent (RSS): No ledger in /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-02-28T02:07:27.087ZINFOSledAgent (RSS): No ledger in /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-02-28T02:07:27.087ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1239
1292025-02-28T02:07:27.087ZINFOSledAgent (RSS): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-02-28T02:07:27.088ZINFOSledAgent (RSS): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-02-28T02:07:27.088ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1271
1322025-02-28T02:07:27.088ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-02-28T02:07:27.088ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-02-28T02:07:27.088ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1302
1352025-02-28T02:07:27.088ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-02-28T02:07:27.088ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-02-28T02:07:27.088ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-02-28T02:07:27.088ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-02-28T02:07:27.088ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f5279127-f12d-4326-a7e5-d07a518dbb01 (sled), rack_id: 4a506621-9899-4a6c-993a-749bd0361232, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-02-28T02:07:27.089ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4353
1412025-02-28T02:07:27.089ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4759
1422025-02-28T02:07:27.093ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1432025-02-28T02:07:27.099ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1442025-02-28T02:07:27.099ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1452025-02-28T02:07:27.103ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-02-28T02:07:27.103ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-02-28T02:07:27.103ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58937
1482025-02-28T02:07:27.104ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: f5279127-f12d-4326-a7e5-d07a518dbb01 (sled), rack_id: 4a506621-9899-4a6c-993a-749bd0361232, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:366
1492025-02-28T02:07:27.104ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:381
1502025-02-28T02:07:27.104ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-02-28T02:07:27.104ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-02-28T02:07:27.104ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-02-28T02:07:27.104ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-02-28T02:07:27.104ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:422 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-02-28T02:07:27.104ZINFOSledAgent (StorageManager): No ledger in /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-02-28T02:07:27.104ZINFOSledAgent (StorageManager): No ledger in /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-02-28T02:07:27.104ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-02-28T02:07:27.104ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-02-28T02:07:27.104ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-02-28T02:07:27.104ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-02-28T02:07:27.104ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-02-28T02:07:27.119ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-02-28T02:07:27.139ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-02-28T02:07:27.156ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-02-28T02:07:27.187ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
1662025-02-28T02:07:27.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-02-28T02:07:27.187ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
1682025-02-28T02:07:27.187ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 4a506621-9899-4a6c-993a-749bd0361232, sled_id: f5279127-f12d-4326-a7e5-d07a518dbb01 }
1692025-02-28T02:07:27.190ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "701abefc-d539-4f25-890e-e098247cf1a2", "content-length": "124", "date": "Fri, 28 Feb 2025 02:07:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "701abefc-d539-4f25-890e-e098247cf1a2" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 133.964381ms
1702025-02-28T02:07:27.201ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_8bbd7b1a-3a9d-4082-9365-c7fb79577908/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-02-28T02:07:27.226ZINFOSledAgent: successfully created encrypted zvol: name="oxi_8bbd7b1a-3a9d-4082-9365-c7fb79577908/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-02-28T02:07:27.226ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_8bbd7b1a-3a9d-4082-9365-c7fb79577908/swap" file = sled-agent/src/swap_device.rs:96
1732025-02-28T02:07:27.231ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
1742025-02-28T02:07:27.231ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-02-28T02:07:27.231ZINFOSledAgent (BackingFs): Ensuring dataset oxi_8bbd7b1a-3a9d-4082-9365-c7fb79577908/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-02-28T02:07:27.300ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772025-02-28T02:07:27.325ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 4a506621-9899-4a6c-993a-749bd0361232, sled_id: f5279127-f12d-4326-a7e5-d07a518dbb01 }
1782025-02-28T02:07:27.325ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "88674507-a2b6-40a1-ac49-20d51b8ae709", "content-length": "124", "date": "Fri, 28 Feb 2025 02:07:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "88674507-a2b6-40a1-ac49-20d51b8ae709" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 154.47644ms
1792025-02-28T02:07:27.481ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 4a506621-9899-4a6c-993a-749bd0361232, sled_id: f5279127-f12d-4326-a7e5-d07a518dbb01 }
1802025-02-28T02:07:27.482ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9976a4be-a96c-49b0-b442-90a877c38659", "content-length": "124", "date": "Fri, 28 Feb 2025 02:07:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9976a4be-a96c-49b0-b442-90a877c38659" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 117.710615ms
1812025-02-28T02:07:27.520ZINFOSledAgent (BackingFs): Mounting oxi_8bbd7b1a-3a9d-4082-9365-c7fb79577908/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-02-28T02:07:27.532ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-02-28T02:07:27.532ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-02-28T02:07:27.532ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-02-28T02:07:27.532ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-02-28T02:07:27.602ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 4a506621-9899-4a6c-993a-749bd0361232, sled_id: f5279127-f12d-4326-a7e5-d07a518dbb01 }
1872025-02-28T02:07:27.603ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4d455b73-f70e-475c-a3bc-9f51d8b9b970", "content-length": "124", "date": "Fri, 28 Feb 2025 02:07:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4d455b73-f70e-475c-a3bc-9f51d8b9b970" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 235.168482ms
1882025-02-28T02:07:27.838ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 4a506621-9899-4a6c-993a-749bd0361232, sled_id: f5279127-f12d-4326-a7e5-d07a518dbb01 }
1892025-02-28T02:07:27.839ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0694b35a-8f5e-47ba-ad72-8586e3e8e7ff", "content-length": "124", "date": "Fri, 28 Feb 2025 02:07:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0694b35a-8f5e-47ba-ad72-8586e3e8e7ff" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 307.053327ms
1902025-02-28T02:07:28.148ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 4a506621-9899-4a6c-993a-749bd0361232, sled_id: f5279127-f12d-4326-a7e5-d07a518dbb01 }
1912025-02-28T02:07:28.148ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "83e3e434-e682-4452-984e-f8d336676058", "content-length": "124", "date": "Fri, 28 Feb 2025 02:07:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "83e3e434-e682-4452-984e-f8d336676058" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 187.609842ms
1922025-02-28T02:07:28.272ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
1932025-02-28T02:07:28.278ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:52187 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
1942025-02-28T02:07:28.278ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
1952025-02-28T02:07:28.278ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:52187 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = f5279127-f12d-4326-a7e5-d07a518dbb01 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
1962025-02-28T02:07:28.279ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 363.108122ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
1972025-02-28T02:07:28.280ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
1982025-02-28T02:07:28.280ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
1992025-02-28T02:07:28.280ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:977 underlay_address = fd00:1122:3344:101::1
2002025-02-28T02:07:28.280ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012025-02-28T02:07:28.337ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 4a506621-9899-4a6c-993a-749bd0361232, sled_id: f5279127-f12d-4326-a7e5-d07a518dbb01 }
2022025-02-28T02:07:28.644ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 600.078933ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2032025-02-28T02:07:29.245ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 928.035711ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2042025-02-28T02:07:30.175ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.262530083s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2052025-02-28T02:07:31.258ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2787
2062025-02-28T02:07:31.258ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:3015
2072025-02-28T02:07:31.258ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2657
2082025-02-28T02:07:31.258ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2704
2092025-02-28T02:07:31.258ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3096
2102025-02-28T02:07:31.258ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3141
2112025-02-28T02:07:31.259ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2923
2122025-02-28T02:07:31.260ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2698
2132025-02-28T02:07:31.260ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='849eeab0-0b52-44af-b538-776d0c5cf7fd'/> <propval type="astring" name="rack_id" value='4a506621-9899-4a6c-993a-749bd0361232'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe2d:c443'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='4a506621-9899-4a6c-993a-749bd0361232'/> <propval type="astring" name="sled_id" value='f5279127-f12d-4326-a7e5-d07a518dbb01'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='4a506621-9899-4a6c-993a-749bd0361232'/> <propval type="astring" name="sled_id" value='f5279127-f12d-4326-a7e5-d07a518dbb01'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='f5279127-f12d-4326-a7e5-d07a518dbb01'/> <propval type="astring" name="rack_uuid" value='4a506621-9899-4a6c-993a-749bd0361232'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='f5279127-f12d-4326-a7e5-d07a518dbb01'/> <propval type="astring" name="rack_uuid" value='4a506621-9899-4a6c-993a-749bd0361232'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-02-28T02:07:31.261ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_switch
2152025-02-28T02:07:31.644ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 65.635601ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-02-28T02:07:31.880ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 115.366221ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-02-28T02:07:32.090ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 217.761661ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-02-28T02:07:32.383ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 289.69469ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-02-28T02:07:32.440ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.687322544s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2202025-02-28T02:07:32.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 463.446606ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-02-28T02:07:33.391ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.3226403s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-02-28T02:07:34.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.091502734s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-02-28T02:07:35.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 692.055211ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-02-28T02:07:36.627ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.153185548s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-02-28T02:07:38.156ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.703797479s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2262025-02-28T02:07:38.193ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272025-02-28T02:07:38.193ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2282025-02-28T02:07:38.195ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2292025-02-28T02:07:38.195ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:495
2302025-02-28T02:07:38.195ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312025-02-28T02:07:38.195ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322025-02-28T02:07:38.195ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-02-28T02:07:38.195ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342025-02-28T02:07:38.195ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352025-02-28T02:07:38.195ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
2362025-02-28T02:07:38.195ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58937
2372025-02-28T02:07:38.417ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2382025-02-28T02:07:38.417ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2392025-02-28T02:07:38.418ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2290749193341108339 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2402025-02-28T02:07:38.418ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12068597891640042987 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2412025-02-28T02:07:38.422ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4377 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422025-02-28T02:07:38.422ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4393
2432025-02-28T02:07:38.422ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:535 zone = oxz_switch
2442025-02-28T02:07:38.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64596
2452025-02-28T02:07:38.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-02-28T02:07:38.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2472025-02-28T02:07:38.679ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-02-28T02:07:38.679ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-zones.json file = common/src/ledger.rs:188
2492025-02-28T02:07:38.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64596 req_id = 76ae9ba6-9ead-4875-9ca5-0fac7ab349f4 response_code = 200 uri = /inventory
2502025-02-28T02:07:38.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50516
2512025-02-28T02:07:38.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50516 req_id = b8b5b0d7-5289-4e12-a2b3-a25da5217736 response_code = 200 uri = /sled-role
2522025-02-28T02:07:38.742ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 060806a8-b789-4f57-9636-e54cdcd5f4d0 (physical_disk), pool_id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 6a098d70-5ad4-41cf-8367-c8822d84efe6 (physical_disk), pool_id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 794bfac6-b0c0-44fe-a817-b4bc28cc910e (physical_disk), pool_id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 970fd059-ac61-4ffc-9f7d-b2b5da6c6de8 (physical_disk), pool_id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: a299d309-bba1-4d46-a8cd-bb181d3ed1de (physical_disk), pool_id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c648cb46-c9d1-435c-9d11-674bd028ce0f (physical_disk), pool_id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: d752d5df-7d34-4f1b-b5a8-c16aa799983f (physical_disk), pool_id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e5085954-298f-4cfa-ac61-27f4e468e2d5 (physical_disk), pool_id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: eff1b820-da34-49ed-8005-d5e62ebfcbc4 (physical_disk), pool_id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2532025-02-28T02:07:38.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42025
2542025-02-28T02:07:38.742ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2552025-02-28T02:07:38.742ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 060806a8-b789-4f57-9636-e54cdcd5f4d0 (physical_disk), pool_id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 6a098d70-5ad4-41cf-8367-c8822d84efe6 (physical_disk), pool_id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 794bfac6-b0c0-44fe-a817-b4bc28cc910e (physical_disk), pool_id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 970fd059-ac61-4ffc-9f7d-b2b5da6c6de8 (physical_disk), pool_id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: a299d309-bba1-4d46-a8cd-bb181d3ed1de (physical_disk), pool_id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c648cb46-c9d1-435c-9d11-674bd028ce0f (physical_disk), pool_id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: d752d5df-7d34-4f1b-b5a8-c16aa799983f (physical_disk), pool_id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e5085954-298f-4cfa-ac61-27f4e468e2d5 (physical_disk), pool_id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: eff1b820-da34-49ed-8005-d5e62ebfcbc4 (physical_disk), pool_id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2562025-02-28T02:07:38.742ZINFOSledAgent (StorageManager): No ledger in /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572025-02-28T02:07:38.742ZINFOSledAgent (StorageManager): No ledger in /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582025-02-28T02:07:38.742ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2592025-02-28T02:07:38.742ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2602025-02-28T02:07:38.742ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2612025-02-28T02:07:38.742ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2622025-02-28T02:07:38.742ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2632025-02-28T02:07:38.870ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2642025-02-28T02:07:38.878ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2652025-02-28T02:07:38.878ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool)
2662025-02-28T02:07:38.965ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }
2672025-02-28T02:07:38.972ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2682025-02-28T02:07:38.972ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2692025-02-28T02:07:38.972ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2702025-02-28T02:07:38.972ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2712025-02-28T02:07:38.972ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722025-02-28T02:07:38.972ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-02-28T02:07:38.972ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2742025-02-28T02:07:39.004ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752025-02-28T02:07:39.013ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone file = sled-storage/src/dataset.rs:302
2762025-02-28T02:07:39.148ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b3a87d4a-d86a-4868-ad38-fc879461da99 file = sled-storage/src/dataset.rs:388
2772025-02-28T02:07:39.156ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2782025-02-28T02:07:39.156ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2792025-02-28T02:07:39.156ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2802025-02-28T02:07:39.156ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2812025-02-28T02:07:39.156ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2822025-02-28T02:07:39.165ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2832025-02-28T02:07:39.165ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool)
2842025-02-28T02:07:39.254ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }
2852025-02-28T02:07:39.261ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2862025-02-28T02:07:39.261ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2872025-02-28T02:07:39.261ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2882025-02-28T02:07:39.261ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2892025-02-28T02:07:39.261ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2902025-02-28T02:07:39.261ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-02-28T02:07:39.261ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2922025-02-28T02:07:39.264ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f5279127-f12d-4326-a7e5-d07a518dbb01) file = sled-agent/src/probe_manager.rs:238 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
2932025-02-28T02:07:39.294ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942025-02-28T02:07:39.301ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/zone file = sled-storage/src/dataset.rs:302
2952025-02-28T02:07:39.433ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e file = sled-storage/src/dataset.rs:388
2962025-02-28T02:07:39.440ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972025-02-28T02:07:39.440ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982025-02-28T02:07:39.440ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992025-02-28T02:07:39.440ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002025-02-28T02:07:39.440ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012025-02-28T02:07:39.450ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022025-02-28T02:07:39.450ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool)
3032025-02-28T02:07:39.541ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }
3042025-02-28T02:07:39.549ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052025-02-28T02:07:39.549ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062025-02-28T02:07:39.549ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072025-02-28T02:07:39.549ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082025-02-28T02:07:39.549ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092025-02-28T02:07:39.549ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-02-28T02:07:39.549ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112025-02-28T02:07:39.583ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122025-02-28T02:07:39.591ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone file = sled-storage/src/dataset.rs:302
3132025-02-28T02:07:39.727ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 file = sled-storage/src/dataset.rs:388
3142025-02-28T02:07:39.735ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3152025-02-28T02:07:39.735ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3162025-02-28T02:07:39.735ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3172025-02-28T02:07:39.735ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3182025-02-28T02:07:39.735ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3192025-02-28T02:07:39.745ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3202025-02-28T02:07:39.745ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7ae93100-6078-4f36-b916-7ea04312348c (zpool)
3212025-02-28T02:07:39.838ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }
3222025-02-28T02:07:39.846ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3232025-02-28T02:07:39.846ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3242025-02-28T02:07:39.846ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3252025-02-28T02:07:39.846ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3262025-02-28T02:07:39.846ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272025-02-28T02:07:39.846ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-02-28T02:07:39.846ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3292025-02-28T02:07:39.881ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3302025-02-28T02:07:39.889ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7ae93100-6078-4f36-b916-7ea04312348c/crypt/zone file = sled-storage/src/dataset.rs:302
3312025-02-28T02:07:40.027ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7ae93100-6078-4f36-b916-7ea04312348c file = sled-storage/src/dataset.rs:388
3322025-02-28T02:07:40.036ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3332025-02-28T02:07:40.036ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3342025-02-28T02:07:40.036ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3352025-02-28T02:07:40.036ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3362025-02-28T02:07:40.036ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3372025-02-28T02:07:40.047ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3382025-02-28T02:07:40.047ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool)
3392025-02-28T02:07:40.142ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }
3402025-02-28T02:07:40.151ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3412025-02-28T02:07:40.151ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3422025-02-28T02:07:40.151ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3432025-02-28T02:07:40.151ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3442025-02-28T02:07:40.151ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3452025-02-28T02:07:40.152ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-02-28T02:07:40.152ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3472025-02-28T02:07:40.188ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3482025-02-28T02:07:40.196ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a/crypt/zone file = sled-storage/src/dataset.rs:302
3492025-02-28T02:07:40.268ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f5279127-f12d-4326-a7e5-d07a518dbb01) file = sled-agent/src/probe_manager.rs:238 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
3502025-02-28T02:07:40.338ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a file = sled-storage/src/dataset.rs:388
3512025-02-28T02:07:40.346ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522025-02-28T02:07:40.346ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532025-02-28T02:07:40.346ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542025-02-28T02:07:40.346ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552025-02-28T02:07:40.346ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562025-02-28T02:07:40.356ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572025-02-28T02:07:40.356ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool)
3582025-02-28T02:07:40.447ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }
3592025-02-28T02:07:40.454ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3602025-02-28T02:07:40.454ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3612025-02-28T02:07:40.454ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3622025-02-28T02:07:40.454ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3632025-02-28T02:07:40.454ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-02-28T02:07:40.454ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-02-28T02:07:40.454ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3662025-02-28T02:07:40.488ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672025-02-28T02:07:40.496ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone file = sled-storage/src/dataset.rs:302
3682025-02-28T02:07:40.627ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_56271d63-ce52-4a9a-beca-d66806dddbb3 file = sled-storage/src/dataset.rs:388
3692025-02-28T02:07:40.634ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702025-02-28T02:07:40.634ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712025-02-28T02:07:40.634ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722025-02-28T02:07:40.634ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732025-02-28T02:07:40.634ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742025-02-28T02:07:40.644ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752025-02-28T02:07:40.644ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool)
3762025-02-28T02:07:40.736ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }
3772025-02-28T02:07:40.744ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3782025-02-28T02:07:40.744ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3792025-02-28T02:07:40.744ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3802025-02-28T02:07:40.744ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3812025-02-28T02:07:40.744ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822025-02-28T02:07:40.744ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-02-28T02:07:40.744ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3842025-02-28T02:07:40.779ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3852025-02-28T02:07:40.787ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/zone file = sled-storage/src/dataset.rs:302
3862025-02-28T02:07:40.924ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_55ae14e7-5a6e-4245-98d6-55cf62789803 file = sled-storage/src/dataset.rs:388
3872025-02-28T02:07:40.932ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3882025-02-28T02:07:40.932ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3892025-02-28T02:07:40.932ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3902025-02-28T02:07:40.932ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3912025-02-28T02:07:40.932ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3922025-02-28T02:07:40.942ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3932025-02-28T02:07:40.942ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool)
3942025-02-28T02:07:41.035ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }
3952025-02-28T02:07:41.043ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3962025-02-28T02:07:41.043ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3972025-02-28T02:07:41.043ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3982025-02-28T02:07:41.043ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3992025-02-28T02:07:41.043ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4002025-02-28T02:07:41.044ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-02-28T02:07:41.044ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4022025-02-28T02:07:41.080ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4032025-02-28T02:07:41.088ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/zone file = sled-storage/src/dataset.rs:302
4042025-02-28T02:07:41.251ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_81fb17c7-22e5-4138-98cb-7b91dded8807 file = sled-storage/src/dataset.rs:388
4052025-02-28T02:07:41.259ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4062025-02-28T02:07:41.259ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4072025-02-28T02:07:41.259ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4082025-02-28T02:07:41.259ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4092025-02-28T02:07:41.259ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4102025-02-28T02:07:41.270ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4112025-02-28T02:07:41.270ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool)
4122025-02-28T02:07:41.372ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }
4132025-02-28T02:07:41.380ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4142025-02-28T02:07:41.380ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4152025-02-28T02:07:41.380ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4162025-02-28T02:07:41.381ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4172025-02-28T02:07:41.381ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4182025-02-28T02:07:41.381ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192025-02-28T02:07:41.381ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4202025-02-28T02:07:41.385ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f5279127-f12d-4326-a7e5-d07a518dbb01) file = sled-agent/src/probe_manager.rs:238 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
4212025-02-28T02:07:41.418ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222025-02-28T02:07:41.426ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/zone file = sled-storage/src/dataset.rs:302
4232025-02-28T02:07:41.565ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf file = sled-storage/src/dataset.rs:388
4242025-02-28T02:07:41.573ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252025-02-28T02:07:41.573ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262025-02-28T02:07:41.573ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272025-02-28T02:07:41.573ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbd7b1a-3a9d-4082-9365-c7fb79577908 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca68e244-d998-48e2-aae1-cc4418d41537 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282025-02-28T02:07:41.573ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292025-02-28T02:07:41.573ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302025-02-28T02:07:41.573ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-02-28T02:07:41.573ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
4322025-02-28T02:07:41.573ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4332025-02-28T02:07:41.573ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
4342025-02-28T02:07:41.573ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
4352025-02-28T02:07:41.573ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
4362025-02-28T02:07:41.573ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
4372025-02-28T02:07:41.573ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
4382025-02-28T02:07:41.573ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392025-02-28T02:07:41.573ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
4402025-02-28T02:07:41.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2831729 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42025 req_id = bd5fab04-9825-41a1-903a-de465c142710 response_code = 200 uri = /omicron-physical-disks
4412025-02-28T02:07:41.606ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {097a66c3-4c6c-4ca6-b9ed-568020b73652 (dataset): DatasetConfig { id: 097a66c3-4c6c-4ca6-b9ed-568020b73652 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0da040b5-5f0d-4795-a959-3ec8e0e781c1 (dataset): DatasetConfig { id: 0da040b5-5f0d-4795-a959-3ec8e0e781c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 123abac9-4f4b-485c-a760-77d060fa9d7b (dataset): DatasetConfig { id: 123abac9-4f4b-485c-a760-77d060fa9d7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 15e652fc-749e-4572-ab71-d9e04a0974b1 (dataset): DatasetConfig { id: 15e652fc-749e-4572-ab71-d9e04a0974b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1783203f-cffa-41d3-bdba-11a44f479fae (dataset): DatasetConfig { id: 1783203f-cffa-41d3-bdba-11a44f479fae (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 184d990a-cdce-474e-ac5e-4337792bf019 (dataset): DatasetConfig { id: 184d990a-cdce-474e-ac5e-4337792bf019 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c28fc5f-c7d7-43ef-907e-62c183884b4e (dataset): DatasetConfig { id: 1c28fc5f-c7d7-43ef-907e-62c183884b4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c3b98ce-946b-468b-88a9-5d43252b8ba7 (dataset): DatasetConfig { id: 1c3b98ce-946b-468b-88a9-5d43252b8ba7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e8f8c45-37e6-4355-b116-36b2171564b7 (dataset): DatasetConfig { id: 1e8f8c45-37e6-4355-b116-36b2171564b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 236b13ff-1c7f-4fd1-a82d-e279195b0651 (dataset): DatasetConfig { id: 236b13ff-1c7f-4fd1-a82d-e279195b0651 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2519b0f8-f91f-40a9-93e9-3011e8adbbcb (dataset): DatasetConfig { id: 2519b0f8-f91f-40a9-93e9-3011e8adbbcb (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 270095fa-7379-4559-a73c-030c31cfd47a (dataset): DatasetConfig { id: 270095fa-7379-4559-a73c-030c31cfd47a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a7f6180-8197-4325-88a8-cae3bf5854d1 (dataset): DatasetConfig { id: 2a7f6180-8197-4325-88a8-cae3bf5854d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d0d6e1d-96a6-4b7f-bbc1-0959e1b9badc (dataset): DatasetConfig { id: 2d0d6e1d-96a6-4b7f-bbc1-0959e1b9badc (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d975338-9f4e-40fa-84fa-4b7e186a2ab2 (dataset): DatasetConfig { id: 2d975338-9f4e-40fa-84fa-4b7e186a2ab2 (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32b1cf78-0be2-424e-90fe-48c0d45ae430 (dataset): DatasetConfig { id: 32b1cf78-0be2-424e-90fe-48c0d45ae430 (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36276f64-6f7c-4286-8e1d-fbc26b471ef1 (dataset): DatasetConfig { id: 36276f64-6f7c-4286-8e1d-fbc26b471ef1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3666a7e5-c54c-463d-bab4-d14c826a5e17 (dataset): DatasetConfig { id: 3666a7e5-c54c-463d-bab4-d14c826a5e17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37799fe7-95f8-445f-9aa4-a993190d004c (dataset): DatasetConfig { id: 37799fe7-95f8-445f-9aa4-a993190d004c (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3aee9f8f-fdeb-4c4f-a681-607d16e2b75b (dataset): DatasetConfig { id: 3aee9f8f-fdeb-4c4f-a681-607d16e2b75b (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3be398b8-787c-4eae-a092-cc57dcb9ad31 (dataset): DatasetConfig { id: 3be398b8-787c-4eae-a092-cc57dcb9ad31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3beb8ea8-29bd-45fd-9a54-714b0481845b (dataset): DatasetConfig { id: 3beb8ea8-29bd-45fd-9a54-714b0481845b (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4040f5a3-1020-4ed6-b7f2-29c278d9c129 (dataset): DatasetConfig { id: 4040f5a3-1020-4ed6-b7f2-29c278d9c129 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 44897d16-b5b1-4e73-83cc-89654cad726b (dataset): DatasetConfig { id: 44897d16-b5b1-4e73-83cc-89654cad726b (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4658c13a-bb10-4e5b-94fa-81cdc55e7652 (dataset): DatasetConfig { id: 4658c13a-bb10-4e5b-94fa-81cdc55e7652 (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52e82883-ba14-46e0-9e57-a0d772539395 (dataset): DatasetConfig { id: 52e82883-ba14-46e0-9e57-a0d772539395 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5361b7b2-93d9-4488-80bf-d8829ac703bc (dataset): DatasetConfig { id: 5361b7b2-93d9-4488-80bf-d8829ac703bc (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56210d46-36d7-4b8f-839f-572c24042304 (dataset): DatasetConfig { id: 56210d46-36d7-4b8f-839f-572c24042304 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56fcbea2-e7d0-4c06-9086-5c619e1ceabf (dataset): DatasetConfig { id: 56fcbea2-e7d0-4c06-9086-5c619e1ceabf (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 576d57fd-60ea-4e77-8b4a-7db8110346bd (dataset): DatasetConfig { id: 576d57fd-60ea-4e77-8b4a-7db8110346bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 604524f0-47b3-4a57-b789-fba0691c039f (dataset): DatasetConfig { id: 604524f0-47b3-4a57-b789-fba0691c039f (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d8eb65f-3cef-4a6b-b7cc-ca29c040fb1d (dataset): DatasetConfig { id: 6d8eb65f-3cef-4a6b-b7cc-ca29c040fb1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 718c34c2-8812-4730-92c6-3c4b1335cba6 (dataset): DatasetConfig { id: 718c34c2-8812-4730-92c6-3c4b1335cba6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 771f4e37-1bd7-4b9c-a757-f6912a03e84b (dataset): DatasetConfig { id: 771f4e37-1bd7-4b9c-a757-f6912a03e84b (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77b05d99-8e05-4dab-8397-af4a4eee91ac (dataset): DatasetConfig { id: 77b05d99-8e05-4dab-8397-af4a4eee91ac (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 781ee4b5-9575-46c3-822c-f2c9d64f4b2d (dataset): DatasetConfig { id: 781ee4b5-9575-46c3-822c-f2c9d64f4b2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d729d52-b6c5-46a9-a0ad-3441b7c9ccc4 (dataset): DatasetConfig { id: 7d729d52-b6c5-46a9-a0ad-3441b7c9ccc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8010de22-6043-4559-a150-0bf9642df090 (dataset): DatasetConfig { id: 8010de22-6043-4559-a150-0bf9642df090 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85cce98a-1e1c-489a-9972-0a05b89d7f85 (dataset): DatasetConfig { id: 85cce98a-1e1c-489a-9972-0a05b89d7f85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8ab49051-4cb8-4ba6-9b73-d58a9a7b88aa (dataset): DatasetConfig { id: 8ab49051-4cb8-4ba6-9b73-d58a9a7b88aa (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ee6affa-b355-43f6-bc40-433f5b01efe5 (dataset): DatasetConfig { id: 8ee6affa-b355-43f6-bc40-433f5b01efe5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96e42a94-a372-4e5e-8317-661e94f7523a (dataset): DatasetConfig { id: 96e42a94-a372-4e5e-8317-661e94f7523a (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97408113-e35f-43c6-8922-d4c2029bf151 (dataset): DatasetConfig { id: 97408113-e35f-43c6-8922-d4c2029bf151 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98e2be9a-0dbb-46c2-9ccb-9cce5af8adb3 (dataset): DatasetConfig { id: 98e2be9a-0dbb-46c2-9ccb-9cce5af8adb3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 993e22f6-490e-4860-a58b-5e81ff51f515 (dataset): DatasetConfig { id: 993e22f6-490e-4860-a58b-5e81ff51f515 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9ab99e0c-0a25-4eb4-99ac-f43901a042ff (dataset): DatasetConfig { id: 9ab99e0c-0a25-4eb4-99ac-f43901a042ff (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a09e238c-1be0-469b-9388-84b1ed9c5eae (dataset): DatasetConfig { id: a09e238c-1be0-469b-9388-84b1ed9c5eae (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a521f5e3-6c3b-49bf-8030-e5f7f536d68a (dataset): DatasetConfig { id: a521f5e3-6c3b-49bf-8030-e5f7f536d68a (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aac2082b-bfba-4c68-832a-55218e324525 (dataset): DatasetConfig { id: aac2082b-bfba-4c68-832a-55218e324525 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ab36e914-0700-475d-81ac-f85823850891 (dataset): DatasetConfig { id: ab36e914-0700-475d-81ac-f85823850891 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b558adb3-6167-4543-869f-8e13b324642d (dataset): DatasetConfig { id: b558adb3-6167-4543-869f-8e13b324642d (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b7764ef0-8195-4b70-9288-306f450544da (dataset): DatasetConfig { id: b7764ef0-8195-4b70-9288-306f450544da (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be94b650-2db5-48fa-9a24-e8ae57da5d77 (dataset): DatasetConfig { id: be94b650-2db5-48fa-9a24-e8ae57da5d77 (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2722b3e-6f17-4175-aa8b-ef14d6961d81 (dataset): DatasetConfig { id: c2722b3e-6f17-4175-aa8b-ef14d6961d81 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6a95ad3-2258-464b-b99a-7c328bceb076 (dataset): DatasetConfig { id: c6a95ad3-2258-464b-b99a-7c328bceb076 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd96e748-75cb-49a6-bc82-47b4e991a0e8 (dataset): DatasetConfig { id: cd96e748-75cb-49a6-bc82-47b4e991a0e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cebcafa8-ede0-417d-8b1a-232ce452056c (dataset): DatasetConfig { id: cebcafa8-ede0-417d-8b1a-232ce452056c (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9b21409-af4c-4e50-9cc6-9446a1a263a7 (dataset): DatasetConfig { id: d9b21409-af4c-4e50-9cc6-9446a1a263a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2688de4-a434-4538-8087-e157c2918a4a (dataset): DatasetConfig { id: e2688de4-a434-4538-8087-e157c2918a4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec942398-e904-41bd-a669-e21efd0eef6b (dataset): DatasetConfig { id: ec942398-e904-41bd-a669-e21efd0eef6b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f00f031e-7dd4-4be8-a906-30495ebd6420 (dataset): DatasetConfig { id: f00f031e-7dd4-4be8-a906-30495ebd6420 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f108d2ec-18e4-4a74-8dae-fb05ae0cab16 (dataset): DatasetConfig { id: f108d2ec-18e4-4a74-8dae-fb05ae0cab16 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2553581-e8f7-471a-800e-0a1482f9cd0f (dataset): DatasetConfig { id: f2553581-e8f7-471a-800e-0a1482f9cd0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f347276b-3564-4cd8-b9c5-1726cdc0690f (dataset): DatasetConfig { id: f347276b-3564-4cd8-b9c5-1726cdc0690f (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbea3bc8-4d3e-4084-87f1-b390fe714f1e (dataset): DatasetConfig { id: fbea3bc8-4d3e-4084-87f1-b390fe714f1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_97706d05-7981-4c67-b267-252930b86713" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fda6f210-0a44-4472-973e-022f28eb1ac0 (dataset): DatasetConfig { id: fda6f210-0a44-4472-973e-022f28eb1ac0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422025-02-28T02:07:41.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47209
4432025-02-28T02:07:41.607ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
4442025-02-28T02:07:41.607ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {097a66c3-4c6c-4ca6-b9ed-568020b73652 (dataset): DatasetConfig { id: 097a66c3-4c6c-4ca6-b9ed-568020b73652 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0da040b5-5f0d-4795-a959-3ec8e0e781c1 (dataset): DatasetConfig { id: 0da040b5-5f0d-4795-a959-3ec8e0e781c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 123abac9-4f4b-485c-a760-77d060fa9d7b (dataset): DatasetConfig { id: 123abac9-4f4b-485c-a760-77d060fa9d7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 15e652fc-749e-4572-ab71-d9e04a0974b1 (dataset): DatasetConfig { id: 15e652fc-749e-4572-ab71-d9e04a0974b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1783203f-cffa-41d3-bdba-11a44f479fae (dataset): DatasetConfig { id: 1783203f-cffa-41d3-bdba-11a44f479fae (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 184d990a-cdce-474e-ac5e-4337792bf019 (dataset): DatasetConfig { id: 184d990a-cdce-474e-ac5e-4337792bf019 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c28fc5f-c7d7-43ef-907e-62c183884b4e (dataset): DatasetConfig { id: 1c28fc5f-c7d7-43ef-907e-62c183884b4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c3b98ce-946b-468b-88a9-5d43252b8ba7 (dataset): DatasetConfig { id: 1c3b98ce-946b-468b-88a9-5d43252b8ba7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e8f8c45-37e6-4355-b116-36b2171564b7 (dataset): DatasetConfig { id: 1e8f8c45-37e6-4355-b116-36b2171564b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 236b13ff-1c7f-4fd1-a82d-e279195b0651 (dataset): DatasetConfig { id: 236b13ff-1c7f-4fd1-a82d-e279195b0651 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2519b0f8-f91f-40a9-93e9-3011e8adbbcb (dataset): DatasetConfig { id: 2519b0f8-f91f-40a9-93e9-3011e8adbbcb (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 270095fa-7379-4559-a73c-030c31cfd47a (dataset): DatasetConfig { id: 270095fa-7379-4559-a73c-030c31cfd47a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a7f6180-8197-4325-88a8-cae3bf5854d1 (dataset): DatasetConfig { id: 2a7f6180-8197-4325-88a8-cae3bf5854d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d0d6e1d-96a6-4b7f-bbc1-0959e1b9badc (dataset): DatasetConfig { id: 2d0d6e1d-96a6-4b7f-bbc1-0959e1b9badc (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d975338-9f4e-40fa-84fa-4b7e186a2ab2 (dataset): DatasetConfig { id: 2d975338-9f4e-40fa-84fa-4b7e186a2ab2 (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32b1cf78-0be2-424e-90fe-48c0d45ae430 (dataset): DatasetConfig { id: 32b1cf78-0be2-424e-90fe-48c0d45ae430 (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36276f64-6f7c-4286-8e1d-fbc26b471ef1 (dataset): DatasetConfig { id: 36276f64-6f7c-4286-8e1d-fbc26b471ef1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3666a7e5-c54c-463d-bab4-d14c826a5e17 (dataset): DatasetConfig { id: 3666a7e5-c54c-463d-bab4-d14c826a5e17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37799fe7-95f8-445f-9aa4-a993190d004c (dataset): DatasetConfig { id: 37799fe7-95f8-445f-9aa4-a993190d004c (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3aee9f8f-fdeb-4c4f-a681-607d16e2b75b (dataset): DatasetConfig { id: 3aee9f8f-fdeb-4c4f-a681-607d16e2b75b (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3be398b8-787c-4eae-a092-cc57dcb9ad31 (dataset): DatasetConfig { id: 3be398b8-787c-4eae-a092-cc57dcb9ad31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3beb8ea8-29bd-45fd-9a54-714b0481845b (dataset): DatasetConfig { id: 3beb8ea8-29bd-45fd-9a54-714b0481845b (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4040f5a3-1020-4ed6-b7f2-29c278d9c129 (dataset): DatasetConfig { id: 4040f5a3-1020-4ed6-b7f2-29c278d9c129 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 44897d16-b5b1-4e73-83cc-89654cad726b (dataset): DatasetConfig { id: 44897d16-b5b1-4e73-83cc-89654cad726b (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4658c13a-bb10-4e5b-94fa-81cdc55e7652 (dataset): DatasetConfig { id: 4658c13a-bb10-4e5b-94fa-81cdc55e7652 (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52e82883-ba14-46e0-9e57-a0d772539395 (dataset): DatasetConfig { id: 52e82883-ba14-46e0-9e57-a0d772539395 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5361b7b2-93d9-4488-80bf-d8829ac703bc (dataset): DatasetConfig { id: 5361b7b2-93d9-4488-80bf-d8829ac703bc (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56210d46-36d7-4b8f-839f-572c24042304 (dataset): DatasetConfig { id: 56210d46-36d7-4b8f-839f-572c24042304 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56fcbea2-e7d0-4c06-9086-5c619e1ceabf (dataset): DatasetConfig { id: 56fcbea2-e7d0-4c06-9086-5c619e1ceabf (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 576d57fd-60ea-4e77-8b4a-7db8110346bd (dataset): DatasetConfig { id: 576d57fd-60ea-4e77-8b4a-7db8110346bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 604524f0-47b3-4a57-b789-fba0691c039f (dataset): DatasetConfig { id: 604524f0-47b3-4a57-b789-fba0691c039f (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d8eb65f-3cef-4a6b-b7cc-ca29c040fb1d (dataset): DatasetConfig { id: 6d8eb65f-3cef-4a6b-b7cc-ca29c040fb1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 718c34c2-8812-4730-92c6-3c4b1335cba6 (dataset): DatasetConfig { id: 718c34c2-8812-4730-92c6-3c4b1335cba6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 771f4e37-1bd7-4b9c-a757-f6912a03e84b (dataset): DatasetConfig { id: 771f4e37-1bd7-4b9c-a757-f6912a03e84b (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77b05d99-8e05-4dab-8397-af4a4eee91ac (dataset): DatasetConfig { id: 77b05d99-8e05-4dab-8397-af4a4eee91ac (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 781ee4b5-9575-46c3-822c-f2c9d64f4b2d (dataset): DatasetConfig { id: 781ee4b5-9575-46c3-822c-f2c9d64f4b2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d729d52-b6c5-46a9-a0ad-3441b7c9ccc4 (dataset): DatasetConfig { id: 7d729d52-b6c5-46a9-a0ad-3441b7c9ccc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8010de22-6043-4559-a150-0bf9642df090 (dataset): DatasetConfig { id: 8010de22-6043-4559-a150-0bf9642df090 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85cce98a-1e1c-489a-9972-0a05b89d7f85 (dataset): DatasetConfig { id: 85cce98a-1e1c-489a-9972-0a05b89d7f85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8ab49051-4cb8-4ba6-9b73-d58a9a7b88aa (dataset): DatasetConfig { id: 8ab49051-4cb8-4ba6-9b73-d58a9a7b88aa (dataset), name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ee6affa-b355-43f6-bc40-433f5b01efe5 (dataset): DatasetConfig { id: 8ee6affa-b355-43f6-bc40-433f5b01efe5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96e42a94-a372-4e5e-8317-661e94f7523a (dataset): DatasetConfig { id: 96e42a94-a372-4e5e-8317-661e94f7523a (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97408113-e35f-43c6-8922-d4c2029bf151 (dataset): DatasetConfig { id: 97408113-e35f-43c6-8922-d4c2029bf151 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98e2be9a-0dbb-46c2-9ccb-9cce5af8adb3 (dataset): DatasetConfig { id: 98e2be9a-0dbb-46c2-9ccb-9cce5af8adb3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 993e22f6-490e-4860-a58b-5e81ff51f515 (dataset): DatasetConfig { id: 993e22f6-490e-4860-a58b-5e81ff51f515 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9ab99e0c-0a25-4eb4-99ac-f43901a042ff (dataset): DatasetConfig { id: 9ab99e0c-0a25-4eb4-99ac-f43901a042ff (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a09e238c-1be0-469b-9388-84b1ed9c5eae (dataset): DatasetConfig { id: a09e238c-1be0-469b-9388-84b1ed9c5eae (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a521f5e3-6c3b-49bf-8030-e5f7f536d68a (dataset): DatasetConfig { id: a521f5e3-6c3b-49bf-8030-e5f7f536d68a (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aac2082b-bfba-4c68-832a-55218e324525 (dataset): DatasetConfig { id: aac2082b-bfba-4c68-832a-55218e324525 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ab36e914-0700-475d-81ac-f85823850891 (dataset): DatasetConfig { id: ab36e914-0700-475d-81ac-f85823850891 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b558adb3-6167-4543-869f-8e13b324642d (dataset): DatasetConfig { id: b558adb3-6167-4543-869f-8e13b324642d (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b7764ef0-8195-4b70-9288-306f450544da (dataset): DatasetConfig { id: b7764ef0-8195-4b70-9288-306f450544da (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be94b650-2db5-48fa-9a24-e8ae57da5d77 (dataset): DatasetConfig { id: be94b650-2db5-48fa-9a24-e8ae57da5d77 (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2722b3e-6f17-4175-aa8b-ef14d6961d81 (dataset): DatasetConfig { id: c2722b3e-6f17-4175-aa8b-ef14d6961d81 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6a95ad3-2258-464b-b99a-7c328bceb076 (dataset): DatasetConfig { id: c6a95ad3-2258-464b-b99a-7c328bceb076 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd96e748-75cb-49a6-bc82-47b4e991a0e8 (dataset): DatasetConfig { id: cd96e748-75cb-49a6-bc82-47b4e991a0e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cebcafa8-ede0-417d-8b1a-232ce452056c (dataset): DatasetConfig { id: cebcafa8-ede0-417d-8b1a-232ce452056c (dataset), name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9b21409-af4c-4e50-9cc6-9446a1a263a7 (dataset): DatasetConfig { id: d9b21409-af4c-4e50-9cc6-9446a1a263a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2688de4-a434-4538-8087-e157c2918a4a (dataset): DatasetConfig { id: e2688de4-a434-4538-8087-e157c2918a4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec942398-e904-41bd-a669-e21efd0eef6b (dataset): DatasetConfig { id: ec942398-e904-41bd-a669-e21efd0eef6b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f00f031e-7dd4-4be8-a906-30495ebd6420 (dataset): DatasetConfig { id: f00f031e-7dd4-4be8-a906-30495ebd6420 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f108d2ec-18e4-4a74-8dae-fb05ae0cab16 (dataset): DatasetConfig { id: f108d2ec-18e4-4a74-8dae-fb05ae0cab16 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2553581-e8f7-471a-800e-0a1482f9cd0f (dataset): DatasetConfig { id: f2553581-e8f7-471a-800e-0a1482f9cd0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f347276b-3564-4cd8-b9c5-1726cdc0690f (dataset): DatasetConfig { id: f347276b-3564-4cd8-b9c5-1726cdc0690f (dataset), name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbea3bc8-4d3e-4084-87f1-b390fe714f1e (dataset): DatasetConfig { id: fbea3bc8-4d3e-4084-87f1-b390fe714f1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_97706d05-7981-4c67-b267-252930b86713" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fda6f210-0a44-4472-973e-022f28eb1ac0 (dataset): DatasetConfig { id: fda6f210-0a44-4472-973e-022f28eb1ac0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4452025-02-28T02:07:41.607ZINFOSledAgent (StorageManager): No ledger in /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462025-02-28T02:07:41.607ZINFOSledAgent (StorageManager): No ledger in /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-02-28T02:07:41.607ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4482025-02-28T02:07:41.623ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4492025-02-28T02:07:41.623ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4502025-02-28T02:07:41.623ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone/oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9"), full_name: "oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone/oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9" } file = sled-storage/src/manager.rs:1431
4512025-02-28T02:07:41.681ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522025-02-28T02:07:41.681ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532025-02-28T02:07:41.681ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone/oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66"), full_name: "oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone/oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66" } file = sled-storage/src/manager.rs:1431
4542025-02-28T02:07:41.743ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552025-02-28T02:07:41.743ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4562025-02-28T02:07:41.743ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/debug"), full_name: "oxp_55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/debug" } file = sled-storage/src/manager.rs:1431
4572025-02-28T02:07:41.773ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582025-02-28T02:07:41.773ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4592025-02-28T02:07:41.773ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone/oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925"), full_name: "oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone/oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925" } file = sled-storage/src/manager.rs:1431
4602025-02-28T02:07:41.833ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612025-02-28T02:07:41.834ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4622025-02-28T02:07:41.834ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96d00a6f-2f4d-4b13-a75f-c89809dc380a/crypt/zone"), full_name: "oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a/crypt/zone" } file = sled-storage/src/manager.rs:1431
4632025-02-28T02:07:41.862ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642025-02-28T02:07:41.862ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652025-02-28T02:07:41.862ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4662025-02-28T02:07:41.912ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672025-02-28T02:07:41.912ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4682025-02-28T02:07:41.912ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7ae93100-6078-4f36-b916-7ea04312348c/crypt/zone"), full_name: "oxp_7ae93100-6078-4f36-b916-7ea04312348c/crypt/zone" } file = sled-storage/src/manager.rs:1431
4692025-02-28T02:07:41.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702025-02-28T02:07:41.940ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4712025-02-28T02:07:41.940ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/zone/oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31"), full_name: "oxp_55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/zone/oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31" } file = sled-storage/src/manager.rs:1431
4722025-02-28T02:07:41.998ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732025-02-28T02:07:41.998ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4742025-02-28T02:07:41.998ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone/oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516"), full_name: "oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone/oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516" } file = sled-storage/src/manager.rs:1431
4752025-02-28T02:07:42.058ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4762025-02-28T02:07:42.058ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4772025-02-28T02:07:42.058ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone"), full_name: "oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone" } file = sled-storage/src/manager.rs:1431
4782025-02-28T02:07:42.089ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4792025-02-28T02:07:42.089ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4802025-02-28T02:07:42.089ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone/oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326"), full_name: "oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone/oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326" } file = sled-storage/src/manager.rs:1431
4812025-02-28T02:07:42.149ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822025-02-28T02:07:42.150ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4832025-02-28T02:07:42.150ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone/oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc"), full_name: "oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone/oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc" } file = sled-storage/src/manager.rs:1431
4842025-02-28T02:07:42.208ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852025-02-28T02:07:42.208ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4862025-02-28T02:07:42.208ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4872025-02-28T02:07:42.257ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882025-02-28T02:07:42.257ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4892025-02-28T02:07:42.257ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/zone"), full_name: "oxp_81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/zone" } file = sled-storage/src/manager.rs:1431
4902025-02-28T02:07:42.287ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912025-02-28T02:07:42.287ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4922025-02-28T02:07:42.287ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/zone"), full_name: "oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/zone" } file = sled-storage/src/manager.rs:1431
4932025-02-28T02:07:42.316ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942025-02-28T02:07:42.316ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4952025-02-28T02:07:42.316ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf/crucible" } file = sled-storage/src/manager.rs:1431
4962025-02-28T02:07:42.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972025-02-28T02:07:42.363ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4982025-02-28T02:07:42.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4992025-02-28T02:07:42.386ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f5279127-f12d-4326-a7e5-d07a518dbb01) file = sled-agent/src/probe_manager.rs:238 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
5002025-02-28T02:07:42.412ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-02-28T02:07:42.412ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5022025-02-28T02:07:42.412ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/zone/oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051"), full_name: "oxp_55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/zone/oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051" } file = sled-storage/src/manager.rs:1431
5032025-02-28T02:07:42.472ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-02-28T02:07:42.472ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052025-02-28T02:07:42.472ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96d00a6f-2f4d-4b13-a75f-c89809dc380a/crypt/zone/oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe"), full_name: "oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a/crypt/zone/oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe" } file = sled-storage/src/manager.rs:1431
5062025-02-28T02:07:42.535ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-02-28T02:07:42.535ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-02-28T02:07:42.535ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/zone/oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58"), full_name: "oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/zone/oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58" } file = sled-storage/src/manager.rs:1431
5092025-02-28T02:07:42.595ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-02-28T02:07:42.595ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112025-02-28T02:07:42.595ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43" } file = sled-storage/src/manager.rs:1431
5122025-02-28T02:07:42.653ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-02-28T02:07:42.653ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142025-02-28T02:07:42.653ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_55ae14e7-5a6e-4245-98d6-55cf62789803/crucible" } file = sled-storage/src/manager.rs:1431
5152025-02-28T02:07:42.700ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-02-28T02:07:42.700ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5172025-02-28T02:07:42.700ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/debug"), full_name: "oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/debug" } file = sled-storage/src/manager.rs:1431
5182025-02-28T02:07:42.729ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-02-28T02:07:42.730ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202025-02-28T02:07:42.730ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/zone/oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77"), full_name: "oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/zone/oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77" } file = sled-storage/src/manager.rs:1431
5212025-02-28T02:07:42.789ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-02-28T02:07:42.789ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5232025-02-28T02:07:42.789ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/zone"), full_name: "oxp_55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/zone" } file = sled-storage/src/manager.rs:1431
5242025-02-28T02:07:42.818ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-02-28T02:07:42.818ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262025-02-28T02:07:42.818ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/zone/oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b"), full_name: "oxp_81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/zone/oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b" } file = sled-storage/src/manager.rs:1431
5272025-02-28T02:07:42.863ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 19.793379137s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
5282025-02-28T02:07:42.879ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-02-28T02:07:42.879ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5302025-02-28T02:07:42.879ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone/oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a"), full_name: "oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone/oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a" } file = sled-storage/src/manager.rs:1431
5312025-02-28T02:07:42.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-02-28T02:07:42.940ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332025-02-28T02:07:42.940ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a/crucible" } file = sled-storage/src/manager.rs:1431
5342025-02-28T02:07:42.987ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-02-28T02:07:42.987ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5362025-02-28T02:07:42.987ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/debug"), full_name: "oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/debug" } file = sled-storage/src/manager.rs:1431
5372025-02-28T02:07:43.016ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-02-28T02:07:43.016ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392025-02-28T02:07:43.016ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5402025-02-28T02:07:43.067ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-02-28T02:07:43.067ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-02-28T02:07:43.067ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible" } file = sled-storage/src/manager.rs:1431
5432025-02-28T02:07:43.115ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-02-28T02:07:43.115ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452025-02-28T02:07:43.115ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337" } file = sled-storage/src/manager.rs:1431
5462025-02-28T02:07:43.179ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-02-28T02:07:43.179ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5482025-02-28T02:07:43.179ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone"), full_name: "oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/zone" } file = sled-storage/src/manager.rs:1431
5492025-02-28T02:07:43.208ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-02-28T02:07:43.208ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-02-28T02:07:43.208ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/zone/oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109"), full_name: "oxp_81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/zone/oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109" } file = sled-storage/src/manager.rs:1431
5522025-02-28T02:07:43.267ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-02-28T02:07:43.267ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542025-02-28T02:07:43.267ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5552025-02-28T02:07:43.317ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-02-28T02:07:43.317ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5572025-02-28T02:07:43.317ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone" } file = sled-storage/src/manager.rs:1431
5582025-02-28T02:07:43.346ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-02-28T02:07:43.346ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602025-02-28T02:07:43.346ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/zone/oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc"), full_name: "oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/zone/oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc" } file = sled-storage/src/manager.rs:1431
5612025-02-28T02:07:43.388ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f5279127-f12d-4326-a7e5-d07a518dbb01) file = sled-agent/src/probe_manager.rs:238 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
5622025-02-28T02:07:43.406ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-02-28T02:07:43.406ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5642025-02-28T02:07:43.406ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7ae93100-6078-4f36-b916-7ea04312348c/crucible" } file = sled-storage/src/manager.rs:1431
5652025-02-28T02:07:43.454ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-02-28T02:07:43.454ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5672025-02-28T02:07:43.454ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/debug"), full_name: "oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/debug" } file = sled-storage/src/manager.rs:1431
5682025-02-28T02:07:43.483ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-02-28T02:07:43.483ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702025-02-28T02:07:43.483ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/zone/oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f"), full_name: "oxp_55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/zone/oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f" } file = sled-storage/src/manager.rs:1431
5712025-02-28T02:07:43.544ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-02-28T02:07:43.544ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5732025-02-28T02:07:43.544ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5742025-02-28T02:07:43.594ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752025-02-28T02:07:43.594ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5762025-02-28T02:07:43.594ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7ae93100-6078-4f36-b916-7ea04312348c/crypt/zone/oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c"), full_name: "oxp_7ae93100-6078-4f36-b916-7ea04312348c/crypt/zone/oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c" } file = sled-storage/src/manager.rs:1431
5772025-02-28T02:07:43.654ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5782025-02-28T02:07:43.654ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5792025-02-28T02:07:43.654ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5802025-02-28T02:07:43.705ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812025-02-28T02:07:43.705ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5822025-02-28T02:07:43.705ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_81fb17c7-22e5-4138-98cb-7b91dded8807/crucible" } file = sled-storage/src/manager.rs:1431
5832025-02-28T02:07:43.754ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842025-02-28T02:07:43.754ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5852025-02-28T02:07:43.754ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/debug"), full_name: "oxp_81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/debug" } file = sled-storage/src/manager.rs:1431
5862025-02-28T02:07:43.784ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872025-02-28T02:07:43.784ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5882025-02-28T02:07:43.784ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/zone/oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f"), full_name: "oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/zone/oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f" } file = sled-storage/src/manager.rs:1431
5892025-02-28T02:07:43.844ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-02-28T02:07:43.844ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912025-02-28T02:07:43.844ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1" } file = sled-storage/src/manager.rs:1431
5922025-02-28T02:07:43.905ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-02-28T02:07:43.905ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5942025-02-28T02:07:43.905ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05" } file = sled-storage/src/manager.rs:1431
5952025-02-28T02:07:43.965ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-02-28T02:07:43.965ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5972025-02-28T02:07:43.965ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/debug"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/debug" } file = sled-storage/src/manager.rs:1431
5982025-02-28T02:07:43.993ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-02-28T02:07:43.993ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002025-02-28T02:07:43.993ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08" } file = sled-storage/src/manager.rs:1431
6012025-02-28T02:07:44.054ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-02-28T02:07:44.054ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6032025-02-28T02:07:44.054ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/debug"), full_name: "oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/debug" } file = sled-storage/src/manager.rs:1431
6042025-02-28T02:07:44.083ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-02-28T02:07:44.083ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-02-28T02:07:44.083ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6072025-02-28T02:07:44.133ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-02-28T02:07:44.133ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-02-28T02:07:44.133ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6102025-02-28T02:07:44.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-02-28T02:07:44.182ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-02-28T02:07:44.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crucible" } file = sled-storage/src/manager.rs:1431
6132025-02-28T02:07:44.231ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-02-28T02:07:44.231ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152025-02-28T02:07:44.231ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crucible" } file = sled-storage/src/manager.rs:1431
6162025-02-28T02:07:44.280ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-02-28T02:07:44.280ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182025-02-28T02:07:44.280ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crucible" } file = sled-storage/src/manager.rs:1431
6192025-02-28T02:07:44.328ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-02-28T02:07:44.328ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6212025-02-28T02:07:44.328ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/zone"), full_name: "oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/zone" } file = sled-storage/src/manager.rs:1431
6222025-02-28T02:07:44.358ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-02-28T02:07:44.358ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242025-02-28T02:07:44.358ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/zone/oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3" } file = sled-storage/src/manager.rs:1431
6252025-02-28T02:07:44.394ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f5279127-f12d-4326-a7e5-d07a518dbb01) file = sled-agent/src/probe_manager.rs:238 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
6262025-02-28T02:07:44.419ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272025-02-28T02:07:44.419ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6282025-02-28T02:07:44.419ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6292025-02-28T02:07:44.468ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302025-02-28T02:07:44.468ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6312025-02-28T02:07:44.468ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6322025-02-28T02:07:44.518ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332025-02-28T02:07:44.518ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6342025-02-28T02:07:44.518ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone/oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1"), full_name: "oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/zone/oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1" } file = sled-storage/src/manager.rs:1431
6352025-02-28T02:07:44.578ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362025-02-28T02:07:44.578ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6372025-02-28T02:07:44.578ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96d00a6f-2f4d-4b13-a75f-c89809dc380a/crypt/zone/oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff"), full_name: "oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a/crypt/zone/oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff" } file = sled-storage/src/manager.rs:1431
6382025-02-28T02:07:44.638ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6392025-02-28T02:07:44.638ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6402025-02-28T02:07:44.638ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7ae93100-6078-4f36-b916-7ea04312348c/crypt/debug"), full_name: "oxp_7ae93100-6078-4f36-b916-7ea04312348c/crypt/debug" } file = sled-storage/src/manager.rs:1431
6412025-02-28T02:07:44.668ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6422025-02-28T02:07:44.668ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6432025-02-28T02:07:44.668ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/zone/oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2"), full_name: "oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/zone/oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2" } file = sled-storage/src/manager.rs:1431
6442025-02-28T02:07:44.729ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452025-02-28T02:07:44.729ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6462025-02-28T02:07:44.729ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/zone/oxz_nexus_97706d05-7981-4c67-b267-252930b86713"), full_name: "oxp_81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/zone/oxz_nexus_97706d05-7981-4c67-b267-252930b86713" } file = sled-storage/src/manager.rs:1431
6472025-02-28T02:07:44.789ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482025-02-28T02:07:44.789ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6492025-02-28T02:07:44.789ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96d00a6f-2f4d-4b13-a75f-c89809dc380a/crypt/debug"), full_name: "oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a/crypt/debug" } file = sled-storage/src/manager.rs:1431
6502025-02-28T02:07:44.819ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-02-28T02:07:44.819ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522025-02-28T02:07:44.819ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
6532025-02-28T02:07:44.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3212812 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47209 req_id = 8326f1b5-e0eb-4828-a82e-161bc8efa3d4 response_code = 200 uri = /datasets
6542025-02-28T02:07:44.851ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3 (service), filesystem_pool: Some(ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a (service), filesystem_pool: Some(ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9 (service), filesystem_pool: Some(ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6552025-02-28T02:07:44.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61798
6562025-02-28T02:07:44.852ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6572025-02-28T02:07:44.852ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582025-02-28T02:07:44.861ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592025-02-28T02:07:44.861ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602025-02-28T02:07:44.869ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612025-02-28T02:07:44.870ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622025-02-28T02:07:44.878ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6632025-02-28T02:07:44.878ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-zones.json file = common/src/ledger.rs:188
6642025-02-28T02:07:44.878ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-02-28T02:07:44.878ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6662025-02-28T02:07:44.878ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-02-28T02:07:44.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-02-28T02:07:44.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-02-28T02:07:44.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-02-28T02:07:44.975ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3 file = illumos-utils/src/zone.rs:325
6712025-02-28T02:07:44.979ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9 file = illumos-utils/src/zone.rs:325
6722025-02-28T02:07:44.982ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a file = illumos-utils/src/zone.rs:325
6732025-02-28T02:07:44.995ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3 file = illumos-utils/src/zone.rs:363
6742025-02-28T02:07:44.999ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9 file = illumos-utils/src/zone.rs:363
6752025-02-28T02:07:45.003ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a file = illumos-utils/src/zone.rs:363
6762025-02-28T02:07:45.396ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/f5279127-f12d-4326-a7e5-d07a518dbb01) file = sled-agent/src/probe_manager.rs:238 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
6772025-02-28T02:07:46.716ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782025-02-28T02:07:46.716ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6792025-02-28T02:07:47.193ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802025-02-28T02:07:47.193ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
6812025-02-28T02:07:47.197ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6822025-02-28T02:07:47.650ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4401
6832025-02-28T02:07:47.650ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4411 gateway = fd00:1122:3344:101::1
6842025-02-28T02:07:47.658ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4425 gateway = fd00:1122:3344:101::1
6852025-02-28T02:07:47.658ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4490
6862025-02-28T02:07:47.681ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6872025-02-28T02:07:47.681ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9
6882025-02-28T02:07:47.696ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a") failed: Property not found. retry in 53.618388ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
6892025-02-28T02:07:47.696ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6902025-02-28T02:07:47.696ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3
6912025-02-28T02:07:47.761ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a") failed: Property not found. retry in 59.800463ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
6922025-02-28T02:07:47.821ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9") failed: Property not found. retry in 59.568369ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9
6932025-02-28T02:07:47.829ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4531
6942025-02-28T02:07:47.829ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4558
6952025-02-28T02:07:47.830ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a") failed: Property not found. retry in 234.955021ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
6962025-02-28T02:07:47.845ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3") failed: Property not found. retry in 44.827543ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3
6972025-02-28T02:07:47.873ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4571
6982025-02-28T02:07:47.873ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4442
6992025-02-28T02:07:47.892ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9") failed: Property not found. retry in 88.228884ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9
7002025-02-28T02:07:47.907ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3") failed: Property not found. retry in 126.785263ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3
7012025-02-28T02:07:48.039ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9") failed: Property not found. retry in 229.116933ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9
7022025-02-28T02:07:48.051ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4484
7032025-02-28T02:07:48.056ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4538 rack_subnet = fd00:1122:3344::
7042025-02-28T02:07:48.056ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3") failed: Property not found. retry in 264.62115ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3
7052025-02-28T02:07:48.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a") failed: Property not found. retry in 433.302473ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
7062025-02-28T02:07:48.100ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4549
7072025-02-28T02:07:48.100ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4622
7082025-02-28T02:07:48.168ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2252679084643217590 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
7092025-02-28T02:07:48.168ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 513526410483225983 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
7102025-02-28T02:07:48.295ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4654
7112025-02-28T02:07:48.297ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4660
7122025-02-28T02:07:48.313ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9") failed: Property not found. retry in 353.727913ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9
7132025-02-28T02:07:48.375ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3") failed: Property not found. retry in 463.602552ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3
7142025-02-28T02:07:48.421ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2290749193341108339 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
7152025-02-28T02:07:48.421ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12068597891640042987 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
7162025-02-28T02:07:48.475ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4701
7172025-02-28T02:07:48.475ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4574
7182025-02-28T02:07:48.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a") failed: Property not found. retry in 403.072485ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
7192025-02-28T02:07:48.582ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4607
7202025-02-28T02:07:48.582ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7212025-02-28T02:07:48.615ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/f5279127-f12d-4326-a7e5-d07a518dbb01) file = sled-agent/src/nexus.rs:530 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
7222025-02-28T02:07:48.615ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7232025-02-28T02:07:48.648ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7242025-02-28T02:07:48.648ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7252025-02-28T02:07:48.648ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7262025-02-28T02:07:48.648ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7272025-02-28T02:07:48.691ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9") failed: Property not found. retry in 671.857448ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9
7282025-02-28T02:07:48.692ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
7292025-02-28T02:07:48.745ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7302025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7312025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7322025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7332025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7342025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7352025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7362025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7372025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7382025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7392025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7402025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7412025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7422025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7432025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7442025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7452025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7462025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7472025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7482025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7492025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7502025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7512025-02-28T02:07:48.745ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7522025-02-28T02:07:48.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3") failed: Property not found. retry in 775.108572ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3
7532025-02-28T02:07:48.942ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a") failed: Property not found. retry in 1.469356558s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
7542025-02-28T02:07:49.373ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9") failed: Property not found. retry in 1.019299755s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9
7552025-02-28T02:07:49.621ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3") failed: Property not found. retry in 1.203940508s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3
7562025-02-28T02:07:50.402ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9") failed: Property not found. retry in 1.369033209s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9
7572025-02-28T02:07:50.420ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a") failed: Property not found. retry in 812.341527ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
7582025-02-28T02:07:50.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3") failed: Property not found. retry in 771.62621ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3
7592025-02-28T02:07:51.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a") failed: Property not found. retry in 1.377067458s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
7602025-02-28T02:07:51.615ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3") failed: Property not found. retry in 1.312972459s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3
7612025-02-28T02:07:51.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9") failed: Property not found. retry in 1.379996757s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9
7622025-02-28T02:07:52.626ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a") failed: Property not found. retry in 916.645073ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
7632025-02-28T02:07:53.561ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3
7642025-02-28T02:07:53.561ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9
7652025-02-28T02:07:53.561ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a
7662025-02-28T02:07:53.561ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672025-02-28T02:07:53.561ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682025-02-28T02:07:53.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8710312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61798 req_id = c5a66175-de4d-47d8-a1cf-1b1f763b8fa9 response_code = 204 uri = /omicron-zones
7692025-02-28T02:07:53.564ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702025-02-28T02:07:53.797ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 103.128199ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7712025-02-28T02:07:53.919ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722025-02-28T02:07:53.967ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732025-02-28T02:07:54.015ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7742025-02-28T02:07:54.015ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7752025-02-28T02:07:54.046ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7762025-02-28T02:07:54.047ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7772025-02-28T02:07:54.047ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7782025-02-28T02:07:54.076ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3 (service), filesystem_pool: Some(ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a (service), filesystem_pool: Some(ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9 (service), filesystem_pool: Some(ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: b15d390a-5f3f-49a8-84ce-dec6d458b051 (service), filesystem_pool: Some(ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1e8d66e7-c4d9-4f77-868c-64910cd1212f, kind: Service { id: b15d390a-5f3f-49a8-84ce-dec6d458b051 }, name: Name("ntp-b15d390a-5f3f-49a8-84ce-dec6d458b051"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 243])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7792025-02-28T02:07:54.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44208
7802025-02-28T02:07:54.076ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812025-02-28T02:07:54.076ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822025-02-28T02:07:54.087ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-02-28T02:07:54.087ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-02-28T02:07:54.097ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-02-28T02:07:54.097ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-02-28T02:07:54.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872025-02-28T02:07:54.107ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-zones.json file = common/src/ledger.rs:177
7882025-02-28T02:07:54.108ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-zones.json file = common/src/ledger.rs:177
7892025-02-28T02:07:54.108ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7902025-02-28T02:07:54.108ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7912025-02-28T02:07:54.119ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7922025-02-28T02:07:54.150ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7932025-02-28T02:07:54.151ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7942025-02-28T02:07:54.151ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7952025-02-28T02:07:54.180ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 230, 243]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7962025-02-28T02:07:54.180ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = boundary_ntp
7972025-02-28T02:07:54.181ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7982025-02-28T02:07:54.181ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7992025-02-28T02:07:54.181ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8002025-02-28T02:07:54.181ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8012025-02-28T02:07:54.204ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051 file = illumos-utils/src/zone.rs:325
8022025-02-28T02:07:54.222ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051 file = illumos-utils/src/zone.rs:363
8032025-02-28T02:07:54.852ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8042025-02-28T02:07:54.852ZINFOSledAgent (ServiceManager): Booting oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8052025-02-28T02:07:54.972ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051") failed: Property not found. retry in 39.618226ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8062025-02-28T02:07:55.019ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051") failed: Property not found. retry in 94.136632ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8072025-02-28T02:07:55.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051") failed: Property not found. retry in 273.287287ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8082025-02-28T02:07:55.410ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051") failed: Property not found. retry in 457.785828ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8092025-02-28T02:07:55.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051") failed: Property not found. retry in 641.622626ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8102025-02-28T02:07:56.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051") failed: Property not found. retry in 599.995403ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8112025-02-28T02:07:57.140ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051") failed: Property not found. retry in 623.899657ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8122025-02-28T02:07:57.772ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051") failed: Property not found. retry in 1.036617365s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8132025-02-28T02:07:58.169ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2252679084643217590 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8142025-02-28T02:07:58.169ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 513526410483225983 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8152025-02-28T02:07:58.422ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2290749193341108339 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8162025-02-28T02:07:58.422ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12068597891640042987 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8172025-02-28T02:07:58.819ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051") failed: Property not found. retry in 945.218957ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8182025-02-28T02:07:59.774ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051") failed: Property not found. retry in 898.392747ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8192025-02-28T02:08:00.692ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051
8202025-02-28T02:08:00.692ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8212025-02-28T02:08:00.692ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8222025-02-28T02:08:00.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6616491 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44208 req_id = 99685957-d2c0-4e9b-b536-350d32d086fb response_code = 204 uri = /omicron-zones
8232025-02-28T02:08:00.695ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8242025-02-28T02:08:00.724ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8252025-02-28T02:08:00.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46739
8262025-02-28T02:08:00.732ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8272025-02-28T02:08:00.732ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 7364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46739 req_id = 40d05700-eb68-422d-86df-158199834abb response_code = 500 uri = /timesync
8282025-02-28T02:08:00.733ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8292025-02-28T02:08:00.826ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8302025-02-28T02:08:00.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44454
8312025-02-28T02:08:02.953ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3089273681456689862 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8322025-02-28T02:08:03.184ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16543694768619205403 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8332025-02-28T02:08:03.564ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4084091839032351090 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8342025-02-28T02:08:04.834ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8352025-02-28T02:08:04.834ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 4007612 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44454 req_id = c1b042f2-412c-4e7e-be43-5a60072f96f7 response_code = 500 uri = /timesync
8362025-02-28T02:08:04.836ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8372025-02-28T02:08:05.032ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8382025-02-28T02:08:05.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53785
8392025-02-28T02:08:05.042ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8402025-02-28T02:08:05.043ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 10541 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53785 req_id = 015d61b3-d91f-4dd7-9059-939bfb1ae1e3 response_code = 500 uri = /timesync
8412025-02-28T02:08:05.045ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8422025-02-28T02:08:05.212ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8432025-02-28T02:08:05.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63666
8442025-02-28T02:08:08.451ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2252679084643217590 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8452025-02-28T02:08:08.452ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 513526410483225983 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8462025-02-28T02:08:08.705ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2290749193341108339 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8472025-02-28T02:08:08.705ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12068597891640042987 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8482025-02-28T02:08:09.501ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_b15d390a-5f3f-49a8-84ce-dec6d458b051': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8492025-02-28T02:08:09.501ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008813 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63666 req_id = 6f068ff0-10f6-4413-b613-a36e122b8170 response_code = 500 uri = /timesync
8502025-02-28T02:08:09.504ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512025-02-28T02:08:09.686ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8522025-02-28T02:08:09.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43600
8532025-02-28T02:08:09.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8823 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43600 req_id = d4ebaac0-32ae-4cb1-80de-c6a7ad2d0c70 response_code = 200 uri = /timesync
8542025-02-28T02:08:09.697ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.039367247 } file = sled-agent/src/rack_setup/service.rs:743
8552025-02-28T02:08:09.697ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8562025-02-28T02:08:09.933ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572025-02-28T02:08:09.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55422
8582025-02-28T02:08:09.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8856 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55422 req_id = fb450087-26d3-45d5-beb0-4b75cd225ed3 response_code = 200 uri = /timesync
8592025-02-28T02:08:09.944ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.0386956 } file = sled-agent/src/rack_setup/service.rs:743
8602025-02-28T02:08:09.944ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612025-02-28T02:08:10.297ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8622025-02-28T02:08:10.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35513
8632025-02-28T02:08:10.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7868 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35513 req_id = 1d23428f-f92b-456e-b1c7-9626f7324591 response_code = 200 uri = /timesync
8642025-02-28T02:08:10.306ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.037710797 } file = sled-agent/src/rack_setup/service.rs:743
8652025-02-28T02:08:10.306ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8662025-02-28T02:08:10.622ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8672025-02-28T02:08:10.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37821
8682025-02-28T02:08:10.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7901 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37821 req_id = 4c894518-996d-4e41-b566-2136a931e3a9 response_code = 200 uri = /timesync
8692025-02-28T02:08:10.631ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740708488.9992492, correction: -0.038473018 } file = sled-agent/src/rack_setup/service.rs:743
8702025-02-28T02:08:10.631ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8712025-02-28T02:08:10.970ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1311710721811749292 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8722025-02-28T02:08:10.971ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6275543239465955322 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
8732025-02-28T02:08:11.041ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8742025-02-28T02:08:11.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56829
8752025-02-28T02:08:11.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9466 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56829 req_id = 66e33dcc-a5cb-4845-bbef-7e20c8285d04 response_code = 200 uri = /timesync
8762025-02-28T02:08:11.055ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740708488.9992492, correction: -0.037328634 } file = sled-agent/src/rack_setup/service.rs:743
8772025-02-28T02:08:11.055ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8782025-02-28T02:08:11.356ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8792025-02-28T02:08:11.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35495
8802025-02-28T02:08:11.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7560 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35495 req_id = e9518e57-6f58-4066-9b1f-d3d5c8ee3ec7 response_code = 200 uri = /timesync
8812025-02-28T02:08:11.365ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740708488.9992492, correction: -0.036479805 } file = sled-agent/src/rack_setup/service.rs:743
8822025-02-28T02:08:11.365ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8832025-02-28T02:08:12.023ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8842025-02-28T02:08:12.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50783
8852025-02-28T02:08:12.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8787 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50783 req_id = ebeb3906-76c5-41c9-987c-2c513ee385e2 response_code = 200 uri = /timesync
8862025-02-28T02:08:12.034ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740708488.9992492, correction: -0.029117502 } file = sled-agent/src/rack_setup/service.rs:743
8872025-02-28T02:08:12.034ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8882025-02-28T02:08:12.501ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8892025-02-28T02:08:12.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45839
8902025-02-28T02:08:12.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 22034 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45839 req_id = 1ff74919-6b02-44fb-b941-37177e94836c response_code = 200 uri = /timesync
8912025-02-28T02:08:12.527ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2366368323, ip_addr: 141.11.234.67, stratum: 3, ref_time: 1740708492.2996082, correction: -0.025838031 } file = sled-agent/src/rack_setup/service.rs:743
8922025-02-28T02:08:12.527ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1378
8932025-02-28T02:08:12.557ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3 (service), filesystem_pool: Some(ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a (service), filesystem_pool: Some(ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9 (service), filesystem_pool: Some(ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: b15d390a-5f3f-49a8-84ce-dec6d458b051 (service), filesystem_pool: Some(ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1e8d66e7-c4d9-4f77-868c-64910cd1212f, kind: Service { id: b15d390a-5f3f-49a8-84ce-dec6d458b051 }, name: Name("ntp-b15d390a-5f3f-49a8-84ce-dec6d458b051"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 243])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: a4e1abee-d0da-439e-bf90-4ac6e85e40d1 (service), filesystem_pool: Some(ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 7dbc7893-874f-4418-8180-e7b3e0652326 (service), filesystem_pool: Some(ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8437c9e3-36e1-46a7-bc55-943fba6bb516 (service), filesystem_pool: Some(ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: c46a1621-3637-4996-9844-e7b98d95e109 (service), filesystem_pool: Some(ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ba8c348f-8ea8-4381-a9bd-f6213b39be6f (service), filesystem_pool: Some(ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8942025-02-28T02:08:12.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49687
8952025-02-28T02:08:12.558ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8962025-02-28T02:08:12.558ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8972025-02-28T02:08:12.570ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8982025-02-28T02:08:12.570ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8992025-02-28T02:08:12.579ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9002025-02-28T02:08:12.579ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9012025-02-28T02:08:12.588ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9022025-02-28T02:08:12.588ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9032025-02-28T02:08:12.598ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9042025-02-28T02:08:12.598ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9052025-02-28T02:08:12.606ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9062025-02-28T02:08:12.606ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9072025-02-28T02:08:12.615ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9082025-02-28T02:08:12.615ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9092025-02-28T02:08:12.624ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9102025-02-28T02:08:12.624ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Cockroach }, responder: ... }
9112025-02-28T02:08:12.633ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9122025-02-28T02:08:12.633ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-zones.json file = common/src/ledger.rs:177
9132025-02-28T02:08:12.633ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-zones.json file = common/src/ledger.rs:177
9142025-02-28T02:08:12.633ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
9152025-02-28T02:08:12.633ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9162025-02-28T02:08:12.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9172025-02-28T02:08:12.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9182025-02-28T02:08:12.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9192025-02-28T02:08:12.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9202025-02-28T02:08:12.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9212025-02-28T02:08:12.801ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f file = illumos-utils/src/zone.rs:325
9222025-02-28T02:08:12.805ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 file = illumos-utils/src/zone.rs:325
9232025-02-28T02:08:12.810ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1 file = illumos-utils/src/zone.rs:325
9242025-02-28T02:08:12.814ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109 file = illumos-utils/src/zone.rs:325
9252025-02-28T02:08:12.818ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516 file = illumos-utils/src/zone.rs:325
9262025-02-28T02:08:12.823ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f file = illumos-utils/src/zone.rs:363
9272025-02-28T02:08:12.827ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 file = illumos-utils/src/zone.rs:363
9282025-02-28T02:08:12.832ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1 file = illumos-utils/src/zone.rs:363
9292025-02-28T02:08:12.837ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109 file = illumos-utils/src/zone.rs:363
9302025-02-28T02:08:12.841ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516 file = illumos-utils/src/zone.rs:363
9312025-02-28T02:08:16.973ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8437c9e3-36e1-46a7-bc55-943fba6bb516'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9322025-02-28T02:08:16.973ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9332025-02-28T02:08:16.979ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a4e1abee-d0da-439e-bf90-4ac6e85e40d1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9342025-02-28T02:08:16.979ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9352025-02-28T02:08:17.067ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7dbc7893-874f-4418-8180-e7b3e0652326'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9362025-02-28T02:08:17.067ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9372025-02-28T02:08:17.073ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c46a1621-3637-4996-9844-e7b98d95e109'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9382025-02-28T02:08:17.073ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9392025-02-28T02:08:17.118ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 26.348556ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9402025-02-28T02:08:17.125ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 42.972836ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9412025-02-28T02:08:17.132ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ba8c348f-8ea8-4381-a9bd-f6213b39be6f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9422025-02-28T02:08:17.132ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9432025-02-28T02:08:17.153ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 142.005699ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9442025-02-28T02:08:17.178ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 92.071022ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9452025-02-28T02:08:17.214ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 58.722728ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9462025-02-28T02:08:17.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 26.2917ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9472025-02-28T02:08:17.257ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 105.768826ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9482025-02-28T02:08:17.268ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 50.202141ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9492025-02-28T02:08:17.281ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 182.467849ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9502025-02-28T02:08:17.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 139.743018ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9512025-02-28T02:08:17.306ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 278.955118ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9522025-02-28T02:08:17.325ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 119.116121ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9532025-02-28T02:08:17.372ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 195.626839ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9542025-02-28T02:08:17.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 228.476676ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9552025-02-28T02:08:17.454ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 177.086781ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9562025-02-28T02:08:17.471ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 209.610785ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9572025-02-28T02:08:17.576ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 539.672458ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9582025-02-28T02:08:17.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 218.159814ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9592025-02-28T02:08:17.640ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 469.518723ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9602025-02-28T02:08:17.677ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 259.34414ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9612025-02-28T02:08:17.689ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 662.113378ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9622025-02-28T02:08:17.820ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 519.579059ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9632025-02-28T02:08:17.945ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 575.135853ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9642025-02-28T02:08:17.950ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 360.717322ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
9652025-02-28T02:08:18.121ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 982.660076ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9662025-02-28T02:08:18.131ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 801.379754ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9672025-02-28T02:08:18.135ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60394
9682025-02-28T02:08:18.135ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60394 req_id = b161f438-50ff-4fd4-a3f8-de6cb0ac9bef response_code = 200 uri = /baseboard
9692025-02-28T02:08:18.350ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 823.329306ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9702025-02-28T02:08:18.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 783.840587ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9712025-02-28T02:08:18.529ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 1.401151125s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9722025-02-28T02:08:18.939ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 933.884386ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9732025-02-28T02:08:19.109ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 1.184337238s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9742025-02-28T02:08:19.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 636.589985ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9752025-02-28T02:08:19.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 684.768447ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9762025-02-28T02:08:19.888ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 595.73265ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9772025-02-28T02:08:20.353ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 1.285132803s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9782025-02-28T02:08:20.368ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 970.011139ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9792025-02-28T02:08:20.384ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 1.076349835s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9802025-02-28T02:08:20.400ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 599.628347ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9812025-02-28T02:08:20.497ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 869.225785ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9822025-02-28T02:08:21.010ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 518.671682ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9832025-02-28T02:08:21.346ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 828.110976ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9842025-02-28T02:08:21.373ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 977.006796ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9852025-02-28T02:08:21.466ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 1.153954248s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9862025-02-28T02:08:21.537ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 1.336865408s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9872025-02-28T02:08:21.645ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 1.255431093s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9882025-02-28T02:08:22.184ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 1.429011836s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9892025-02-28T02:08:22.360ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 964.154344ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9902025-02-28T02:08:22.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 1.336775877s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9912025-02-28T02:08:22.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 1.229839593s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9922025-02-28T02:08:22.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 763.238994ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9932025-02-28T02:08:23.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 737.063676ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9942025-02-28T02:08:23.622ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 748.563034ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
9952025-02-28T02:08:23.680ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 1.406330732s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
9962025-02-28T02:08:23.975ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 1.006533093s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
9972025-02-28T02:08:24.078ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 1.100371135s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
9982025-02-28T02:08:24.120ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 1.114659432s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
9992025-02-28T02:08:24.382ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 987.64822ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
10002025-02-28T02:08:24.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 1.051921682s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
10012025-02-28T02:08:25.097ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 1.205199313s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
10022025-02-28T02:08:25.188ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 1.185041155s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
10032025-02-28T02:08:25.244ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 1.232612685s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
10042025-02-28T02:08:25.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 1.272374913s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
10052025-02-28T02:08:26.053ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 694.275448ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
10062025-02-28T02:08:26.313ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 628.460232ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
10072025-02-28T02:08:26.382ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 1.439718903s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
10082025-02-28T02:08:26.486ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 611.027324ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
10092025-02-28T02:08:26.659ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 760.268974ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
10102025-02-28T02:08:26.756ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 928.641282ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
10112025-02-28T02:08:26.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 1.292179718s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
10122025-02-28T02:08:27.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 705.805596ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
10132025-02-28T02:08:27.429ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 659.994499ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
10142025-02-28T02:08:27.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 533.851482ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
10152025-02-28T02:08:27.823ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 1.322239323s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
10162025-02-28T02:08:27.831ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 570.089817ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
10172025-02-28T02:08:28.098ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 536.05437ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
10182025-02-28T02:08:28.238ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 1.217473986s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
10192025-02-28T02:08:28.254ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 1.24677045s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
10202025-02-28T02:08:28.410ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 651.56521ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
10212025-02-28T02:08:28.643ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 691.560383ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
10222025-02-28T02:08:29.072ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 1.473754826s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
10232025-02-28T02:08:29.155ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 723.421018ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
10242025-02-28T02:08:29.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 1.253353154s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
10252025-02-28T02:08:29.465ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 1.486905848s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
10262025-02-28T02:08:29.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 744.319249ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
10272025-02-28T02:08:29.889ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 1.491839112s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
10282025-02-28T02:08:30.262ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109") failed: Property not found. retry in 1.381188263s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
10292025-02-28T02:08:30.555ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1") failed: Property not found. retry in 1.478200649s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
10302025-02-28T02:08:30.607ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516") failed: Property not found. retry in 1.165753546s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
10312025-02-28T02:08:30.960ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 537.660714ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
10322025-02-28T02:08:31.391ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326") failed: Property not found. retry in 600.669763ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
10332025-02-28T02:08:31.506ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f") failed: Property not found. retry in 1.129556922s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
10342025-02-28T02:08:32.662ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_ba8c348f-8ea8-4381-a9bd-f6213b39be6f
10352025-02-28T02:08:32.662ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326
10362025-02-28T02:08:32.662ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_a4e1abee-d0da-439e-bf90-4ac6e85e40d1
10372025-02-28T02:08:32.662ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_c46a1621-3637-4996-9844-e7b98d95e109
10382025-02-28T02:08:32.662ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_8437c9e3-36e1-46a7-bc55-943fba6bb516
10392025-02-28T02:08:32.662ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10402025-02-28T02:08:32.663ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10412025-02-28T02:08:32.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 20129608 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49687 req_id = c13d30dc-90b5-4b3c-9c78-fcc149cca4b4 response_code = 204 uri = /omicron-zones
10422025-02-28T02:08:32.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37805
10432025-02-28T02:08:32.731ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 28988 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37805 req_id = 2bf6aec0-c88e-4f50-b10a-db9ee78f96ba response_code = 500 uri = /cockroachdb
10442025-02-28T02:08:32.731ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2bf6aec0-c88e-4f50-b10a-db9ee78f96ba", "content-length": "124", "date": "Fri, 28 Feb 2025 02:08:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2bf6aec0-c88e-4f50-b10a-db9ee78f96ba" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 134.520858ms
10452025-02-28T02:08:32.894ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 26661 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37805 req_id = c31a9ab8-c0e8-4664-b5eb-c3259e46c4c7 response_code = 500 uri = /cockroachdb
10462025-02-28T02:08:32.894ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c31a9ab8-c0e8-4664-b5eb-c3259e46c4c7", "content-length": "124", "date": "Fri, 28 Feb 2025 02:08:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c31a9ab8-c0e8-4664-b5eb-c3259e46c4c7" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 80.698867ms
10472025-02-28T02:08:33.002ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 25336 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37805 req_id = 771f3a20-0880-486e-b417-df96748bcbe5 response_code = 500 uri = /cockroachdb
10482025-02-28T02:08:33.002ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "771f3a20-0880-486e-b417-df96748bcbe5", "content-length": "124", "date": "Fri, 28 Feb 2025 02:08:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "771f3a20-0880-486e-b417-df96748bcbe5" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 130.754061ms
10492025-02-28T02:08:33.162ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 27462 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37805 req_id = cc498a02-7728-4383-a7d8-daf74448de55 response_code = 500 uri = /cockroachdb
10502025-02-28T02:08:33.162ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cc498a02-7728-4383-a7d8-daf74448de55", "content-length": "124", "date": "Fri, 28 Feb 2025 02:08:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cc498a02-7728-4383-a7d8-daf74448de55" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 118.958698ms
10512025-02-28T02:08:33.310ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 28089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37805 req_id = a19b8b53-7838-431f-9652-86cdb9a25ae4 response_code = 500 uri = /cockroachdb
10522025-02-28T02:08:33.310ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a19b8b53-7838-431f-9652-86cdb9a25ae4", "content-length": "124", "date": "Fri, 28 Feb 2025 02:08:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a19b8b53-7838-431f-9652-86cdb9a25ae4" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 241.135845ms
10532025-02-28T02:08:33.336ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 559.708418ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
10542025-02-28T02:08:33.578ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 26180 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37805 req_id = f1a24057-3b02-4e0b-8df6-c35c0cf2e5f5 response_code = 500 uri = /cockroachdb
10552025-02-28T02:08:33.578ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f1a24057-3b02-4e0b-8df6-c35c0cf2e5f5", "content-length": "124", "date": "Fri, 28 Feb 2025 02:08:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f1a24057-3b02-4e0b-8df6-c35c0cf2e5f5" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 253.935649ms
10562025-02-28T02:08:33.862ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 28122 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37805 req_id = b5b1b72b-64ff-4f0c-8b71-9eec99d9e744 response_code = 500 uri = /cockroachdb
10572025-02-28T02:08:33.862ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b5b1b72b-64ff-4f0c-8b71-9eec99d9e744", "content-length": "124", "date": "Fri, 28 Feb 2025 02:08:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b5b1b72b-64ff-4f0c-8b71-9eec99d9e744" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 234.584472ms
10582025-02-28T02:08:34.123ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_7dbc7893-874f-4418-8180-e7b3e0652326 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:855 latency_us = 25627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37805 req_id = c3bd6b5e-442b-480d-b9b3-df91411c6b60 response_code = 500 uri = /cockroachdb
10592025-02-28T02:08:34.123ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c3bd6b5e-442b-480d-b9b3-df91411c6b60", "content-length": "124", "date": "Fri, 28 Feb 2025 02:08:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c3bd6b5e-442b-480d-b9b3-df91411c6b60" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 231.479934ms
10602025-02-28T02:08:34.381ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3852
10612025-02-28T02:08:59.787ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3870
10622025-02-28T02:09:04.302ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3893
10632025-02-28T02:09:04.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 29947222 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37805 req_id = 60e84998-e9ed-4537-8f1c-b094906810eb response_code = 204 uri = /cockroachdb
10642025-02-28T02:09:04.311ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63768
10652025-02-28T02:09:04.326ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.228957724s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
10662025-02-28T02:09:04.375ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: d53fadb3-fc6a-4ca3-9399-aaaf4fbeade3 (service), filesystem_pool: Some(ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 6bc7c8aa-819f-4f1e-845e-1e1d8a18b11a (service), filesystem_pool: Some(ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: ad4ec98e-312a-47ce-9f5c-cb60dff6f1e9 (service), filesystem_pool: Some(ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: b15d390a-5f3f-49a8-84ce-dec6d458b051 (service), filesystem_pool: Some(ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1e8d66e7-c4d9-4f77-868c-64910cd1212f, kind: Service { id: b15d390a-5f3f-49a8-84ce-dec6d458b051 }, name: Name("ntp-b15d390a-5f3f-49a8-84ce-dec6d458b051"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 243])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: a4e1abee-d0da-439e-bf90-4ac6e85e40d1 (service), filesystem_pool: Some(ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 7dbc7893-874f-4418-8180-e7b3e0652326 (service), filesystem_pool: Some(ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8437c9e3-36e1-46a7-bc55-943fba6bb516 (service), filesystem_pool: Some(ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: c46a1621-3637-4996-9844-e7b98d95e109 (service), filesystem_pool: Some(ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ba8c348f-8ea8-4381-a9bd-f6213b39be6f (service), filesystem_pool: Some(ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 (service), filesystem_pool: Some(ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 (service), filesystem_pool: Some(ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 93cc49c1-2861-4962-9f80-1961b297cd43 (service), filesystem_pool: Some(ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f (service), filesystem_pool: Some(ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 97706d05-7981-4c67-b267-252930b86713 (service), filesystem_pool: Some(ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 5b2025ef-6347-4939-a58e-a3b260c96fcc (service), filesystem_pool: Some(ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: f31db580-dafe-416a-ac51-7d13b61f9a05 (service), filesystem_pool: Some(ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4d50ae5c-d41d-4e25-94c8-47f2b20e37f1 (service), filesystem_pool: Some(ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 6613589b-925e-4835-b5cf-2a2555718d58 (service), filesystem_pool: Some(ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: ee8c250b-0920-4b81-9ee2-e6a75db4c4ff (service), filesystem_pool: Some(ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 7ea3968f-03b8-449a-bba9-ad00377b2337 (service), filesystem_pool: Some(ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2f320024-5723-4442-8cc9-a9c2e9484e66 (service), filesystem_pool: Some(ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4393b6ee-0a72-4709-8bea-32dfcb462ccc (service), filesystem_pool: Some(ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 0041d0fd-64b2-4ca0-ab37-e70021644a2b (service), filesystem_pool: Some(ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4a50844d-66ba-4289-8aaa-4158bf2e15c2 (service), filesystem_pool: Some(ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: c00d3169-f051-4b19-9715-b55bd4d1f3fe (service), filesystem_pool: Some(ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b56d6db0-d375-49ea-9267-3902aed8f62c (service), filesystem_pool: Some(ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b7146ab8-7a92-41df-9542-18ca1cec5d31 (service), filesystem_pool: Some(ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77 (service), filesystem_pool: Some(ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10672025-02-28T02:09:04.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39939
10682025-02-28T02:09:04.381ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10692025-02-28T02:09:04.381ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10702025-02-28T02:09:04.394ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10712025-02-28T02:09:04.394ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10722025-02-28T02:09:04.404ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10732025-02-28T02:09:04.404ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10742025-02-28T02:09:04.412ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10752025-02-28T02:09:04.412ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10762025-02-28T02:09:04.421ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10772025-02-28T02:09:04.421ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10782025-02-28T02:09:04.430ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10792025-02-28T02:09:04.430ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10802025-02-28T02:09:04.440ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10812025-02-28T02:09:04.440ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10822025-02-28T02:09:04.450ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10832025-02-28T02:09:04.450ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Cockroach }, responder: ... }
10842025-02-28T02:09:04.459ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10852025-02-28T02:09:04.459ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10862025-02-28T02:09:04.469ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10872025-02-28T02:09:04.469ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10882025-02-28T02:09:04.478ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10892025-02-28T02:09:04.478ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10902025-02-28T02:09:04.489ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10912025-02-28T02:09:04.489ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10922025-02-28T02:09:04.499ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10932025-02-28T02:09:04.499ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, kind: Crucible }, responder: ... }
10942025-02-28T02:09:04.508ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10952025-02-28T02:09:04.508ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, kind: Crucible }, responder: ... }
10962025-02-28T02:09:04.518ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10972025-02-28T02:09:04.518ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, kind: Crucible }, responder: ... }
10982025-02-28T02:09:04.528ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10992025-02-28T02:09:04.528ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, kind: Crucible }, responder: ... }
11002025-02-28T02:09:04.538ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11012025-02-28T02:09:04.538ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, kind: Crucible }, responder: ... }
11022025-02-28T02:09:04.548ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11032025-02-28T02:09:04.548ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, kind: Crucible }, responder: ... }
11042025-02-28T02:09:04.558ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11052025-02-28T02:09:04.558ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, kind: Crucible }, responder: ... }
11062025-02-28T02:09:04.568ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11072025-02-28T02:09:04.568ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, kind: Crucible }, responder: ... }
11082025-02-28T02:09:04.579ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11092025-02-28T02:09:04.579ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-zones.json file = common/src/ledger.rs:177
11102025-02-28T02:09:04.580ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-zones.json file = common/src/ledger.rs:177
11112025-02-28T02:09:04.581ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
11122025-02-28T02:09:04.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11132025-02-28T02:09:04.694ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11142025-02-28T02:09:04.695ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11152025-02-28T02:09:04.708ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11162025-02-28T02:09:04.734ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11172025-02-28T02:09:04.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11182025-02-28T02:09:04.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11192025-02-28T02:09:04.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11202025-02-28T02:09:04.759ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11212025-02-28T02:09:04.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11222025-02-28T02:09:04.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11232025-02-28T02:09:04.946ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11242025-02-28T02:09:04.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11252025-02-28T02:09:04.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11262025-02-28T02:09:04.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11272025-02-28T02:09:04.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282025-02-28T02:09:04.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11292025-02-28T02:09:04.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11302025-02-28T02:09:04.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11312025-02-28T02:09:04.958ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11322025-02-28T02:09:04.958ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05 file = illumos-utils/src/zone.rs:325
11332025-02-28T02:09:04.964ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58 file = illumos-utils/src/zone.rs:325
11342025-02-28T02:09:04.968ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe file = illumos-utils/src/zone.rs:325
11352025-02-28T02:09:04.973ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c file = illumos-utils/src/zone.rs:325
11362025-02-28T02:09:04.979ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31 file = illumos-utils/src/zone.rs:325
11372025-02-28T02:09:04.985ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff file = illumos-utils/src/zone.rs:325
11382025-02-28T02:09:05.151ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05 file = illumos-utils/src/zone.rs:363
11392025-02-28T02:09:05.157ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58 file = illumos-utils/src/zone.rs:363
11402025-02-28T02:09:05.161ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe file = illumos-utils/src/zone.rs:363
11412025-02-28T02:09:05.166ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c file = illumos-utils/src/zone.rs:363
11422025-02-28T02:09:05.171ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31 file = illumos-utils/src/zone.rs:363
11432025-02-28T02:09:05.176ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff file = illumos-utils/src/zone.rs:363
11442025-02-28T02:09:05.181ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66 file = illumos-utils/src/zone.rs:325
11452025-02-28T02:09:05.187ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1 file = illumos-utils/src/zone.rs:325
11462025-02-28T02:09:05.193ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77 file = illumos-utils/src/zone.rs:325
11472025-02-28T02:09:05.198ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc file = illumos-utils/src/zone.rs:325
11482025-02-28T02:09:05.204ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b file = illumos-utils/src/zone.rs:325
11492025-02-28T02:09:05.209ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337 file = illumos-utils/src/zone.rs:325
11502025-02-28T02:09:05.215ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2 file = illumos-utils/src/zone.rs:325
11512025-02-28T02:09:05.222ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc file = illumos-utils/src/zone.rs:325
11522025-02-28T02:09:05.230ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66 file = illumos-utils/src/zone.rs:363
11532025-02-28T02:09:05.238ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1 file = illumos-utils/src/zone.rs:363
11542025-02-28T02:09:05.248ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77 file = illumos-utils/src/zone.rs:363
11552025-02-28T02:09:05.255ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc file = illumos-utils/src/zone.rs:363
11562025-02-28T02:09:05.262ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b file = illumos-utils/src/zone.rs:363
11572025-02-28T02:09:05.272ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337 file = illumos-utils/src/zone.rs:363
11582025-02-28T02:09:05.286ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2 file = illumos-utils/src/zone.rs:363
11592025-02-28T02:09:05.300ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc file = illumos-utils/src/zone.rs:363
11602025-02-28T02:09:05.367ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11612025-02-28T02:09:05.450ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11622025-02-28T02:09:05.509ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11632025-02-28T02:09:05.573ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11642025-02-28T02:09:05.666ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11652025-02-28T02:09:05.672ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11662025-02-28T02:09:05.672ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11672025-02-28T02:09:05.741ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 197, 69]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11682025-02-28T02:09:05.741ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
11692025-02-28T02:09:05.744ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11702025-02-28T02:09:05.744ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11712025-02-28T02:09:05.847ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 217, 80]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11722025-02-28T02:09:05.847ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
11732025-02-28T02:09:05.848ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11742025-02-28T02:09:05.848ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11752025-02-28T02:09:05.924ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 143, 74]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11762025-02-28T02:09:05.924ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
11772025-02-28T02:09:05.925ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11782025-02-28T02:09:05.925ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11792025-02-28T02:09:05.981ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 232, 242]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11802025-02-28T02:09:05.981ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
11812025-02-28T02:09:05.982ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11822025-02-28T02:09:05.982ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11832025-02-28T02:09:06.038ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 172, 12]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11842025-02-28T02:09:06.038ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
11852025-02-28T02:09:06.050ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11862025-02-28T02:09:06.050ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11872025-02-28T02:09:06.053ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11882025-02-28T02:09:06.053ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11892025-02-28T02:09:06.053ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11902025-02-28T02:09:06.053ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11912025-02-28T02:09:06.054ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11922025-02-28T02:09:06.054ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11932025-02-28T02:09:06.054ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11942025-02-28T02:09:06.054ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11952025-02-28T02:09:06.066ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11962025-02-28T02:09:06.068ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11972025-02-28T02:09:06.128ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11982025-02-28T02:09:06.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11992025-02-28T02:09:06.133ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12002025-02-28T02:09:06.137ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12012025-02-28T02:09:06.140ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12022025-02-28T02:09:06.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12032025-02-28T02:09:06.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12042025-02-28T02:09:06.188ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12052025-02-28T02:09:06.286ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925 file = illumos-utils/src/zone.rs:325
12062025-02-28T02:09:06.291ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f file = illumos-utils/src/zone.rs:325
12072025-02-28T02:09:06.298ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43 file = illumos-utils/src/zone.rs:325
12082025-02-28T02:09:06.304ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 file = illumos-utils/src/zone.rs:325
12092025-02-28T02:09:06.310ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_97706d05-7981-4c67-b267-252930b86713 file = illumos-utils/src/zone.rs:325
12102025-02-28T02:09:06.315ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925 file = illumos-utils/src/zone.rs:363
12112025-02-28T02:09:06.322ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f file = illumos-utils/src/zone.rs:363
12122025-02-28T02:09:06.327ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43 file = illumos-utils/src/zone.rs:363
12132025-02-28T02:09:06.334ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 file = illumos-utils/src/zone.rs:363
12142025-02-28T02:09:06.340ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_97706d05-7981-4c67-b267-252930b86713 file = illumos-utils/src/zone.rs:363
12152025-02-28T02:09:21.319ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.913005426s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
12162025-02-28T02:09:21.340ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12172025-02-28T02:09:21.375ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12182025-02-28T02:09:21.419ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
12192025-02-28T02:09:21.639ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
12202025-02-28T02:09:22.117ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1eb9fe66-9cf6-4013-b6ca-4d0325826024'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12212025-02-28T02:09:22.118ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
12222025-02-28T02:09:22.128ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ab77a49f-66d3-44d7-9ad1-49bd9d648ee0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12232025-02-28T02:09:22.128ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b3a87d4a-d86a-4868-ad38-fc879461da99/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f251953a-899c-44a5-913c-3ca9d5fd7a90'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12242025-02-28T02:09:22.128ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1211919d-568b-411d-a799-2cc9843c518d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12252025-02-28T02:09:22.129ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
12262025-02-28T02:09:22.136ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7ae93100-6078-4f36-b916-7ea04312348c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='202ae90a-6d2c-404f-badf-cfe2bb13c3fc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12272025-02-28T02:09:22.137ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_55ae14e7-5a6e-4245-98d6-55cf62789803/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='87b966f1-9c01-4c20-872a-dda24c09e4df'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12282025-02-28T02:09:22.137ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
12292025-02-28T02:09:22.146ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_81fb17c7-22e5-4138-98cb-7b91dded8807/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='107f9dd0-e564-475a-9668-a44fc80ad607'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12302025-02-28T02:09:22.146ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
12312025-02-28T02:09:22.155ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
12322025-02-28T02:09:22.162ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
12332025-02-28T02:09:22.169ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
12342025-02-28T02:09:22.410ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 58.710551ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
12352025-02-28T02:09:22.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 48.182124ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
12362025-02-28T02:09:22.435ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 46.679651ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
12372025-02-28T02:09:22.447ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 69.779159ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
12382025-02-28T02:09:22.458ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 27.304165ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
12392025-02-28T02:09:22.469ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 43.740283ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
12402025-02-28T02:09:22.480ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 54.941603ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
12412025-02-28T02:09:22.480ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12422025-02-28T02:09:22.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 36.665776ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
12432025-02-28T02:09:22.502ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 72.090301ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
12442025-02-28T02:09:22.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 54.941106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
12452025-02-28T02:09:22.525ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 137.75384ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
12462025-02-28T02:09:22.536ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 67.97673ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
12472025-02-28T02:09:22.547ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 115.592647ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
12482025-02-28T02:09:22.561ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 75.177147ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
12492025-02-28T02:09:22.561ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
12502025-02-28T02:09:22.578ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 119.842222ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
12512025-02-28T02:09:22.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 134.312261ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
12522025-02-28T02:09:22.597ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 111.816082ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
12532025-02-28T02:09:22.606ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 84.262059ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
12542025-02-28T02:09:22.616ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 203.741342ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
12552025-02-28T02:09:22.626ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 274.585734ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
12562025-02-28T02:09:22.648ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 168.457054ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
12572025-02-28T02:09:22.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 183.355232ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
12582025-02-28T02:09:22.687ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 126.227664ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
12592025-02-28T02:09:22.703ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 276.234877ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
12602025-02-28T02:09:22.716ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 169.7693ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
12612025-02-28T02:09:22.730ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 244.032502ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
12622025-02-28T02:09:22.744ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 161.021803ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
12632025-02-28T02:09:22.818ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 70.115256ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
12642025-02-28T02:09:22.831ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 466.103095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
12652025-02-28T02:09:22.845ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 518.49073ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
12662025-02-28T02:09:23.078ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 532.231175ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
12672025-02-28T02:09:23.116ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 468.540874ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
12682025-02-28T02:09:23.135ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 485.852347ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
12692025-02-28T02:09:23.152ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 128.471707ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
12702025-02-28T02:09:23.172ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 590.839564ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
12712025-02-28T02:09:23.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 279.099587ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
12722025-02-28T02:09:23.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 438.599643ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
12732025-02-28T02:09:23.215ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 538.361225ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
12742025-02-28T02:09:23.299ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 103.135146ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
12752025-02-28T02:09:23.313ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 517.608666ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
12762025-02-28T02:09:23.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 652.891879ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
12772025-02-28T02:09:23.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 485.126275ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
12782025-02-28T02:09:23.480ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 1.194891469s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
12792025-02-28T02:09:23.600ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 854.376252ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
12802025-02-28T02:09:23.690ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 973.501714ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
12812025-02-28T02:09:23.709ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 759.444453ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
12822025-02-28T02:09:23.734ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 616.224511ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
12832025-02-28T02:09:23.735ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12842025-02-28T02:09:23.736ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
12852025-02-28T02:09:23.746ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='956d109b-b41f-4ee0-9a87-e329623b671d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12862025-02-28T02:09:23.746ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
12872025-02-28T02:09:23.771ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 946.816504ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
12882025-02-28T02:09:23.788ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 618.745581ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
12892025-02-28T02:09:23.847ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 954.121337ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
12902025-02-28T02:09:23.880ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_56271d63-ce52-4a9a-beca-d66806dddbb3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='65b5721f-78a9-4cda-b539-59350d17a96c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12912025-02-28T02:09:23.881ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
12922025-02-28T02:09:23.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 489.010346ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
12932025-02-28T02:09:24.058ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 934.693109ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
12942025-02-28T02:09:24.076ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 54.090307ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
12952025-02-28T02:09:24.097ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 68.902777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
12962025-02-28T02:09:24.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 71.703124ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
12972025-02-28T02:09:24.235ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 51.015189ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
12982025-02-28T02:09:24.274ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 120.703247ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
12992025-02-28T02:09:24.292ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 53.764908ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
13002025-02-28T02:09:24.314ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 262.424247ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
13012025-02-28T02:09:24.363ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 69.515986ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
13022025-02-28T02:09:24.383ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 948.55769ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
13032025-02-28T02:09:24.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 398.155437ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
13042025-02-28T02:09:24.413ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13052025-02-28T02:09:24.432ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 553.264464ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
13062025-02-28T02:09:24.432ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
13072025-02-28T02:09:24.510ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 1.285011533s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
13082025-02-28T02:09:24.578ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 1.310276627s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
13092025-02-28T02:09:24.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 1.373953421s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
13102025-02-28T02:09:24.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 574.652528ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
13112025-02-28T02:09:24.729ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 211.777419ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
13122025-02-28T02:09:24.746ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 962.98683ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
13132025-02-28T02:09:24.763ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.371620497s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
13142025-02-28T02:09:24.782ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 1.073062794s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
13152025-02-28T02:09:24.819ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 1.421154835s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
13162025-02-28T02:09:24.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 686.422501ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
13172025-02-28T02:09:24.854ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 26.025527ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
13182025-02-28T02:09:24.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 66.702831ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
13192025-02-28T02:09:24.892ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='5b2025ef-6347-4939-a58e-a3b260c96fcc'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13202025-02-28T02:09:24.893ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
13212025-02-28T02:09:24.954ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 454.456298ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
13222025-02-28T02:09:24.971ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 281.064008ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
13232025-02-28T02:09:25.003ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 862.559326ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
13242025-02-28T02:09:25.024ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 1.383760336s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
13252025-02-28T02:09:25.185ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_97706d05-7981-4c67-b267-252930b86713: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13262025-02-28T02:09:25.185ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13272025-02-28T02:09:25.185ZINFOSledAgent (ServiceManager): Booting oxz_nexus_97706d05-7981-4c67-b267-252930b86713 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
13282025-02-28T02:09:25.196ZINFOSledAgent (ServiceManager): Booting oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
13292025-02-28T02:09:25.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 37.689188ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
13302025-02-28T02:09:25.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 571.106126ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
13312025-02-28T02:09:25.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 82.609553ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
13322025-02-28T02:09:25.313ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 935.439491ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
13332025-02-28T02:09:25.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 1.249874143s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
13342025-02-28T02:09:25.385ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 180.337758ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
13352025-02-28T02:09:25.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 1.080320979s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
13362025-02-28T02:09:25.496ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 34.619456ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
13372025-02-28T02:09:25.507ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 57.558687ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
13382025-02-28T02:09:25.534ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 1.476777516s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
13392025-02-28T02:09:25.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 122.005365ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
13402025-02-28T02:09:25.577ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 70.645633ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
13412025-02-28T02:09:25.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 303.857828ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
13422025-02-28T02:09:25.716ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 277.356409ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
13432025-02-28T02:09:25.735ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 1.435677656s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
13442025-02-28T02:09:25.749ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 215.730301ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
13452025-02-28T02:09:25.811ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 1.0700577s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
13462025-02-28T02:09:25.858ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 766.211846ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
13472025-02-28T02:09:25.870ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 558.806452ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
13482025-02-28T02:09:25.883ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 1.042030764s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
13492025-02-28T02:09:25.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 880.217732ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
13502025-02-28T02:09:25.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 419.431474ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
13512025-02-28T02:09:25.983ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 580.304479ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
13522025-02-28T02:09:26.011ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 543.10714ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
13532025-02-28T02:09:26.065ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 1.127696315s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
13542025-02-28T02:09:26.147ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.224726232s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
13552025-02-28T02:09:26.253ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 706.688261ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
13562025-02-28T02:09:26.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 1.300014669s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
13572025-02-28T02:09:26.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 709.329661ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
13582025-02-28T02:09:26.359ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13592025-02-28T02:09:26.359ZINFOSledAgent (ServiceManager): Booting oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
13602025-02-28T02:09:26.422ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 679.585833ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
13612025-02-28T02:09:26.441ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 902.859371ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
13622025-02-28T02:09:26.521ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 954.706481ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
13632025-02-28T02:09:26.567ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 609.9336ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
13642025-02-28T02:09:26.577ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 25.508617ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
13652025-02-28T02:09:26.589ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 934.310106ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
13662025-02-28T02:09:26.612ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 1.08713723s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
13672025-02-28T02:09:26.624ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 134.049251ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
13682025-02-28T02:09:26.637ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 962.655009ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
13692025-02-28T02:09:26.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 149.4229ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
13702025-02-28T02:09:26.812ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 1.121034618s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
13712025-02-28T02:09:26.894ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 947.183938ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
13722025-02-28T02:09:26.938ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 1.338818881s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
13732025-02-28T02:09:26.951ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 313.84556ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
13742025-02-28T02:09:26.973ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 774.50952ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
13752025-02-28T02:09:27.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 1.301257101s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
13762025-02-28T02:09:27.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 619.716755ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
13772025-02-28T02:09:27.114ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 830.911169ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
13782025-02-28T02:09:27.186ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 996.892424ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
13792025-02-28T02:09:27.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 530.860245ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
13802025-02-28T02:09:27.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 1.199494782s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
13812025-02-28T02:09:27.281ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 1.092891264s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
13822025-02-28T02:09:27.358ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 514.752002ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
13832025-02-28T02:09:27.384ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.102598683s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
13842025-02-28T02:09:27.489ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 773.0264ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
13852025-02-28T02:09:27.538ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 1.302228219s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
13862025-02-28T02:09:27.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 1.42147706s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
13872025-02-28T02:09:27.615ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 539.552701ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
13882025-02-28T02:09:27.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 1.422978364s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
13892025-02-28T02:09:27.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 900.163476ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
13902025-02-28T02:09:27.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 518.984723ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
13912025-02-28T02:09:27.764ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 1.117534648s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
13922025-02-28T02:09:27.857ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 1.015666191s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
13932025-02-28T02:09:27.889ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 1.14899524s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
13942025-02-28T02:09:27.947ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 689.08223ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
13952025-02-28T02:09:27.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 1.189330245s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
13962025-02-28T02:09:28.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 947.025092ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
13972025-02-28T02:09:28.200ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 1.090879544s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
13982025-02-28T02:09:28.278ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 1.176142347s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
13992025-02-28T02:09:28.293ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 619.774452ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
14002025-02-28T02:09:28.307ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 998.16678ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
14012025-02-28T02:09:28.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 870.545611ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
14022025-02-28T02:09:28.392ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 897.240213ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
14032025-02-28T02:09:28.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 688.480399ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
14042025-02-28T02:09:28.506ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.315229659s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
14052025-02-28T02:09:28.641ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 1.255368981s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
14062025-02-28T02:09:28.657ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 1.085760967s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
14072025-02-28T02:09:28.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 551.099913ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
14082025-02-28T02:09:28.888ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 501.00538ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
14092025-02-28T02:09:28.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 818.925616ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
14102025-02-28T02:09:28.925ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 917.070917ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
14112025-02-28T02:09:29.014ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 976.301242ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
14122025-02-28T02:09:29.050ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 770.308671ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
14132025-02-28T02:09:29.126ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 979.665259ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
14142025-02-28T02:09:29.139ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 1.255536138s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
14152025-02-28T02:09:29.152ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 1.027979976s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
14162025-02-28T02:09:29.163ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 1.245121553s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
14172025-02-28T02:09:29.228ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 669.785069ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
14182025-02-28T02:09:29.303ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 834.109483ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
14192025-02-28T02:09:29.315ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 599.945758ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
14202025-02-28T02:09:29.325ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 1.171164814s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
14212025-02-28T02:09:29.403ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 1.117351067s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
14222025-02-28T02:09:29.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 794.63283ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
14232025-02-28T02:09:29.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 1.424053028s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
14242025-02-28T02:09:29.735ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 744.540594ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
14252025-02-28T02:09:29.755ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 1.238058516s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
14262025-02-28T02:09:29.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 905.93477ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
14272025-02-28T02:09:29.841ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 929.847698ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
14282025-02-28T02:09:29.853ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 1.022574568s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
14292025-02-28T02:09:29.909ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 1.128709941s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
14302025-02-28T02:09:29.919ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 832.916877ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
14312025-02-28T02:09:29.927ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 850.991508ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
14322025-02-28T02:09:30.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 522.041447ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
14332025-02-28T02:09:30.119ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 773.028396ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
14342025-02-28T02:09:30.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 1.285946804s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
14352025-02-28T02:09:30.192ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 1.027305157s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
14362025-02-28T02:09:30.227ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 1.380191827s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
14372025-02-28T02:09:30.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 638.539471ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
14382025-02-28T02:09:30.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 1.03706845s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
14392025-02-28T02:09:30.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 1.233582916s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
14402025-02-28T02:09:30.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 884.291638ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
14412025-02-28T02:09:30.532ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 753.760706ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
14422025-02-28T02:09:30.542ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 1.097024448s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
14432025-02-28T02:09:30.751ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 1.017374493s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
14442025-02-28T02:09:30.765ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 1.396023401s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
14452025-02-28T02:09:30.782ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.309644734s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
14462025-02-28T02:09:30.794ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 707.303511ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
14472025-02-28T02:09:30.889ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 1.337334383s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
14482025-02-28T02:09:30.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 754.927379ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
14492025-02-28T02:09:30.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 648.433519ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
14502025-02-28T02:09:31.005ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 1.233720339s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
14512025-02-28T02:09:31.051ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 1.387982994s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
14522025-02-28T02:09:31.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 702.632372ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
14532025-02-28T02:09:31.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 1.197466921s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
14542025-02-28T02:09:31.298ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 1.039052266s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
14552025-02-28T02:09:31.405ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 1.472205479s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
14562025-02-28T02:09:31.446ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 1.464557305s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
14572025-02-28T02:09:31.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 631.352294ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
14582025-02-28T02:09:31.512ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 1.439642998s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
14592025-02-28T02:09:31.573ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 1.189312938s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
14602025-02-28T02:09:31.618ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 1.233185124s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
14612025-02-28T02:09:31.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 1.24736171s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
14622025-02-28T02:09:31.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 1.110182827s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
14632025-02-28T02:09:31.741ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 1.479339437s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
14642025-02-28T02:09:31.785ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 515.42636ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
14652025-02-28T02:09:31.805ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 1.335671092s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
14662025-02-28T02:09:32.103ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.391011218s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
14672025-02-28T02:09:32.113ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 1.246618124s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
14682025-02-28T02:09:32.172ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 885.054514ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
14692025-02-28T02:09:32.235ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 870.390979ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
14702025-02-28T02:09:32.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 1.001528345s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
14712025-02-28T02:09:32.312ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 1.054221808s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
14722025-02-28T02:09:32.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 1.422747193s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
14732025-02-28T02:09:32.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 684.240675ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
14742025-02-28T02:09:32.448ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 953.218649ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
14752025-02-28T02:09:32.774ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 1.209433193s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
14762025-02-28T02:09:32.789ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 1.349587146s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
14772025-02-28T02:09:32.861ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 621.403331ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
14782025-02-28T02:09:32.888ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 1.127212408s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
14792025-02-28T02:09:32.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 1.391085706s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
14802025-02-28T02:09:32.919ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 1.334110842s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
14812025-02-28T02:09:32.961ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 1.041378326s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
14822025-02-28T02:09:33.065ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 523.094133ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
14832025-02-28T02:09:33.114ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 596.636404ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
14842025-02-28T02:09:33.133ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 1.495120079s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
14852025-02-28T02:09:33.156ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 1.070678934s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
14862025-02-28T02:09:33.229ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 575.813382ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
14872025-02-28T02:09:33.259ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 1.007654224s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
14882025-02-28T02:09:33.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 1.021932118s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
14892025-02-28T02:09:33.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 1.445629171s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
14902025-02-28T02:09:33.410ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 1.248360615s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
14912025-02-28T02:09:33.493ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 1.092615858s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
14922025-02-28T02:09:33.502ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.066954544s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
14932025-02-28T02:09:33.597ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 589.902298ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
14942025-02-28T02:09:33.719ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 1.316034481s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
14952025-02-28T02:09:33.778ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 678.239955ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
14962025-02-28T02:09:33.813ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 734.670166ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
14972025-02-28T02:09:33.992ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 769.812396ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
14982025-02-28T02:09:34.010ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 531.239987ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
14992025-02-28T02:09:34.024ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 847.751529ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
15002025-02-28T02:09:34.160ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 1.447825765s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
15012025-02-28T02:09:34.198ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 857.244565ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
15022025-02-28T02:09:34.238ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 825.881535ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
15032025-02-28T02:09:34.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 1.361617732s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
15042025-02-28T02:09:34.277ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 1.193271995s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
15052025-02-28T02:09:34.309ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 638.353203ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
15062025-02-28T02:09:34.396ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55103
15072025-02-28T02:09:34.475ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15082025-02-28T02:09:34.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 1.021957074s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
15092025-02-28T02:09:34.514ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
15102025-02-28T02:09:34.575ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 1.312989577s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
15112025-02-28T02:09:34.625ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 1.347790592s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
15122025-02-28T02:09:34.674ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 154954 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55103 req_id = 2688e6e0-1d9d-485e-a0f7-06c00bd1f0b2 response_code = 200 uri = /baseboard
15132025-02-28T02:09:34.679ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 1.208690756s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
15142025-02-28T02:09:34.687ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 1.136536049s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
15152025-02-28T02:09:34.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.194342511s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
15162025-02-28T02:09:34.701ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 31.303747ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
15172025-02-28T02:09:34.709ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 745.525272ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
15182025-02-28T02:09:34.716ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 836.61739ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
15192025-02-28T02:09:34.742ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 142.90822ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
15202025-02-28T02:09:34.770ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 589.125105ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
15212025-02-28T02:09:34.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 1.175524131s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
15222025-02-28T02:09:34.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 902.462922ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
15232025-02-28T02:09:34.909ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 275.808704ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
15242025-02-28T02:09:34.958ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 792.474163ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
15252025-02-28T02:09:35.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 539.653492ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
15262025-02-28T02:09:35.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 1.460442481s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
15272025-02-28T02:09:35.072ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 1.253946112s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
15282025-02-28T02:09:35.195ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 336.205886ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
15292025-02-28T02:09:35.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 613.005417ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
15302025-02-28T02:09:35.465ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 655.295851ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
15312025-02-28T02:09:35.478ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 966.430072ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
15322025-02-28T02:09:35.542ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 754.751612ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
15332025-02-28T02:09:35.551ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 832.491092ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
15342025-02-28T02:09:35.561ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 1.346946196s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
15352025-02-28T02:09:35.596ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 1.470045225s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
15362025-02-28T02:09:35.618ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 1.483756015s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
15372025-02-28T02:09:35.636ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 1.437098453s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
15382025-02-28T02:09:35.760ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 585.952516ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
15392025-02-28T02:09:35.796ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 580.010719ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
15402025-02-28T02:09:35.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 1.281981065s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
15412025-02-28T02:09:35.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 886.914309ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
15422025-02-28T02:09:35.910ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 1.006319039s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
15432025-02-28T02:09:35.919ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 930.199798ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
15442025-02-28T02:09:35.987ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 1.277363221s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
15452025-02-28T02:09:36.000ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 1.17587686s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
15462025-02-28T02:09:36.021ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 753.708189ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
15472025-02-28T02:09:36.132ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 977.16142ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
15482025-02-28T02:09:36.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.357118968s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
15492025-02-28T02:09:36.336ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 1.24076786s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
15502025-02-28T02:09:36.356ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 569.996432ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
15512025-02-28T02:09:36.385ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 801.978726ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
15522025-02-28T02:09:36.393ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 1.386320886s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
15532025-02-28T02:09:36.455ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 595.989533ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
15542025-02-28T02:09:36.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 517.063508ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
15552025-02-28T02:09:36.785ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 1.069964981s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
15562025-02-28T02:09:36.796ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 1.209567737s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
15572025-02-28T02:09:36.860ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.04962066s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
15582025-02-28T02:09:36.919ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 620.354365ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
15592025-02-28T02:09:36.926ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 1.199390327s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
15602025-02-28T02:09:36.935ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 1.020257014s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
15612025-02-28T02:09:37.060ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 997.512436ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
15622025-02-28T02:09:37.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 1.333762805s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
15632025-02-28T02:09:37.077ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 747.627963ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
15642025-02-28T02:09:37.085ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 864.052091ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
15652025-02-28T02:09:37.111ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 887.042801ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
15662025-02-28T02:09:37.119ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 528.187112ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
15672025-02-28T02:09:37.127ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 537.484886ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
15682025-02-28T02:09:37.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 1.193539222s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
15692025-02-28T02:09:37.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 1.439156515s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
15702025-02-28T02:09:37.274ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 1.30505427s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
15712025-02-28T02:09:37.548ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 696.777539ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
15722025-02-28T02:09:37.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 1.126659281s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
15732025-02-28T02:09:37.658ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 1.005361685s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
15742025-02-28T02:09:37.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 896.083538ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
15752025-02-28T02:09:37.682ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.339645725s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
15762025-02-28T02:09:37.787ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 781.839989ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
15772025-02-28T02:09:37.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 1.194968138s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
15782025-02-28T02:09:37.864ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 766.616632ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
15792025-02-28T02:09:37.918ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.197196431s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
15802025-02-28T02:09:37.958ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 1.257486644s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
15812025-02-28T02:09:37.965ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 518.388247ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
15822025-02-28T02:09:38.007ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 740.416388ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
15832025-02-28T02:09:38.015ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe") failed: Property not found. retry in 1.105721922s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
15842025-02-28T02:09:38.066ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 837.261186ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
15852025-02-28T02:09:38.136ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 901.477835ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
15862025-02-28T02:09:38.255ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 639.018941ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
15872025-02-28T02:09:38.389ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 795.879516ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
15882025-02-28T02:09:38.412ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c") failed: Property not found. retry in 1.455889915s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
15892025-02-28T02:09:38.492ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 846.634449ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
15902025-02-28T02:09:38.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 1.079876083s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
15912025-02-28T02:09:38.588ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 1.279572993s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
15922025-02-28T02:09:38.595ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31") failed: Property not found. retry in 523.971674ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
15932025-02-28T02:09:38.640ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 736.426134ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
15942025-02-28T02:09:38.648ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 802.566228ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
15952025-02-28T02:09:38.672ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 764.567564ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
15962025-02-28T02:09:38.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 591.498933ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
15972025-02-28T02:09:38.756ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925") failed: Property not found. retry in 1.058999235s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
15982025-02-28T02:09:38.903ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b") failed: Property not found. retry in 1.024218466s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
15992025-02-28T02:09:38.912ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 1.237437054s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
16002025-02-28T02:09:39.030ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.011165483s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16012025-02-28T02:09:39.040ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 996.447965ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
16022025-02-28T02:09:39.048ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2") failed: Property not found. retry in 1.285902036s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
16032025-02-28T02:09:39.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.122544934s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
16042025-02-28T02:09:39.195ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 546.210953ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
16052025-02-28T02:09:39.228ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 607.007823ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
16062025-02-28T02:09:39.323ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1") failed: Property not found. retry in 1.398575687s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
16072025-02-28T02:09:39.348ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 671.421229ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
16082025-02-28T02:09:39.386ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 1.189823299s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
16092025-02-28T02:09:39.445ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 1.029616708s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
16102025-02-28T02:09:39.459ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 943.881547ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
16112025-02-28T02:09:39.668ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff") failed: Property not found. retry in 562.450087ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
16122025-02-28T02:09:39.703ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.121367049s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
16132025-02-28T02:09:39.751ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 743.188631ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
16142025-02-28T02:09:39.845ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 829.931736ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
16152025-02-28T02:09:39.896ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 527.031971ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
16162025-02-28T02:09:40.030ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 1.395135139s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
16172025-02-28T02:09:40.045ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 860.862637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
16182025-02-28T02:09:40.053ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.457860818s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16192025-02-28T02:09:40.159ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 907.364807ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
16202025-02-28T02:09:40.256ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc") failed: Property not found. retry in 1.366541756s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
16212025-02-28T02:09:40.525ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 1.421194105s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
16222025-02-28T02:09:40.534ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 906.280646ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
16232025-02-28T02:09:40.543ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 671.152049ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
16242025-02-28T02:09:40.552ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 1.03988439s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
16252025-02-28T02:09:40.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 808.6682ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
16262025-02-28T02:09:40.685ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 1.315226521s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
16272025-02-28T02:09:40.916ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66") failed: Property not found. retry in 716.336481ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
16282025-02-28T02:09:41.076ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58") failed: Property not found. retry in 1.072057324s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
16292025-02-28T02:09:41.226ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 601.053527ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
16302025-02-28T02:09:41.405ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08") failed: Property not found. retry in 987.002338ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
16312025-02-28T02:09:41.434ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77") failed: Property not found. retry in 1.336135163s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
16322025-02-28T02:09:41.452ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc") failed: Property not found. retry in 709.48868ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
16332025-02-28T02:09:41.523ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.399897365s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16342025-02-28T02:09:41.604ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f") failed: Property not found. retry in 1.291118774s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
16352025-02-28T02:09:41.837ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337") failed: Property not found. retry in 881.562832ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
16362025-02-28T02:09:41.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_97706d05-7981-4c67-b267-252930b86713") failed: Property not found. retry in 722.848803ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
16372025-02-28T02:09:42.010ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 674.343998ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
16382025-02-28T02:09:42.759ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 619.929174ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
16392025-02-28T02:09:42.934ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.185340193s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16402025-02-28T02:09:43.394ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43") failed: Property not found. retry in 1.066820775s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
16412025-02-28T02:09:44.130ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 991.513228ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16422025-02-28T02:09:45.131ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.181661962s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16432025-02-28T02:09:46.323ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.461406269s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16442025-02-28T02:09:47.794ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 763.504475ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16452025-02-28T02:09:48.568ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.19966578s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16462025-02-28T02:09:49.779ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.041489505s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16472025-02-28T02:09:50.830ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05") failed: Property not found. retry in 1.426149651s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16482025-02-28T02:09:52.299ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_clickhouse_f31db580-dafe-416a-ac51-7d13b61f9a05
16492025-02-28T02:09:52.299ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_93cc49c1-2861-4962-9f80-1961b297cd43
16502025-02-28T02:09:52.299ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08
16512025-02-28T02:09:52.299ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_6613589b-925e-4835-b5cf-2a2555718d58
16522025-02-28T02:09:52.299ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_c00d3169-f051-4b19-9715-b55bd4d1f3fe
16532025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_b56d6db0-d375-49ea-9267-3902aed8f62c
16542025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_97706d05-7981-4c67-b267-252930b86713
16552025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_b7146ab8-7a92-41df-9542-18ca1cec5d31
16562025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_ee8c250b-0920-4b81-9ee2-e6a75db4c4ff
16572025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_b8fab31d-c1c3-47ef-8445-d320ff18b925
16582025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_2f320024-5723-4442-8cc9-a9c2e9484e66
16592025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_4d50ae5c-d41d-4e25-94c8-47f2b20e37f1
16602025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_bca7f7fb-f45f-4f59-99b6-dfd8b8ecde77
16612025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_oximeter_5b2025ef-6347-4939-a58e-a3b260c96fcc
16622025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_0041d0fd-64b2-4ca0-ab37-e70021644a2b
16632025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_7ea3968f-03b8-449a-bba9-ad00377b2337
16642025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_4a50844d-66ba-4289-8aaa-4158bf2e15c2
16652025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_95cefe9d-6cfa-4abd-8c4f-beef4564758f
16662025-02-28T02:09:52.300ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_4393b6ee-0a72-4709-8bea-32dfcb462ccc
16672025-02-28T02:09:52.347ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16682025-02-28T02:09:52.349ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16692025-02-28T02:09:52.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 47982037 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39939 req_id = 2d9ae870-d527-4514-bf74-71160b9d0c0f response_code = 204 uri = /omicron-zones
16702025-02-28T02:09:52.383ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1401
16712025-02-28T02:09:52.573ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16722025-02-28T02:09:52.586ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
16732025-02-28T02:09:52.629ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1003
16742025-02-28T02:09:53.023ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.999938124s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
16752025-02-28T02:09:53.023ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16762025-02-28T02:09:53.094ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16772025-02-28T02:09:53.207ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16782025-02-28T02:09:53.281ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16792025-02-28T02:09:53.528ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16802025-02-28T02:09:53.653ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16812025-02-28T02:09:53.856ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16822025-02-28T02:09:54.158ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16832025-02-28T02:09:54.521ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16842025-02-28T02:09:54.769ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16852025-02-28T02:09:55.537ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16862025-02-28T02:09:56.348ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a506621-9899-4a6c-993a-749bd0361232/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
16872025-02-28T02:09:57.871ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f409ff75-281a-4647-a4c9-861e5ddd3728", "content-length": "173", "date": "Fri, 28 Feb 2025 02:09:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"4a506621-9899-4a6c-993a-749bd0361232\"", request_id: "f409ff75-281a-4647-a4c9-861e5ddd3728" } file = sled-agent/src/rack_setup/service.rs:1065
16882025-02-28T02:09:58.512ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a3dc8b3b-8cc1-47ec-ad54-26f8fdc8a8b9", "content-length": "173", "date": "Fri, 28 Feb 2025 02:09:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"4a506621-9899-4a6c-993a-749bd0361232\"", request_id: "a3dc8b3b-8cc1-47ec-ad54-26f8fdc8a8b9" } file = sled-agent/src/rack_setup/service.rs:1065
16892025-02-28T02:09:59.093ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "80676ae0-6de3-4e04-a4a9-dc67a82e23c5", "content-length": "173", "date": "Fri, 28 Feb 2025 02:09:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"4a506621-9899-4a6c-993a-749bd0361232\"", request_id: "80676ae0-6de3-4e04-a4a9-dc67a82e23c5" } file = sled-agent/src/rack_setup/service.rs:1065
16902025-02-28T02:10:00.966ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2d8e36b2-9451-47fc-a5b7-f02d3ffa1e1c", "content-length": "173", "date": "Fri, 28 Feb 2025 02:10:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f5279127-f12d-4326-a7e5-d07a518dbb01\"", request_id: "2d8e36b2-9451-47fc-a5b7-f02d3ffa1e1c" } file = sled-agent/src/rack_setup/service.rs:1065
16912025-02-28T02:10:03.240ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7c68c5b4-7036-448c-8ea6-c6bc7bfa7123", "content-length": "173", "date": "Fri, 28 Feb 2025 02:10:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f5279127-f12d-4326-a7e5-d07a518dbb01\"", request_id: "7c68c5b4-7036-448c-8ea6-c6bc7bfa7123" } file = sled-agent/src/rack_setup/service.rs:1065
16922025-02-28T02:10:04.714ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36622
16932025-02-28T02:10:04.714ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36622 req_id = ebfbd4ce-d498-452d-94ef-408a39780cd5 response_code = 200 uri = /baseboard
16942025-02-28T02:10:05.420ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d69f6338-95cb-4703-83be-fb3fe25447c2", "content-length": "173", "date": "Fri, 28 Feb 2025 02:10:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f5279127-f12d-4326-a7e5-d07a518dbb01\"", request_id: "d69f6338-95cb-4703-83be-fb3fe25447c2" } file = sled-agent/src/rack_setup/service.rs:1065
16952025-02-28T02:10:07.168ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1065541c-50e9-43c9-84a6-5c75c157f471", "content-length": "173", "date": "Fri, 28 Feb 2025 02:10:07 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f5279127-f12d-4326-a7e5-d07a518dbb01\"", request_id: "1065541c-50e9-43c9-84a6-5c75c157f471" } file = sled-agent/src/rack_setup/service.rs:1065
16962025-02-28T02:10:10.179ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a931e1d4-8114-4a56-9840-6b234b0620b1", "content-length": "173", "date": "Fri, 28 Feb 2025 02:10:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"f5279127-f12d-4326-a7e5-d07a518dbb01\"", request_id: "a931e1d4-8114-4a56-9840-6b234b0620b1" } file = sled-agent/src/rack_setup/service.rs:1065
16972025-02-28T02:10:13.140ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
16982025-02-28T02:10:13.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58522
16992025-02-28T02:10:13.235ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17002025-02-28T02:10:13.235ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17012025-02-28T02:10:13.235ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-zones.json file = common/src/ledger.rs:177
17022025-02-28T02:10:13.238ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-zones.json file = common/src/ledger.rs:177
17032025-02-28T02:10:13.250ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17042025-02-28T02:10:13.250ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3a87d4a-d86a-4868-ad38-fc879461da99
17052025-02-28T02:10:13.275ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17062025-02-28T02:10:13.275ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e
17072025-02-28T02:10:13.295ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17082025-02-28T02:10:13.295ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2
17092025-02-28T02:10:13.317ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17102025-02-28T02:10:13.317ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7ae93100-6078-4f36-b916-7ea04312348c
17112025-02-28T02:10:13.338ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17122025-02-28T02:10:13.338ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a
17132025-02-28T02:10:13.358ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17142025-02-28T02:10:13.358ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_56271d63-ce52-4a9a-beca-d66806dddbb3
17152025-02-28T02:10:13.380ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17162025-02-28T02:10:13.380ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_55ae14e7-5a6e-4245-98d6-55cf62789803
17172025-02-28T02:10:13.400ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17182025-02-28T02:10:13.400ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81fb17c7-22e5-4138-98cb-7b91dded8807
17192025-02-28T02:10:13.420ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17202025-02-28T02:10:13.420ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf
17212025-02-28T02:10:13.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 199254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58522 req_id = 3a69daf8-e871-4587-911d-de027e205b89 response_code = 200 uri = /inventory
17222025-02-28T02:10:15.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61539
17232025-02-28T02:10:15.805ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17242025-02-28T02:10:15.805ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17252025-02-28T02:10:15.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17262025-02-28T02:10:15.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17272025-02-28T02:10:15.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17282025-02-28T02:10:15.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17292025-02-28T02:10:15.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17302025-02-28T02:10:15.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8633 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61539 req_id = 63bc41f4-5aed-467d-a695-d7ecd4d18ebd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17312025-02-28T02:10:15.808ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1075
17322025-02-28T02:10:15.813ZINFOSledAgent (RSS): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17332025-02-28T02:10:15.813ZINFOSledAgent (RSS): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17342025-02-28T02:10:16.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37329
17352025-02-28T02:10:16.002ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17362025-02-28T02:10:16.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17372025-02-28T02:10:16.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17382025-02-28T02:10:16.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17392025-02-28T02:10:16.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17402025-02-28T02:10:16.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17412025-02-28T02:10:16.002ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17422025-02-28T02:10:16.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37329 req_id = 1e14f842-abeb-4ea9-9a10-6c15e28e3cba response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17432025-02-28T02:10:16.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44740
17442025-02-28T02:10:16.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17452025-02-28T02:10:16.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17462025-02-28T02:10:16.100ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-zones.json file = common/src/ledger.rs:177
17472025-02-28T02:10:16.100ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-zones.json file = common/src/ledger.rs:177
17482025-02-28T02:10:16.112ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17492025-02-28T02:10:16.112ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3a87d4a-d86a-4868-ad38-fc879461da99
17502025-02-28T02:10:16.134ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17512025-02-28T02:10:16.134ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e
17522025-02-28T02:10:16.153ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17532025-02-28T02:10:16.153ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2
17542025-02-28T02:10:16.175ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17552025-02-28T02:10:16.175ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7ae93100-6078-4f36-b916-7ea04312348c
17562025-02-28T02:10:16.194ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17572025-02-28T02:10:16.194ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a
17582025-02-28T02:10:16.214ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17592025-02-28T02:10:16.214ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_56271d63-ce52-4a9a-beca-d66806dddbb3
17602025-02-28T02:10:16.236ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17612025-02-28T02:10:16.236ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_55ae14e7-5a6e-4245-98d6-55cf62789803
17622025-02-28T02:10:16.255ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17632025-02-28T02:10:16.255ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81fb17c7-22e5-4138-98cb-7b91dded8807
17642025-02-28T02:10:16.274ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17652025-02-28T02:10:16.274ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf
17662025-02-28T02:10:16.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 185336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44740 req_id = df7525b5-5b7e-4f3a-9902-4e983152c8f0 response_code = 200 uri = /inventory
17672025-02-28T02:10:17.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52922
17682025-02-28T02:10:17.695ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17692025-02-28T02:10:17.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17702025-02-28T02:10:17.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17712025-02-28T02:10:17.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17722025-02-28T02:10:17.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17732025-02-28T02:10:17.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17742025-02-28T02:10:17.695ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17752025-02-28T02:10:17.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52922 req_id = eb515362-c1c5-4998-973c-8eabe4fe41de response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17762025-02-28T02:10:17.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54727
17772025-02-28T02:10:17.764ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17782025-02-28T02:10:17.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17792025-02-28T02:10:17.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17802025-02-28T02:10:17.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17812025-02-28T02:10:17.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17822025-02-28T02:10:17.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17832025-02-28T02:10:17.764ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17842025-02-28T02:10:17.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54727 req_id = 87e80ed3-215a-49d8-833d-822f970eb327 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17852025-02-28T02:10:24.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62236
17862025-02-28T02:10:24.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62236 req_id = 119912bf-54b8-4219-af39-28d844905d32 response_code = 200 uri = /vpc-routes
17872025-02-28T02:10:24.767ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
17882025-02-28T02:10:24.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 616 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62236 req_id = 993a85ef-131f-461d-b7dc-2630965659ef response_code = 204 uri = /eip-gateways
17892025-02-28T02:10:24.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2778 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62236 req_id = 07acaeff-201d-407c-ae23-3ba239e993c5 response_code = 204 uri = /vpc-routes
17902025-02-28T02:10:29.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34412
17912025-02-28T02:10:29.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54249
17922025-02-28T02:10:29.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54249 req_id = 3b8b68c1-1105-4f6a-b2cf-fdff4c7511a8 response_code = 200 uri = /vpc-routes
17932025-02-28T02:10:29.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34412 req_id = 5c26ebab-ead2-4c9e-81a5-60ec96c3283f response_code = 200 uri = /vpc-routes
17942025-02-28T02:10:29.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48937
17952025-02-28T02:10:29.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 658 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48937 req_id = 2de728e8-5484-453d-b6cb-004907e9d11f response_code = 200 uri = /v2p
17962025-02-28T02:10:29.591ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
17972025-02-28T02:10:29.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54249 req_id = b5898bbc-b485-456d-b1d6-58fd22871e9d response_code = 204 uri = /eip-gateways
17982025-02-28T02:10:29.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54249 req_id = 1f337115-535d-46c0-bb67-ca064dbb6800 response_code = 204 uri = /vpc-routes
17992025-02-28T02:10:29.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52221
18002025-02-28T02:10:29.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52221 req_id = 4da695a4-e966-4907-b15b-23cffb77ee99 response_code = 200 uri = /v2p
18012025-02-28T02:10:29.645ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
18022025-02-28T02:10:29.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34412 req_id = 8bc5342e-ebdb-4e99-8419-46a3a4b69985 response_code = 204 uri = /eip-gateways
18032025-02-28T02:10:29.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34412 req_id = b3c5f2f5-ed0b-4f3a-9461-c8cded977e0f response_code = 204 uri = /vpc-routes
18042025-02-28T02:10:29.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37263
18052025-02-28T02:10:29.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37263 req_id = a8926af3-ca88-41f6-a261-6e878577bae1 response_code = 200 uri = /vpc-routes
18062025-02-28T02:10:29.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33954
18072025-02-28T02:10:29.795ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18082025-02-28T02:10:29.896ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18092025-02-28T02:10:29.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 175681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33954 req_id = 3ee1f896-6e80-4878-be04-3007bea6aaf7 response_code = 204 uri = /switch-ports
18102025-02-28T02:10:29.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50968
18112025-02-28T02:10:29.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65212
18122025-02-28T02:10:29.969ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
18132025-02-28T02:10:29.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37263 req_id = 3bc03ebd-7eab-45e7-821b-de1a71446d2c response_code = 204 uri = /eip-gateways
18142025-02-28T02:10:29.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65212 req_id = 5021280c-8097-4bc2-9143-ef5c3ca40f5b response_code = 200 uri = /v2p
18152025-02-28T02:10:29.970ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18162025-02-28T02:10:29.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7933 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33954 req_id = 51adb7a8-dfa7-4338-ab68-c2d55be1e777 response_code = 200 uri = /network-bootstore-config
18172025-02-28T02:10:29.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37263 req_id = 292c85e6-3ae5-4a37-971e-78633e51a30a response_code = 204 uri = /vpc-routes
18182025-02-28T02:10:30.020ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18192025-02-28T02:10:30.026ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
18202025-02-28T02:10:30.026ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18212025-02-28T02:10:30.029ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18222025-02-28T02:10:30.029ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
18232025-02-28T02:10:30.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5819 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33954 req_id = d78458d9-a306-445f-a131-f7d5006746e9 response_code = 204 uri = /network-bootstore-config
18242025-02-28T02:10:30.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34189
18252025-02-28T02:10:30.086ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18262025-02-28T02:10:30.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 115528 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50968 req_id = 966de066-7ce2-4814-ab1c-a0f61ab567f1 response_code = 204 uri = /switch-ports
18272025-02-28T02:10:30.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 606 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50968 req_id = 85710775-5b08-4ea6-afaa-351f8551b004 response_code = 200 uri = /network-bootstore-config
18282025-02-28T02:10:30.119ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18292025-02-28T02:10:30.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 136613 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34189 req_id = 680d3340-c2a7-412f-bafd-8bf84689f799 response_code = 204 uri = /switch-ports
18302025-02-28T02:10:30.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34189 req_id = 694124b6-d242-4e7f-a29d-8cc24fb9a861 response_code = 200 uri = /network-bootstore-config
18312025-02-28T02:10:34.750ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47804
18322025-02-28T02:10:34.750ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47804 req_id = 9fef078c-e78f-4f95-a068-cb76db8d783c response_code = 200 uri = /baseboard
18332025-02-28T02:10:41.071ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:52187 remote_addr = [fd00:1122:3344:101::d]:44981 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
18342025-02-28T02:10:41.101ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 28948 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = ac96bb20-bfcb-4349-a5a2-f4d065a6774e response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
18352025-02-28T02:10:59.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43757
18362025-02-28T02:10:59.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43757 req_id = 09ad32f7-33e3-4e47-9f45-6e62e25b7bf8 response_code = 200 uri = /vpc-routes
18372025-02-28T02:10:59.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43630
18382025-02-28T02:10:59.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43630 req_id = 48943a93-da10-48f2-b565-260b0cd7da13 response_code = 200 uri = /vpc-routes
18392025-02-28T02:10:59.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55798
18402025-02-28T02:10:59.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55798 req_id = 30c1a873-5e14-4595-8cf0-a60ea4578130 response_code = 200 uri = /v2p
18412025-02-28T02:10:59.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
18422025-02-28T02:10:59.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43757 req_id = 00fd0df5-61f7-4f97-b763-2b9fe42a3dd6 response_code = 204 uri = /eip-gateways
18432025-02-28T02:10:59.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40224
18442025-02-28T02:10:59.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40224 req_id = a12181d4-1953-4c9c-86c2-432547fccd90 response_code = 200 uri = /vpc-routes
18452025-02-28T02:10:59.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43757 req_id = 1c2ff9d6-6c66-4007-9aca-957582602c2d response_code = 204 uri = /vpc-routes
18462025-02-28T02:10:59.817ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
18472025-02-28T02:10:59.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43630 req_id = 0bc7dbb3-b7ab-4566-882a-5b9956b2d98c response_code = 204 uri = /eip-gateways
18482025-02-28T02:10:59.817ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
18492025-02-28T02:10:59.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40224 req_id = e4232e45-966d-4873-bd0e-8377e72ad0d7 response_code = 204 uri = /eip-gateways
18502025-02-28T02:10:59.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43630 req_id = ba68cb43-a477-4456-9261-3641be5e1449 response_code = 204 uri = /vpc-routes
18512025-02-28T02:10:59.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57587
18522025-02-28T02:10:59.830ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18532025-02-28T02:10:59.874ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18542025-02-28T02:10:59.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 106617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57587 req_id = 8a7c4f8e-db46-42e1-af72-a46aedafc1c2 response_code = 204 uri = /switch-ports
18552025-02-28T02:10:59.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54090
18562025-02-28T02:10:59.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58811
18572025-02-28T02:10:59.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52295
18582025-02-28T02:10:59.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57587 req_id = efe71495-6425-4658-b4f6-4ff7b8fcde51 response_code = 200 uri = /network-bootstore-config
18592025-02-28T02:10:59.937ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18602025-02-28T02:10:59.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54090 req_id = c296e2ec-5338-4a4a-abb2-c5b185a2ca92 response_code = 200 uri = /v2p
18612025-02-28T02:10:59.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52295 req_id = 288ed444-1a58-4077-b2f0-3e43fca06b35 response_code = 200 uri = /v2p
18622025-02-28T02:10:59.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 862 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40224 req_id = 460825aa-e432-4d97-8d04-868c4a14426b response_code = 204 uri = /vpc-routes
18632025-02-28T02:10:59.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55147
18642025-02-28T02:10:59.979ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18652025-02-28T02:11:00.037ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18662025-02-28T02:11:00.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 99842 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58811 req_id = 5ebf49e7-5334-4982-b18c-da5038b00ad0 response_code = 204 uri = /switch-ports
18672025-02-28T02:11:00.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58811 req_id = bd41a482-0df1-49c8-a0bc-a24a57f27065 response_code = 200 uri = /network-bootstore-config
18682025-02-28T02:11:00.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18692025-02-28T02:11:00.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 161430 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55147 req_id = 60af22da-0ab7-4f07-aefb-8a776903baba response_code = 204 uri = /switch-ports
18702025-02-28T02:11:00.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55147 req_id = a1f71af6-8cf0-4ff0-acb0-5f41ac032d13 response_code = 200 uri = /network-bootstore-config
18712025-02-28T02:11:04.794ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41131
18722025-02-28T02:11:04.794ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41131 req_id = 8e51648b-4942-455e-bd30-5d9a81bc0d26 response_code = 200 uri = /baseboard
18732025-02-28T02:11:11.077ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5977 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 1bcf06fe-28b4-4793-ac67-7fa3356c7e0d response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
18742025-02-28T02:11:29.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60013
18752025-02-28T02:11:29.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60013 req_id = 7dfc67c5-aba2-499f-b946-ff0401f124d3 response_code = 200 uri = /vpc-routes
18762025-02-28T02:11:29.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49668
18772025-02-28T02:11:29.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49668 req_id = 29f79af3-e3af-4731-9ed8-c1f376875da1 response_code = 200 uri = /vpc-routes
18782025-02-28T02:11:29.694ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
18792025-02-28T02:11:29.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49668 req_id = 8a230ed7-61e2-436b-8f20-23ed13210923 response_code = 204 uri = /eip-gateways
18802025-02-28T02:11:29.694ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
18812025-02-28T02:11:29.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 19 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60013 req_id = cbb27719-88ca-4183-8373-6cb5c12f141a response_code = 204 uri = /eip-gateways
18822025-02-28T02:11:29.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40789
18832025-02-28T02:11:29.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40789 req_id = c446abc2-4393-474c-921f-042e09d9cb79 response_code = 200 uri = /vpc-routes
18842025-02-28T02:11:29.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44468
18852025-02-28T02:11:29.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44468 req_id = 8760d10a-9561-44cb-b70e-16bf9fb4b191 response_code = 200 uri = /v2p
18862025-02-28T02:11:29.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52301
18872025-02-28T02:11:29.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52301 req_id = c2fd8b15-28bf-426d-9de3-312af697e9d7 response_code = 200 uri = /v2p
18882025-02-28T02:11:29.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
18892025-02-28T02:11:29.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40789 req_id = 7a34b392-56e0-4d53-be3f-16e50a8d7436 response_code = 204 uri = /eip-gateways
18902025-02-28T02:11:29.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63851
18912025-02-28T02:11:29.772ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18922025-02-28T02:11:29.817ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18932025-02-28T02:11:29.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 104445 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63851 req_id = f4886160-a952-427c-a434-1ab14c7cbb39 response_code = 204 uri = /switch-ports
18942025-02-28T02:11:29.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43653
18952025-02-28T02:11:29.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41225
18962025-02-28T02:11:29.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44420
18972025-02-28T02:11:29.878ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18982025-02-28T02:11:29.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 482 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63851 req_id = 564c72a3-9f96-409e-98ad-467258d3d5dc response_code = 200 uri = /network-bootstore-config
18992025-02-28T02:11:29.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49668 req_id = ed3e6c0c-4891-46fc-aaca-2f0c3795101f response_code = 204 uri = /vpc-routes
19002025-02-28T02:11:29.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5487 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60013 req_id = 0392293b-8ff2-45d1-8420-e8360633bade response_code = 204 uri = /vpc-routes
19012025-02-28T02:11:29.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5424 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41225 req_id = bf4ea205-6fb6-40b0-9306-a5706a17022e response_code = 200 uri = /v2p
19022025-02-28T02:11:29.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1445 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40789 req_id = b9e8cc62-824f-474e-83ca-9d5c2ec9e8c9 response_code = 204 uri = /vpc-routes
19032025-02-28T02:11:29.916ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19042025-02-28T02:11:29.969ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19052025-02-28T02:11:29.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 95469 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43653 req_id = 81ee6d55-b71a-418a-81e5-d04c964f78c5 response_code = 204 uri = /switch-ports
19062025-02-28T02:11:29.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43653 req_id = d46767a1-f67d-4b65-96e8-fcaeaf2add80 response_code = 200 uri = /network-bootstore-config
19072025-02-28T02:11:30.005ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19082025-02-28T02:11:30.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 186754 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44420 req_id = 4ceeffac-575c-45c9-a454-c74ada07702e response_code = 204 uri = /switch-ports
19092025-02-28T02:11:30.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44420 req_id = 20719443-5d54-4170-8596-27fcdcb04713 response_code = 200 uri = /network-bootstore-config
19102025-02-28T02:11:34.830ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49616
19112025-02-28T02:11:34.830ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49616 req_id = d6698bc8-6378-40b9-a7cf-6e1b80965cb3 response_code = 200 uri = /baseboard
19122025-02-28T02:11:41.077ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6093 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 2540f79e-4091-4992-819e-2bce7cd41ba7 response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
19132025-02-28T02:11:59.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39145
19142025-02-28T02:11:59.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39145 req_id = 6a9cd088-558f-4e30-9429-e340992e343d response_code = 200 uri = /vpc-routes
19152025-02-28T02:11:59.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37784
19162025-02-28T02:11:59.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37784 req_id = 4e5bd754-b56f-48f1-a3ee-1ad9f65189b6 response_code = 200 uri = /vpc-routes
19172025-02-28T02:11:59.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37078
19182025-02-28T02:11:59.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37078 req_id = d6ae5d00-6153-4d6c-9602-9dccfc676c24 response_code = 200 uri = /vpc-routes
19192025-02-28T02:11:59.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
19202025-02-28T02:11:59.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39145 req_id = 6c88b0a1-c8d3-48e8-b3e0-dfcab46a3170 response_code = 204 uri = /eip-gateways
19212025-02-28T02:11:59.839ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
19222025-02-28T02:11:59.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37078 req_id = f07b8f82-c9c0-4e7f-87d1-295ea404cdad response_code = 204 uri = /eip-gateways
19232025-02-28T02:11:59.855ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
19242025-02-28T02:11:59.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37784 req_id = 2f1da961-3df5-4773-9666-def0bfe0c84e response_code = 204 uri = /eip-gateways
19252025-02-28T02:11:59.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56290
19262025-02-28T02:11:59.897ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19272025-02-28T02:11:59.936ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19282025-02-28T02:11:59.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 92004 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56290 req_id = e456b213-97e4-4e4e-a658-dfd7217e129e response_code = 204 uri = /switch-ports
19292025-02-28T02:11:59.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49868
19302025-02-28T02:11:59.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54998
19312025-02-28T02:11:59.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61817
19322025-02-28T02:11:59.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56290 req_id = 36bf52c9-aae6-4ae5-b538-46cb9080b0fa response_code = 200 uri = /network-bootstore-config
19332025-02-28T02:11:59.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61817 req_id = 060e06c9-5830-4af2-8746-87b27c3c5fc4 response_code = 200 uri = /v2p
19342025-02-28T02:11:59.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 539 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37784 req_id = a5c9383e-53e1-4ea6-b5ae-3f39ee3cad31 response_code = 204 uri = /vpc-routes
19352025-02-28T02:11:59.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54998 req_id = 305be555-06b8-4329-9a42-7f738ba02837 response_code = 200 uri = /v2p
19362025-02-28T02:11:59.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49868 req_id = 245d2df3-a887-4f4c-9c04-aa797825b0ae response_code = 200 uri = /v2p
19372025-02-28T02:11:59.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 744 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39145 req_id = 0bd25d5f-98dc-4bf6-94c5-64c289283859 response_code = 204 uri = /vpc-routes
19382025-02-28T02:12:00.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38236
19392025-02-28T02:12:00.027ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19402025-02-28T02:12:00.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19412025-02-28T02:12:00.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 92846 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38236 req_id = d0a710a7-d2d3-4129-9d25-9f9105728670 response_code = 204 uri = /switch-ports
19422025-02-28T02:12:00.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60519
19432025-02-28T02:12:00.121ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19442025-02-28T02:12:00.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38236 req_id = a6c403a3-a032-4519-8ac1-da851d5a3e19 response_code = 200 uri = /network-bootstore-config
19452025-02-28T02:12:00.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4095 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37078 req_id = a1971138-ddaf-493b-a53b-8adc2b2fa67d response_code = 204 uri = /vpc-routes
19462025-02-28T02:12:00.156ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19472025-02-28T02:12:00.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 90096 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60519 req_id = 3a966898-332a-4716-9db6-1dc071d659b6 response_code = 204 uri = /switch-ports
19482025-02-28T02:12:00.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60519 req_id = ecbe8530-f324-4885-8f79-a39654916fa8 response_code = 200 uri = /network-bootstore-config
19492025-02-28T02:12:04.865ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40310
19502025-02-28T02:12:04.865ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40310 req_id = d1b67dfe-1d22-464f-ad12-31fa17b81751 response_code = 200 uri = /baseboard
19512025-02-28T02:12:11.080ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8196 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = f33ff17b-00ef-48d3-a629-1d39a3b62aed response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
19522025-02-28T02:12:29.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55165
19532025-02-28T02:12:29.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55165 req_id = c232bf0c-bf31-4ef6-9ebd-40ade3d3670b response_code = 200 uri = /vpc-routes
19542025-02-28T02:12:29.640ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
19552025-02-28T02:12:29.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55165 req_id = 0cdd08db-9e95-488f-8ee1-b8f2083b8585 response_code = 204 uri = /eip-gateways
19562025-02-28T02:12:29.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55165 req_id = 69bfa9d4-4d79-497e-beda-cab2231a5a69 response_code = 204 uri = /vpc-routes
19572025-02-28T02:12:29.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48349
19582025-02-28T02:12:29.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48349 req_id = c2be6710-0528-46f2-871b-cb93ffbcbd58 response_code = 200 uri = /vpc-routes
19592025-02-28T02:12:29.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35590
19602025-02-28T02:12:29.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35590 req_id = 33257db9-6360-4efd-9473-5dee38173612 response_code = 200 uri = /v2p
19612025-02-28T02:12:29.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50752
19622025-02-28T02:12:29.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50752 req_id = 79b84522-3f62-4ade-b93d-fd11254a87b6 response_code = 200 uri = /vpc-routes
19632025-02-28T02:12:29.699ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
19642025-02-28T02:12:29.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48349 req_id = 05c74c8d-08a5-445b-b6c6-b8a547024400 response_code = 204 uri = /eip-gateways
19652025-02-28T02:12:29.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48349 req_id = cedd7cf7-6e69-4e7f-b9b5-03d23630287f response_code = 204 uri = /vpc-routes
19662025-02-28T02:12:29.718ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
19672025-02-28T02:12:29.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50752 req_id = 949d8926-b384-4fc5-a9c2-ad865f8e8cb2 response_code = 204 uri = /eip-gateways
19682025-02-28T02:12:29.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50752 req_id = 51fb2a46-1c6a-47a6-8ba9-aa79a54a2a02 response_code = 204 uri = /vpc-routes
19692025-02-28T02:12:29.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34164
19702025-02-28T02:12:29.768ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19712025-02-28T02:12:29.805ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19722025-02-28T02:12:29.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 88045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34164 req_id = 0ff7656e-9eef-47a7-a38e-92739bf7e5f6 response_code = 204 uri = /switch-ports
19732025-02-28T02:12:29.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38357
19742025-02-28T02:12:29.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63136
19752025-02-28T02:12:29.857ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19762025-02-28T02:12:29.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34164 req_id = 325df9c8-a60b-47ab-8c2c-0d653dd48c75 response_code = 200 uri = /network-bootstore-config
19772025-02-28T02:12:29.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3417 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38357 req_id = 47c1105f-88b8-449f-819a-7a4c6699c46f response_code = 200 uri = /v2p
19782025-02-28T02:12:29.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57230
19792025-02-28T02:12:29.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57230 req_id = 3188c82f-d83a-4450-bc8b-3427c3fa4a9b response_code = 200 uri = /v2p
19802025-02-28T02:12:29.891ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19812025-02-28T02:12:29.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43192
19822025-02-28T02:12:29.939ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19832025-02-28T02:12:29.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 82919 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63136 req_id = a73166ee-5e95-4a02-acab-dd385da2ec47 response_code = 204 uri = /switch-ports
19842025-02-28T02:12:29.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 538 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63136 req_id = 6b668662-ca03-4856-99ac-6c04dcc3af48 response_code = 200 uri = /network-bootstore-config
19852025-02-28T02:12:29.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19862025-02-28T02:12:30.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 113512 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43192 req_id = 2f8ada5d-5b7b-4670-9551-3f7efdc19f03 response_code = 204 uri = /switch-ports
19872025-02-28T02:12:30.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43192 req_id = f18771b2-fde5-45e3-92c2-cde76ce5630d response_code = 200 uri = /network-bootstore-config
19882025-02-28T02:12:34.899ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39931
19892025-02-28T02:12:34.899ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39931 req_id = efbb63da-0a38-48fd-a45c-5897485c46ba response_code = 200 uri = /baseboard
19902025-02-28T02:12:41.080ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6998 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 59b4593b-84ab-4c19-9a02-0a0bd92908b2 response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
19912025-02-28T02:12:41.826ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19922025-02-28T02:12:59.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61395
19932025-02-28T02:12:59.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61395 req_id = 7d30e4fd-28fa-4d8f-ad17-bc0f2de0e622 response_code = 200 uri = /vpc-routes
19942025-02-28T02:12:59.770ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
19952025-02-28T02:12:59.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61395 req_id = ee02a4f2-3b11-4bf9-a6f3-ce18da004a9f response_code = 204 uri = /eip-gateways
19962025-02-28T02:12:59.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61395 req_id = 9e54c015-1a4a-442d-b762-92aa82d83d8e response_code = 204 uri = /vpc-routes
19972025-02-28T02:12:59.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40146
19982025-02-28T02:12:59.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40146 req_id = 66edb6d4-c8a8-473e-827b-d82ee68f912e response_code = 200 uri = /vpc-routes
19992025-02-28T02:12:59.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35751
20002025-02-28T02:12:59.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35751 req_id = c97ad8b5-822f-4ed1-bf7b-65fea6582374 response_code = 200 uri = /v2p
20012025-02-28T02:12:59.919ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
20022025-02-28T02:12:59.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40146 req_id = 8f03f999-8397-4c05-90f3-1534581ba932 response_code = 204 uri = /eip-gateways
20032025-02-28T02:12:59.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40146 req_id = 431f406f-d7b6-4e71-924d-45d270ce24a6 response_code = 204 uri = /vpc-routes
20042025-02-28T02:12:59.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38287
20052025-02-28T02:12:59.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38287 req_id = 2dcb7b79-391b-463e-8df8-ccd02dde3588 response_code = 200 uri = /vpc-routes
20062025-02-28T02:13:00.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33569
20072025-02-28T02:13:00.001ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20082025-02-28T02:13:00.046ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20092025-02-28T02:13:00.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 106423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33569 req_id = 5c38848e-3bcd-4aaf-b50f-e68406117bd8 response_code = 204 uri = /switch-ports
20102025-02-28T02:13:00.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33714
20112025-02-28T02:13:00.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49115
20122025-02-28T02:13:00.108ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
20132025-02-28T02:13:00.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38287 req_id = a5a5f295-dd72-462d-a81d-b038287f58d5 response_code = 204 uri = /eip-gateways
20142025-02-28T02:13:00.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33569 req_id = 94939821-481b-48b2-8c65-dbbe3e82e6e4 response_code = 200 uri = /network-bootstore-config
20152025-02-28T02:13:00.108ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20162025-02-28T02:13:00.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38287 req_id = 754fec69-85a4-4737-bef8-1987053c43fc response_code = 204 uri = /vpc-routes
20172025-02-28T02:13:00.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55393
20182025-02-28T02:13:00.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55393 req_id = f0877f09-b4b5-4b4b-b347-8074886e27e2 response_code = 200 uri = /v2p
20192025-02-28T02:13:00.145ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20202025-02-28T02:13:00.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44024
20212025-02-28T02:13:00.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44024 req_id = e74425ae-8997-42ca-ab17-11b425c0c0d9 response_code = 200 uri = /v2p
20222025-02-28T02:13:00.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 91974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49115 req_id = 67446aa2-24f1-4ff7-928e-a10d4347a71a response_code = 204 uri = /switch-ports
20232025-02-28T02:13:00.200ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20242025-02-28T02:13:00.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 708 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49115 req_id = 2b916794-55a9-471b-a9a4-f16e33174074 response_code = 200 uri = /network-bootstore-config
20252025-02-28T02:13:00.235ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20262025-02-28T02:13:00.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 176587 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33714 req_id = 6836a33e-4aa8-4162-a323-dd87c4e57245 response_code = 204 uri = /switch-ports
20272025-02-28T02:13:00.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33714 req_id = fef24445-0652-44d6-a9e8-b7a6bc2080c2 response_code = 200 uri = /network-bootstore-config
20282025-02-28T02:13:04.933ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39943
20292025-02-28T02:13:04.933ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39943 req_id = d3e3a134-eba2-4af2-a4c3-08c13740a1e3 response_code = 200 uri = /baseboard
20302025-02-28T02:13:11.080ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7054 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 261c0de5-5594-47bf-8388-30014ac525f3 response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
20312025-02-28T02:13:29.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40797
20322025-02-28T02:13:29.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40797 req_id = 5e6434b2-e5d4-4633-abcf-a9408a9a9718 response_code = 200 uri = /vpc-routes
20332025-02-28T02:13:29.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36749
20342025-02-28T02:13:29.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36749 req_id = e877f86b-bdd7-4d80-91df-f6f08cd5da93 response_code = 200 uri = /vpc-routes
20352025-02-28T02:13:29.591ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
20362025-02-28T02:13:29.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36749 req_id = 7267ba60-3a15-4328-b9d2-fbca2f812741 response_code = 204 uri = /eip-gateways
20372025-02-28T02:13:29.592ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
20382025-02-28T02:13:29.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40797 req_id = 2e96e76f-e410-44df-b8f8-bf7d4f3a90ee response_code = 204 uri = /eip-gateways
20392025-02-28T02:13:29.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36749 req_id = f8b37df3-305f-4df5-8bfc-bcc668772280 response_code = 204 uri = /vpc-routes
20402025-02-28T02:13:29.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40797 req_id = 3358caa2-a4ff-44b1-9049-48813facc26a response_code = 204 uri = /vpc-routes
20412025-02-28T02:13:29.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48217
20422025-02-28T02:13:29.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48217 req_id = b111c9de-459b-4e3c-9ab5-eae53bd47093 response_code = 200 uri = /v2p
20432025-02-28T02:13:29.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56542
20442025-02-28T02:13:29.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56542 req_id = 0e48a81a-81ac-40b8-9725-5798deb07d7d response_code = 200 uri = /v2p
20452025-02-28T02:13:29.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57428
20462025-02-28T02:13:29.711ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20472025-02-28T02:13:29.749ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20482025-02-28T02:13:29.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 98220 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57428 req_id = 54be9787-1bff-47bf-bc71-3cafbfab21d5 response_code = 204 uri = /switch-ports
20492025-02-28T02:13:29.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47325
20502025-02-28T02:13:29.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57428 req_id = 9fb48df6-a460-42f9-8db1-fb3240227909 response_code = 200 uri = /network-bootstore-config
20512025-02-28T02:13:29.810ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20522025-02-28T02:13:29.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53510
20532025-02-28T02:13:29.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53510 req_id = 6fe2c19a-e949-40b0-8afb-dec58f79ecf8 response_code = 200 uri = /vpc-routes
20542025-02-28T02:13:29.853ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20552025-02-28T02:13:29.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
20562025-02-28T02:13:29.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53510 req_id = e16989b2-82d9-4cfa-b280-965e83a7aa9e response_code = 204 uri = /eip-gateways
20572025-02-28T02:13:29.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53510 req_id = c86a9ec3-74e9-44b9-8924-d4c6d1ffb176 response_code = 204 uri = /vpc-routes
20582025-02-28T02:13:29.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43471
20592025-02-28T02:13:29.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 106613 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47325 req_id = 2f1846ca-00af-4e67-a68a-7ccef0a95514 response_code = 204 uri = /switch-ports
20602025-02-28T02:13:29.917ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20612025-02-28T02:13:29.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 829 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47325 req_id = 2bfb7f68-8db8-4c7e-838b-d65cab4efc6f response_code = 200 uri = /network-bootstore-config
20622025-02-28T02:13:29.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20632025-02-28T02:13:30.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 100201 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43471 req_id = d21249e0-4621-4b1a-98d0-78b921e244cc response_code = 204 uri = /switch-ports
20642025-02-28T02:13:30.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36031
20652025-02-28T02:13:30.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36031 req_id = 211d9356-790a-469a-b559-3c0ffc673ff6 response_code = 200 uri = /v2p
20662025-02-28T02:13:30.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43471 req_id = f8a7081a-181f-45d6-980f-cedde8c8f59f response_code = 200 uri = /network-bootstore-config
20672025-02-28T02:13:34.966ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55908
20682025-02-28T02:13:34.967ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55908 req_id = 979d49bc-c78e-4505-b453-7f5d9efc23a7 response_code = 200 uri = /baseboard
20692025-02-28T02:13:41.081ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7497 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 5c28315e-8226-4a81-9341-cf659cc401de response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
20702025-02-28T02:13:59.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63990
20712025-02-28T02:13:59.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63990 req_id = 2b835c74-ee71-419b-a62d-765ad48c1501 response_code = 200 uri = /vpc-routes
20722025-02-28T02:13:59.737ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
20732025-02-28T02:13:59.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63990 req_id = caff4764-163a-4ed4-8bde-2ce6f12bf5f8 response_code = 204 uri = /eip-gateways
20742025-02-28T02:13:59.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43813
20752025-02-28T02:13:59.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43813 req_id = 80ef60a3-0cdd-484f-8088-1858aeb49c24 response_code = 200 uri = /vpc-routes
20762025-02-28T02:13:59.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63990 req_id = b6ad2349-f7d7-4702-b9f7-5fd6bd6a734b response_code = 204 uri = /vpc-routes
20772025-02-28T02:13:59.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
20782025-02-28T02:13:59.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43813 req_id = 2c2da508-7d5d-4659-8762-0069811566e1 response_code = 204 uri = /eip-gateways
20792025-02-28T02:13:59.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43813 req_id = 2320e4f7-9354-4da6-b446-208b6319efe8 response_code = 204 uri = /vpc-routes
20802025-02-28T02:13:59.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32994
20812025-02-28T02:13:59.840ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20822025-02-28T02:13:59.875ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20832025-02-28T02:13:59.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 100109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32994 req_id = 45098239-125c-4122-8186-6e041644a0f1 response_code = 204 uri = /switch-ports
20842025-02-28T02:13:59.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53588
20852025-02-28T02:13:59.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63299
20862025-02-28T02:13:59.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56181
20872025-02-28T02:13:59.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54048
20882025-02-28T02:13:59.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32994 req_id = 4dcc006b-ff7f-40c5-a631-7a0fd572d6b9 response_code = 200 uri = /network-bootstore-config
20892025-02-28T02:13:59.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54048 req_id = ee78c4fe-516e-4bc2-ab8c-eaf9928f2049 response_code = 200 uri = /vpc-routes
20902025-02-28T02:13:59.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63299 req_id = 4cbb3f1b-b83b-447e-9a90-9257b6e896a2 response_code = 200 uri = /v2p
20912025-02-28T02:13:59.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53588 req_id = f2e08858-6284-46a0-a7fe-b4e0be6ac46b response_code = 200 uri = /v2p
20922025-02-28T02:13:59.941ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20932025-02-28T02:13:59.959ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
20942025-02-28T02:13:59.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54048 req_id = 661c59b3-eec2-48b5-b248-14d1ede78e3a response_code = 204 uri = /eip-gateways
20952025-02-28T02:13:59.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 701 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54048 req_id = b7f33323-ce86-462d-aaa6-7d0552971c0c response_code = 204 uri = /vpc-routes
20962025-02-28T02:13:59.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37321
20972025-02-28T02:13:59.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37321 req_id = a507334e-4a80-4855-8bbd-203081f38d96 response_code = 200 uri = /v2p
20982025-02-28T02:13:59.976ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20992025-02-28T02:14:00.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 93783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56181 req_id = 5b9a82b2-be4e-4198-8e27-9d7585bc7ad5 response_code = 204 uri = /switch-ports
21002025-02-28T02:14:00.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56181 req_id = 7b45c1cf-a465-46d8-bd11-acd47c3547d3 response_code = 200 uri = /network-bootstore-config
21012025-02-28T02:14:00.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58154
21022025-02-28T02:14:00.072ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21032025-02-28T02:14:00.107ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21042025-02-28T02:14:00.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 87980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58154 req_id = cf6df779-b6ec-4364-8493-a9eac4ccb224 response_code = 204 uri = /switch-ports
21052025-02-28T02:14:00.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58154 req_id = dd1df280-cfa7-4307-a7fa-41c7aece1cb3 response_code = 200 uri = /network-bootstore-config
21062025-02-28T02:14:04.998ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52038
21072025-02-28T02:14:04.998ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52038 req_id = ae7b9409-f48a-4d9d-83cd-7342a25c3e1c response_code = 200 uri = /baseboard
21082025-02-28T02:14:11.079ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6091 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 3d5eff57-49a4-4929-8a2f-731627b48207 response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
21092025-02-28T02:14:29.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36883
21102025-02-28T02:14:29.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36883 req_id = 5e5c3343-3e2f-47be-a75f-c5b7d5310cfe response_code = 200 uri = /vpc-routes
21112025-02-28T02:14:29.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45089
21122025-02-28T02:14:29.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45089 req_id = 48cd19ed-3c91-4f25-a2b9-5f0b74c8026f response_code = 200 uri = /vpc-routes
21132025-02-28T02:14:29.594ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
21142025-02-28T02:14:29.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36883 req_id = d8c630f2-7b1e-4675-96bf-9ed7df601297 response_code = 204 uri = /eip-gateways
21152025-02-28T02:14:29.600ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
21162025-02-28T02:14:29.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45089 req_id = 6dbb0191-1dbe-40db-b59a-f0a8697f97d9 response_code = 204 uri = /eip-gateways
21172025-02-28T02:14:29.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36487
21182025-02-28T02:14:29.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36487 req_id = d5ef858b-8e91-4b02-bdc3-a4f2fdf8cbfb response_code = 200 uri = /vpc-routes
21192025-02-28T02:14:29.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36883 req_id = 5ee57547-c418-4e3f-a9f4-bf9f35a0381f response_code = 204 uri = /vpc-routes
21202025-02-28T02:14:29.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45089 req_id = 40fde335-0122-4461-9647-80347931e2a2 response_code = 204 uri = /vpc-routes
21212025-02-28T02:14:29.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41935
21222025-02-28T02:14:29.619ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21232025-02-28T02:14:29.662ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21242025-02-28T02:14:29.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 107638 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41935 req_id = 09ed0ef0-23e4-4a4d-8d7b-2d45a788509e response_code = 204 uri = /switch-ports
21252025-02-28T02:14:29.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38266
21262025-02-28T02:14:29.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46718
21272025-02-28T02:14:29.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
21282025-02-28T02:14:29.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36487 req_id = 4e4ff4bc-ef28-4423-8f53-3fbb4ca65af3 response_code = 204 uri = /eip-gateways
21292025-02-28T02:14:29.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41935 req_id = e3710557-4ba0-484e-b8db-258b13dee16b response_code = 200 uri = /network-bootstore-config
21302025-02-28T02:14:29.727ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21312025-02-28T02:14:29.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37727
21322025-02-28T02:14:29.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46718 req_id = bf8eee83-a478-457a-900a-bb3b7dae732b response_code = 200 uri = /v2p
21332025-02-28T02:14:29.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37727 req_id = 06476c5f-cb63-47ec-a23f-ed05f79a0bf5 response_code = 200 uri = /v2p
21342025-02-28T02:14:29.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36487 req_id = e2def749-431c-424d-aba7-a4a117582054 response_code = 204 uri = /vpc-routes
21352025-02-28T02:14:29.768ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21362025-02-28T02:14:29.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42968
21372025-02-28T02:14:29.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42968 req_id = 169f128e-af41-4fda-9023-30da5b60ee68 response_code = 200 uri = /v2p
21382025-02-28T02:14:29.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 92379 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38266 req_id = 9742312a-d413-495a-bdaa-d420cb8ecbf3 response_code = 204 uri = /switch-ports
21392025-02-28T02:14:29.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38266 req_id = 164ff696-75b3-41bb-8416-e66ed81607fa response_code = 200 uri = /network-bootstore-config
21402025-02-28T02:14:29.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62662
21412025-02-28T02:14:29.846ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21422025-02-28T02:14:29.882ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21432025-02-28T02:14:29.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 87978 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62662 req_id = a9da3d27-cce5-4b96-911c-92a16fc1e5df response_code = 204 uri = /switch-ports
21442025-02-28T02:14:29.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62662 req_id = 75ad2be9-2f9b-4a8a-99c9-2962105e216b response_code = 200 uri = /network-bootstore-config
21452025-02-28T02:14:35.031ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44246
21462025-02-28T02:14:35.031ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44246 req_id = 9ed206d6-6596-4fa2-abbd-5f50e8237fac response_code = 200 uri = /baseboard
21472025-02-28T02:14:41.079ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5732 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 72bc102f-2b21-40bd-8162-1ce385dbdfa5 response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
21482025-02-28T02:14:59.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34118
21492025-02-28T02:14:59.591ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21502025-02-28T02:14:59.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5862 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34118 req_id = b614290a-d1a4-4214-a58c-b97bb934ba01 response_code = 200 uri = /artifacts
21512025-02-28T02:14:59.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62954
21522025-02-28T02:14:59.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 720 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62954 req_id = da2a2244-a709-4ffc-a5d8-4d5b173db582 response_code = 200 uri = /vpc-routes
21532025-02-28T02:14:59.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65109
21542025-02-28T02:14:59.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65109 req_id = 1357564f-cabe-4921-b4a8-801b478c2756 response_code = 200 uri = /vpc-routes
21552025-02-28T02:14:59.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38486
21562025-02-28T02:14:59.780ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21572025-02-28T02:14:59.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38486 req_id = ce7c11bc-18aa-4202-b546-aede7f07fa2e response_code = 200 uri = /artifacts
21582025-02-28T02:14:59.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63677
21592025-02-28T02:14:59.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63677 req_id = 17c1703d-9bcc-4c1c-91db-47cb18dadec8 response_code = 200 uri = /vpc-routes
21602025-02-28T02:14:59.826ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
21612025-02-28T02:14:59.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65109 req_id = 2ce7bdc8-556e-4671-97c2-3dc974b7a7e4 response_code = 204 uri = /eip-gateways
21622025-02-28T02:14:59.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65109 req_id = 6e294fb1-bbe0-48c3-8f07-04478d878271 response_code = 204 uri = /vpc-routes
21632025-02-28T02:14:59.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38301
21642025-02-28T02:14:59.878ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21652025-02-28T02:14:59.933ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21662025-02-28T02:15:00.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 132753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38301 req_id = fea843dd-07aa-4c36-aa31-73705f13553c response_code = 204 uri = /switch-ports
21672025-02-28T02:15:00.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57196
21682025-02-28T02:15:00.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64059
21692025-02-28T02:15:00.011ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
21702025-02-28T02:15:00.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50277
21712025-02-28T02:15:00.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62954 req_id = d8f573d2-4d67-40fe-8b98-74369c0d758d response_code = 204 uri = /eip-gateways
21722025-02-28T02:15:00.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41240
21732025-02-28T02:15:00.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61863
21742025-02-28T02:15:00.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57196 req_id = 3cddf6c4-d579-4167-8fbb-b92298313031 response_code = 200 uri = /v2p
21752025-02-28T02:15:00.012ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
21762025-02-28T02:15:00.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38301 req_id = fd467822-6996-4ad3-9c99-7cf594b77d62 response_code = 200 uri = /network-bootstore-config
21772025-02-28T02:15:00.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 378 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63677 req_id = 1061190b-cb54-40ec-aac8-75a394495c0d response_code = 204 uri = /eip-gateways
21782025-02-28T02:15:00.012ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21792025-02-28T02:15:00.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21802025-02-28T02:15:00.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 11276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50277 req_id = 69947de2-584b-47ca-8daa-c0c1bfa007e0 response_code = 200 uri = /v2p
21812025-02-28T02:15:00.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 11870 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64059 req_id = 0736bb6b-6bbf-4b76-90a8-71048ceb2e8d response_code = 200 uri = /artifacts
21822025-02-28T02:15:00.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63677 req_id = eb5fd1e4-0bb9-43b0-9a14-596d480882ff response_code = 204 uri = /vpc-routes
21832025-02-28T02:15:00.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 487 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62954 req_id = 0fe38996-8d47-4c22-8659-b409249f188b response_code = 204 uri = /vpc-routes
21842025-02-28T02:15:00.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60087
21852025-02-28T02:15:00.053ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21862025-02-28T02:15:00.053ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21872025-02-28T02:15:00.053ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21882025-02-28T02:15:00.054ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21892025-02-28T02:15:00.054ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21902025-02-28T02:15:00.054ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21912025-02-28T02:15:00.054ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21922025-02-28T02:15:00.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60087 req_id = 6e5c1e22-f6e5-4639-9ea4-7c4cba805c16 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21932025-02-28T02:15:00.056ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21942025-02-28T02:15:00.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62249
21952025-02-28T02:15:00.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62249 req_id = 9607d13f-5e80-4633-80bf-3aebfd7e356c response_code = 200 uri = /v2p
21962025-02-28T02:15:00.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21972025-02-28T02:15:00.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 110915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41240 req_id = 6607c2e9-b292-4cec-86f8-da70094ca9a1 response_code = 204 uri = /switch-ports
21982025-02-28T02:15:00.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 737 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41240 req_id = 7a928c6d-28c6-4f30-a473-8d386d9ea09b response_code = 200 uri = /network-bootstore-config
21992025-02-28T02:15:00.172ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22002025-02-28T02:15:00.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65173
22012025-02-28T02:15:00.220ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22022025-02-28T02:15:00.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22032025-02-28T02:15:00.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22042025-02-28T02:15:00.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
22052025-02-28T02:15:00.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22062025-02-28T02:15:00.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22072025-02-28T02:15:00.220ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22082025-02-28T02:15:00.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65173 req_id = 159986f2-ec0a-4214-8c13-bd0410b6410a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22092025-02-28T02:15:00.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 230683 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61863 req_id = 6f5ab2ed-89b4-4664-94fa-ff0532578513 response_code = 204 uri = /switch-ports
22102025-02-28T02:15:00.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61863 req_id = 3186d075-5244-49fb-9158-e30e6f451dc7 response_code = 200 uri = /network-bootstore-config
22112025-02-28T02:15:00.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47624
22122025-02-28T02:15:00.274ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22132025-02-28T02:15:00.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22142025-02-28T02:15:00.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22152025-02-28T02:15:00.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
22162025-02-28T02:15:00.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22172025-02-28T02:15:00.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22182025-02-28T02:15:00.274ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22192025-02-28T02:15:00.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47624 req_id = 0aa6f121-da5e-4059-a5a0-dfee8052cc65 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22202025-02-28T02:15:05.064ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58250
22212025-02-28T02:15:05.064ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58250 req_id = 26912843-8e5f-4056-852e-6870270f8f2c response_code = 200 uri = /baseboard
22222025-02-28T02:15:11.080ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6092 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = db5e38ae-6f62-40ff-869f-7fc85d94e3bf response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
22232025-02-28T02:15:29.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46483
22242025-02-28T02:15:29.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46483 req_id = bb9c7822-9ef1-4447-9459-0673af7a7508 response_code = 200 uri = /vpc-routes
22252025-02-28T02:15:29.584ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
22262025-02-28T02:15:29.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46483 req_id = bd71d9ac-2df5-461c-82d4-63edc957d125 response_code = 204 uri = /eip-gateways
22272025-02-28T02:15:29.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36824
22282025-02-28T02:15:29.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36824 req_id = a6f7a278-d80f-4778-8c69-917494f43aff response_code = 200 uri = /vpc-routes
22292025-02-28T02:15:29.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47777
22302025-02-28T02:15:29.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47777 req_id = 75ac8abb-d3e1-470e-bf15-f76cb5acb47f response_code = 200 uri = /v2p
22312025-02-28T02:15:29.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49755
22322025-02-28T02:15:29.639ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22332025-02-28T02:15:29.683ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22342025-02-28T02:15:29.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 105742 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49755 req_id = 896701e7-495a-43cf-a084-e585b3542136 response_code = 204 uri = /switch-ports
22352025-02-28T02:15:29.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44014
22362025-02-28T02:15:29.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49843
22372025-02-28T02:15:29.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45574
22382025-02-28T02:15:29.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47835
22392025-02-28T02:15:29.745ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
22402025-02-28T02:15:29.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49755 req_id = aac67c2f-a5ba-4b55-bd52-e088bb64a7f5 response_code = 200 uri = /network-bootstore-config
22412025-02-28T02:15:29.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36824 req_id = 7eaece71-b696-4b72-bf6e-2e8e4954f590 response_code = 204 uri = /eip-gateways
22422025-02-28T02:15:29.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44014 req_id = 5c7ed1bd-9377-492b-9a22-c679c2ef7fe8 response_code = 200 uri = /v2p
22432025-02-28T02:15:29.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22442025-02-28T02:15:29.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 647 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46483 req_id = d6c07f6c-112f-40d0-a9c7-20641e694da9 response_code = 204 uri = /vpc-routes
22452025-02-28T02:15:29.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5355 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45574 req_id = 47673017-38c6-48f6-8c3f-74e17b85257a response_code = 200 uri = /vpc-routes
22462025-02-28T02:15:29.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36824 req_id = 13654802-003d-4053-8d5a-740db73e64c9 response_code = 204 uri = /vpc-routes
22472025-02-28T02:15:29.784ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22482025-02-28T02:15:29.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46190
22492025-02-28T02:15:29.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46190 req_id = 701e48b4-593b-4b59-9c65-d8014e617a46 response_code = 200 uri = /v2p
22502025-02-28T02:15:29.801ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
22512025-02-28T02:15:29.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45574 req_id = c47215ba-21f6-469f-a088-966e69ed6ec6 response_code = 204 uri = /eip-gateways
22522025-02-28T02:15:29.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 489 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45574 req_id = 0d440252-36a2-40a5-9ab9-f662f78e9cdf response_code = 204 uri = /vpc-routes
22532025-02-28T02:15:29.837ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22542025-02-28T02:15:29.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 91837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49843 req_id = 3200e314-7d19-472d-af17-9fb0ff3b7f9e response_code = 204 uri = /switch-ports
22552025-02-28T02:15:29.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 671 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49843 req_id = e98e0180-4ae4-46cd-a6f6-d9ab3c3ea545 response_code = 200 uri = /network-bootstore-config
22562025-02-28T02:15:29.871ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22572025-02-28T02:15:29.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 179579 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47835 req_id = 42fb2c37-0462-492a-a864-52a0b0cb6e6e response_code = 204 uri = /switch-ports
22582025-02-28T02:15:29.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47835 req_id = 28afcfdc-37d6-4e43-933b-469a1a4276eb response_code = 200 uri = /network-bootstore-config
22592025-02-28T02:15:35.099ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54508
22602025-02-28T02:15:35.100ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54508 req_id = 0880b12d-27d7-49f1-a0ae-01922e41da18 response_code = 200 uri = /baseboard
22612025-02-28T02:15:41.082ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7145 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = d32c337f-d4a1-4591-a249-f33cff9dd87d response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
22622025-02-28T02:15:59.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64237
22632025-02-28T02:15:59.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64237 req_id = fcf6524e-209a-4a81-b145-89ff423827a5 response_code = 200 uri = /vpc-routes
22642025-02-28T02:15:59.650ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
22652025-02-28T02:15:59.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64237 req_id = 98c4e21d-4558-46a1-a558-d23cfbfb6501 response_code = 204 uri = /eip-gateways
22662025-02-28T02:15:59.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64237 req_id = 67d10747-971d-4e9e-a4c3-91ecc04e1839 response_code = 204 uri = /vpc-routes
22672025-02-28T02:15:59.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33166
22682025-02-28T02:15:59.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33166 req_id = 2de18f2e-82b4-462f-ae2c-625f97de2c9d response_code = 200 uri = /vpc-routes
22692025-02-28T02:15:59.706ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
22702025-02-28T02:15:59.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33166 req_id = c0e83390-9355-4119-8e06-f20807f6ca0c response_code = 204 uri = /eip-gateways
22712025-02-28T02:15:59.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51947
22722025-02-28T02:15:59.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51947 req_id = 32703b77-1823-4a4c-8925-ff3da339e6d6 response_code = 200 uri = /v2p
22732025-02-28T02:15:59.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33166 req_id = 144a0c1c-d07c-4d6f-8d30-3f569ae3de22 response_code = 204 uri = /vpc-routes
22742025-02-28T02:15:59.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38000
22752025-02-28T02:15:59.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22762025-02-28T02:15:59.837ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22772025-02-28T02:15:59.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 92011 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38000 req_id = 68faa64b-ca78-4afc-bbe2-757d833b1906 response_code = 204 uri = /switch-ports
22782025-02-28T02:15:59.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38000 req_id = 6af8709b-14a2-402f-b20e-ce5c09abee71 response_code = 200 uri = /network-bootstore-config
22792025-02-28T02:15:59.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58854
22802025-02-28T02:15:59.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58854 req_id = 7953914c-3c60-4f27-a711-12a0425d84c7 response_code = 200 uri = /v2p
22812025-02-28T02:15:59.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62475
22822025-02-28T02:15:59.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62475 req_id = d476fd7a-d87e-49e8-bd07-8e567d45c28b response_code = 200 uri = /vpc-routes
22832025-02-28T02:15:59.993ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
22842025-02-28T02:15:59.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62475 req_id = 6b27206d-0199-4d42-b4c9-e3c2720dfc56 response_code = 204 uri = /eip-gateways
22852025-02-28T02:16:00.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62475 req_id = 9161a136-96d5-449b-9c48-9412a4785534 response_code = 204 uri = /vpc-routes
22862025-02-28T02:16:00.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33003
22872025-02-28T02:16:00.023ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22882025-02-28T02:16:00.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22892025-02-28T02:16:00.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 100123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33003 req_id = 85a04ece-7933-45ef-b7ed-46e5bfe9498c response_code = 204 uri = /switch-ports
22902025-02-28T02:16:00.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33003 req_id = f09a8038-a964-462b-b2b3-892c2f1038d1 response_code = 200 uri = /network-bootstore-config
22912025-02-28T02:16:00.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43739
22922025-02-28T02:16:00.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43739 req_id = a5e2d120-75f5-4cbb-a4d7-71a38e6a710f response_code = 200 uri = /v2p
22932025-02-28T02:16:00.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43209
22942025-02-28T02:16:00.198ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22952025-02-28T02:16:00.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22962025-02-28T02:16:00.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 91113 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43209 req_id = 3746d6f7-9858-42e5-8bc8-edaf59b7ee2c response_code = 204 uri = /switch-ports
22972025-02-28T02:16:00.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43209 req_id = d36ce98b-f58f-4f66-bf11-1e21adf4345a response_code = 200 uri = /network-bootstore-config
22982025-02-28T02:16:05.133ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64221
22992025-02-28T02:16:05.134ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64221 req_id = c347c712-170c-46ec-87d2-f7d567ebc9e7 response_code = 200 uri = /baseboard
23002025-02-28T02:16:11.081ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6180 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = e4de9bb7-d686-4d41-a06d-ccc4fa0ca6dc response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
23012025-02-28T02:16:29.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47207
23022025-02-28T02:16:29.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47207 req_id = f5a19a35-d8e7-488b-843a-9620d326ea97 response_code = 200 uri = /vpc-routes
23032025-02-28T02:16:29.531ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
23042025-02-28T02:16:29.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47207 req_id = 95708268-9556-43f3-8433-8bdebe0777cc response_code = 204 uri = /eip-gateways
23052025-02-28T02:16:29.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47207 req_id = b9cf6c70-da56-48a6-86e2-fe927f766df1 response_code = 204 uri = /vpc-routes
23062025-02-28T02:16:29.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50191
23072025-02-28T02:16:29.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50191 req_id = 1ebeb925-9a43-4e6c-9f46-0d21886b75a8 response_code = 200 uri = /vpc-routes
23082025-02-28T02:16:29.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52176
23092025-02-28T02:16:29.641ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23102025-02-28T02:16:29.687ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23112025-02-28T02:16:29.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 117118 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52176 req_id = 09f9e401-b6ed-4565-960c-1fcf7ab089d4 response_code = 204 uri = /switch-ports
23122025-02-28T02:16:29.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37565
23132025-02-28T02:16:29.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63022
23142025-02-28T02:16:29.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37513
23152025-02-28T02:16:29.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49593
23162025-02-28T02:16:29.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
23172025-02-28T02:16:29.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50191 req_id = 7d64d9b4-c293-4169-b14e-378ffab4493e response_code = 204 uri = /eip-gateways
23182025-02-28T02:16:29.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52176 req_id = 3f4454f0-66ec-44cb-a609-f83bb183bb7c response_code = 200 uri = /network-bootstore-config
23192025-02-28T02:16:29.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49593 req_id = a7f87426-65de-43b6-b309-9b24ae8d962f response_code = 200 uri = /v2p
23202025-02-28T02:16:29.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37513 req_id = 2f9e504f-ad16-4db8-aee8-ea9b22374964 response_code = 200 uri = /v2p
23212025-02-28T02:16:29.759ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23222025-02-28T02:16:29.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63022 req_id = fde3ce99-0944-41db-bf63-b3aecc4389cb response_code = 200 uri = /vpc-routes
23232025-02-28T02:16:29.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50191 req_id = db8a1063-73a7-441b-9f5e-265ad27741e4 response_code = 204 uri = /vpc-routes
23242025-02-28T02:16:29.807ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23252025-02-28T02:16:29.831ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
23262025-02-28T02:16:29.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 761 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63022 req_id = b662e580-2ff5-41fd-bafe-1e291d9cf743 response_code = 204 uri = /eip-gateways
23272025-02-28T02:16:29.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54211
23282025-02-28T02:16:29.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54211 req_id = 4d7c7f7c-19e6-496c-87f0-2465435ab761 response_code = 200 uri = /v2p
23292025-02-28T02:16:29.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53309
23302025-02-28T02:16:29.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63022 req_id = 860f84c3-847f-4827-9ddb-bfeb341ca3f2 response_code = 204 uri = /vpc-routes
23312025-02-28T02:16:29.891ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23322025-02-28T02:16:29.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 132678 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37565 req_id = 2f208cb1-2625-48ec-870c-c6d94d134c7c response_code = 204 uri = /switch-ports
23332025-02-28T02:16:29.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 436 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37565 req_id = 27678cc0-dad5-4beb-a8bc-725b97e1f004 response_code = 200 uri = /network-bootstore-config
23342025-02-28T02:16:29.939ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23352025-02-28T02:16:30.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 178028 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53309 req_id = 18aab227-0efc-4057-8cb4-fd49e9ddf135 response_code = 204 uri = /switch-ports
23362025-02-28T02:16:30.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53309 req_id = 590144cf-d72f-4705-9598-a2a4ebb100fa response_code = 200 uri = /network-bootstore-config
23372025-02-28T02:16:35.166ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60997
23382025-02-28T02:16:35.166ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60997 req_id = 050e8848-19ea-4ef9-a8cb-d1dda4e6434b response_code = 200 uri = /baseboard
23392025-02-28T02:16:41.081ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6138 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = b22be8b0-fdc3-418f-ab72-aa83540304e8 response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
23402025-02-28T02:16:59.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49405
23412025-02-28T02:16:59.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49405 req_id = 5f54db0e-0e60-4ecc-a497-793656fd9c0c response_code = 200 uri = /vpc-routes
23422025-02-28T02:16:59.679ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
23432025-02-28T02:16:59.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49405 req_id = f01f4e3f-0dab-42ed-8865-4aff43c5c0f2 response_code = 204 uri = /eip-gateways
23442025-02-28T02:16:59.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49405 req_id = 5d05fff8-bde3-47e9-9dc0-7aa13c293ffa response_code = 204 uri = /vpc-routes
23452025-02-28T02:16:59.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52485
23462025-02-28T02:16:59.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52485 req_id = 116742c0-d1a5-462e-b134-3bcdf6f2cdbd response_code = 200 uri = /vpc-routes
23472025-02-28T02:16:59.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34882
23482025-02-28T02:16:59.818ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23492025-02-28T02:16:59.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23502025-02-28T02:16:59.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 98015 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34882 req_id = 22196562-8396-4f62-8851-a5d98c552164 response_code = 204 uri = /switch-ports
23512025-02-28T02:16:59.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50940
23522025-02-28T02:16:59.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62413
23532025-02-28T02:16:59.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
23542025-02-28T02:16:59.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52485 req_id = 3c39fe35-f875-4a1a-837f-912ca378a6f7 response_code = 204 uri = /eip-gateways
23552025-02-28T02:16:59.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34882 req_id = 38c5e494-3d11-4984-88a8-1b366319a126 response_code = 200 uri = /network-bootstore-config
23562025-02-28T02:16:59.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50940 req_id = 59b10a6e-d22b-4e85-8901-03b9d37e2e69 response_code = 200 uri = /v2p
23572025-02-28T02:16:59.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62413 req_id = 77330ec0-ea1e-42e9-9eec-fbc7b8578480 response_code = 200 uri = /v2p
23582025-02-28T02:16:59.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33401
23592025-02-28T02:16:59.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33401 req_id = 6e221895-8905-4ea5-98c4-d993d6e0f81a response_code = 200 uri = /vpc-routes
23602025-02-28T02:16:59.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52485 req_id = 3a0a7400-fd6a-4d76-a350-9ede1582d805 response_code = 204 uri = /vpc-routes
23612025-02-28T02:16:59.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
23622025-02-28T02:16:59.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33401 req_id = 0e49bf62-0a06-4b5b-8d5c-ce2195b2a834 response_code = 204 uri = /eip-gateways
23632025-02-28T02:16:59.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33401 req_id = 63c67308-1cf8-41c0-a367-3d1331054245 response_code = 204 uri = /vpc-routes
23642025-02-28T02:16:59.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55118
23652025-02-28T02:16:59.954ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23662025-02-28T02:16:59.994ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23672025-02-28T02:17:00.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 97136 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55118 req_id = afc300e6-02c3-4a45-87bc-305a772d600d response_code = 204 uri = /switch-ports
23682025-02-28T02:17:00.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57051
23692025-02-28T02:17:00.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62240
23702025-02-28T02:17:00.052ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23712025-02-28T02:17:00.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55118 req_id = 6e72b857-a078-4766-a491-999efca4e7a1 response_code = 200 uri = /network-bootstore-config
23722025-02-28T02:17:00.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 3731 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62240 req_id = 3818375d-15b3-4c0e-99de-080a98aa92a1 response_code = 200 uri = /v2p
23732025-02-28T02:17:00.087ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23742025-02-28T02:17:00.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 91622 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57051 req_id = 03adffd3-5b55-4b91-ac30-c93e7df10fa7 response_code = 204 uri = /switch-ports
23752025-02-28T02:17:00.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57051 req_id = 8cdc9104-6497-404d-b90a-4774b004c2ed response_code = 200 uri = /network-bootstore-config
23762025-02-28T02:17:05.199ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37981
23772025-02-28T02:17:05.199ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37981 req_id = 3260a397-eea7-47ff-9c0c-39b139ef33b0 response_code = 200 uri = /baseboard
23782025-02-28T02:17:11.081ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5814 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 6e6bab27-2675-40b6-bfeb-153724b96c99 response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
23792025-02-28T02:17:27.338ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23802025-02-28T02:17:27.338ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23812025-02-28T02:17:27.366ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1764, tv_nsec: 994368323 } time_to_next_cleanup = 599.9999957s
23822025-02-28T02:17:29.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43747
23832025-02-28T02:17:29.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43747 req_id = 4771b40d-b571-4088-982d-c4fce84090c9 response_code = 200 uri = /vpc-routes
23842025-02-28T02:17:29.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65111
23852025-02-28T02:17:29.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65111 req_id = e613a190-ebc9-42e8-948c-cbcfac2d1b5f response_code = 200 uri = /vpc-routes
23862025-02-28T02:17:29.617ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
23872025-02-28T02:17:29.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65111 req_id = 2677e047-3627-4b8a-91be-051a58e57c3a response_code = 204 uri = /eip-gateways
23882025-02-28T02:17:29.620ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
23892025-02-28T02:17:29.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43747 req_id = d0fe6bf0-2b8b-4971-92cd-6f236161fb58 response_code = 204 uri = /eip-gateways
23902025-02-28T02:17:29.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44375
23912025-02-28T02:17:29.624ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23922025-02-28T02:17:29.670ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23932025-02-28T02:17:29.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 110814 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44375 req_id = a0b9d897-932b-4359-88a6-b501932824d6 response_code = 204 uri = /switch-ports
23942025-02-28T02:17:29.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58206
23952025-02-28T02:17:29.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54106
23962025-02-28T02:17:29.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40359
23972025-02-28T02:17:29.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40474
23982025-02-28T02:17:29.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 467 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44375 req_id = 4fe4dbf2-1741-435c-8506-e6adf792f046 response_code = 200 uri = /network-bootstore-config
23992025-02-28T02:17:29.735ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24002025-02-28T02:17:29.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 752 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65111 req_id = bf018d47-f6e1-4625-aae1-4a3bf2b23f67 response_code = 204 uri = /vpc-routes
24012025-02-28T02:17:29.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54106 req_id = 7409c0f2-fe00-494d-b6dd-451695593c9b response_code = 200 uri = /v2p
24022025-02-28T02:17:29.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40474 req_id = 489d9235-c671-4834-9a00-dd204b50c148 response_code = 200 uri = /vpc-routes
24032025-02-28T02:17:29.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5615 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43747 req_id = 9c3a5726-1ad7-4ee8-a4e6-39fddbc28e9b response_code = 204 uri = /vpc-routes
24042025-02-28T02:17:29.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40359 req_id = 85f3ce68-d279-48ac-a985-e0d810d9dad9 response_code = 200 uri = /v2p
24052025-02-28T02:17:29.754ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
24062025-02-28T02:17:29.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40474 req_id = cf70e03e-8933-4d2e-a8fc-2e4e4b443328 response_code = 204 uri = /eip-gateways
24072025-02-28T02:17:29.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43237
24082025-02-28T02:17:29.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43032
24092025-02-28T02:17:29.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43032 req_id = 805b0a58-b8d3-4ef2-b754-00227293403a response_code = 200 uri = /v2p
24102025-02-28T02:17:29.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40474 req_id = e5020df7-a183-445b-8032-3c467713824b response_code = 204 uri = /vpc-routes
24112025-02-28T02:17:29.773ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24122025-02-28T02:17:29.826ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24132025-02-28T02:17:29.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 90978 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58206 req_id = aea4416e-e596-4c1c-8702-6da52f73d725 response_code = 204 uri = /switch-ports
24142025-02-28T02:17:29.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 633 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58206 req_id = 61d507de-f9d5-40fd-8081-44aa8081dd1b response_code = 200 uri = /network-bootstore-config
24152025-02-28T02:17:29.860ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24162025-02-28T02:17:29.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 158124 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43237 req_id = 91d5d92c-47a3-44b5-bdcf-d581ff98a5d1 response_code = 204 uri = /switch-ports
24172025-02-28T02:17:29.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43237 req_id = b324095a-e362-45ce-ad9a-c2b54beafef3 response_code = 200 uri = /network-bootstore-config
24182025-02-28T02:17:35.233ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55920
24192025-02-28T02:17:35.233ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55920 req_id = 288ca3d7-0b03-44b9-bec3-e897a8ca71f6 response_code = 200 uri = /baseboard
24202025-02-28T02:17:41.084ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7047 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = e0c65113-be3c-40ef-8fb4-c36aa084064a response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
24212025-02-28T02:17:41.830ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24222025-02-28T02:17:59.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48979
24232025-02-28T02:17:59.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48979 req_id = 5a5ad81b-926d-4b25-a8b6-5b8369ec1e06 response_code = 200 uri = /vpc-routes
24242025-02-28T02:17:59.746ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
24252025-02-28T02:17:59.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48979 req_id = b0f1a40c-fa51-450a-8dbc-a8724d9f925d response_code = 204 uri = /eip-gateways
24262025-02-28T02:17:59.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58489
24272025-02-28T02:17:59.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58489 req_id = 952bb314-c236-432e-b382-881b513d6a52 response_code = 200 uri = /vpc-routes
24282025-02-28T02:17:59.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48979 req_id = 095cad55-fdf6-43b5-92e0-189b9851550b response_code = 204 uri = /vpc-routes
24292025-02-28T02:17:59.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47774
24302025-02-28T02:17:59.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47774 req_id = 8c8cd0b6-b963-42a6-9f11-d72aca4fcabc response_code = 200 uri = /vpc-routes
24312025-02-28T02:17:59.829ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
24322025-02-28T02:17:59.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58489 req_id = 313cf604-19f4-47a7-a2ad-437dfe6e53bc response_code = 204 uri = /eip-gateways
24332025-02-28T02:17:59.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
24342025-02-28T02:17:59.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47774 req_id = febd0c27-ce34-43dc-a433-7006ee59958f response_code = 204 uri = /eip-gateways
24352025-02-28T02:17:59.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58489 req_id = c1f90a2f-1960-4a6f-9474-604e929448c3 response_code = 204 uri = /vpc-routes
24362025-02-28T02:17:59.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34894
24372025-02-28T02:17:59.865ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24382025-02-28T02:17:59.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24392025-02-28T02:17:59.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 97323 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34894 req_id = 317a1871-b40b-4f3e-89f0-c200c6eb8664 response_code = 204 uri = /switch-ports
24402025-02-28T02:17:59.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54680
24412025-02-28T02:17:59.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63769
24422025-02-28T02:17:59.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34894 req_id = ce63b811-d3b7-4911-99fe-c5e2b1288a4a response_code = 200 uri = /network-bootstore-config
24432025-02-28T02:17:59.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54680 req_id = d6ba3d52-5b78-48a5-81aa-d33979947f0c response_code = 200 uri = /v2p
24442025-02-28T02:17:59.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63769 req_id = 533ec974-badf-41d2-8ae7-f9e70137304e response_code = 200 uri = /v2p
24452025-02-28T02:17:59.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 673 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47774 req_id = 8cb7b03d-399c-49f6-be5c-561c3ca87812 response_code = 204 uri = /vpc-routes
24462025-02-28T02:18:00.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48733
24472025-02-28T02:18:00.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48733 req_id = 04cd83fe-2b83-499a-811e-f90cdadeb2ea response_code = 200 uri = /v2p
24482025-02-28T02:18:00.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34937
24492025-02-28T02:18:00.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24502025-02-28T02:18:00.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24512025-02-28T02:18:00.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 95244 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34937 req_id = d0a1dd07-8180-44e9-843c-0409394fa5a5 response_code = 204 uri = /switch-ports
24522025-02-28T02:18:00.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48639
24532025-02-28T02:18:00.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34937 req_id = 2f84886b-77ab-4773-a1c6-193da95b848e response_code = 200 uri = /network-bootstore-config
24542025-02-28T02:18:00.128ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24552025-02-28T02:18:00.162ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24562025-02-28T02:18:00.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 87696 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48639 req_id = 890463a0-6ff2-49de-b65f-80bfa382a903 response_code = 204 uri = /switch-ports
24572025-02-28T02:18:00.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48639 req_id = f15d40ba-99b8-4ed1-b1ff-651208c95ffe response_code = 200 uri = /network-bootstore-config
24582025-02-28T02:18:05.266ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58970
24592025-02-28T02:18:05.266ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58970 req_id = 1c2ea4e1-91a2-4c1b-a079-f377d529d2f8 response_code = 200 uri = /baseboard
24602025-02-28T02:18:11.084ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7523 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 5f4072bd-8f3a-4d65-9a2f-0eda70e8c2dc response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
24612025-02-28T02:18:29.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34237
24622025-02-28T02:18:29.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34237 req_id = 4d9b2071-44ac-48b3-a719-284cc9d80659 response_code = 200 uri = /vpc-routes
24632025-02-28T02:18:29.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53124
24642025-02-28T02:18:29.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53124 req_id = 8d1d41b3-8809-4453-84f0-8b50361044f0 response_code = 200 uri = /vpc-routes
24652025-02-28T02:18:29.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
24662025-02-28T02:18:29.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53124 req_id = 398dfa9b-297a-4d4e-a114-e930635bffd4 response_code = 204 uri = /eip-gateways
24672025-02-28T02:18:29.612ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
24682025-02-28T02:18:29.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34237 req_id = 27d95192-24c2-4b5b-bf3a-463abd5b57ff response_code = 204 uri = /eip-gateways
24692025-02-28T02:18:29.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34237 req_id = 1b00d296-2e30-488d-9bac-3ea61b74e031 response_code = 204 uri = /vpc-routes
24702025-02-28T02:18:29.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43770
24712025-02-28T02:18:29.675ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24722025-02-28T02:18:29.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24732025-02-28T02:18:29.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 96419 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43770 req_id = 98ce8623-93b8-465a-8069-2106282bf2fd response_code = 204 uri = /switch-ports
24742025-02-28T02:18:29.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47714
24752025-02-28T02:18:29.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33186
24762025-02-28T02:18:29.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61936
24772025-02-28T02:18:29.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53124 req_id = 9423ed38-cb44-43ca-98a4-c6c04ed3ac9e response_code = 204 uri = /vpc-routes
24782025-02-28T02:18:29.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37213
24792025-02-28T02:18:29.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43770 req_id = 60873041-cd6f-484a-af82-14edf0bca5e2 response_code = 200 uri = /network-bootstore-config
24802025-02-28T02:18:29.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61936 req_id = 6c92f00f-9fdf-4756-a725-306a25fcfc0c response_code = 200 uri = /vpc-routes
24812025-02-28T02:18:29.773ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24822025-02-28T02:18:29.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47714 req_id = fb55f6f5-eed5-4c21-97fa-b338b64ac519 response_code = 200 uri = /v2p
24832025-02-28T02:18:29.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37213 req_id = 01295436-26d2-4e65-a6b1-f7c66da34693 response_code = 200 uri = /v2p
24842025-02-28T02:18:29.811ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24852025-02-28T02:18:29.815ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
24862025-02-28T02:18:29.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61936 req_id = fac0c474-968a-4dfc-933c-dc2667b8f2b4 response_code = 204 uri = /eip-gateways
24872025-02-28T02:18:29.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40396
24882025-02-28T02:18:29.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40396 req_id = 4ed5d6bd-645f-41c8-a58a-82edad5e9473 response_code = 200 uri = /v2p
24892025-02-28T02:18:29.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 930 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61936 req_id = e021ae46-3127-474f-9ac1-de3f989a46b0 response_code = 204 uri = /vpc-routes
24902025-02-28T02:18:29.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 97108 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33186 req_id = 3cf4e09f-19f4-4623-85fd-f473bdcfebff response_code = 204 uri = /switch-ports
24912025-02-28T02:18:29.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33186 req_id = 12f60ee4-1368-4ace-ab2e-ebb6a552c682 response_code = 200 uri = /network-bootstore-config
24922025-02-28T02:18:29.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60520
24932025-02-28T02:18:29.876ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24942025-02-28T02:18:29.910ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24952025-02-28T02:18:29.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 87112 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60520 req_id = 1d22cc4e-5539-4f24-90e5-4142bcfb6661 response_code = 204 uri = /switch-ports
24962025-02-28T02:18:29.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60520 req_id = 774d4b77-2b7d-40a1-bd73-60c8a70ef923 response_code = 200 uri = /network-bootstore-config
24972025-02-28T02:18:35.300ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49850
24982025-02-28T02:18:35.300ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49850 req_id = 21f9cc19-8ad7-4fd6-8c47-0cc9ddd59451 response_code = 200 uri = /baseboard
24992025-02-28T02:18:41.092ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 8359 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = d6288902-0261-46d1-a47e-522ec8caa377 response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
25002025-02-28T02:18:59.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61949
25012025-02-28T02:18:59.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61949 req_id = 5084ccd4-1798-4424-9e8d-dd5834cf93d7 response_code = 200 uri = /vpc-routes
25022025-02-28T02:18:59.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36074
25032025-02-28T02:18:59.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36074 req_id = 27bb5fc4-29b1-44c4-a61f-f1c4be570072 response_code = 200 uri = /vpc-routes
25042025-02-28T02:18:59.782ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
25052025-02-28T02:18:59.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36074 req_id = 182faec0-214b-4f6a-b8a5-c74aa7700844 response_code = 204 uri = /eip-gateways
25062025-02-28T02:18:59.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36074 req_id = f8d8e6af-b8da-461b-b419-af6c358b8111 response_code = 204 uri = /vpc-routes
25072025-02-28T02:18:59.802ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
25082025-02-28T02:18:59.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61949 req_id = 5e49a3d9-160d-49e2-8d2f-86b3ab89bda2 response_code = 204 uri = /eip-gateways
25092025-02-28T02:18:59.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61949 req_id = d1887b89-dd2a-4706-b45f-fdff097f684a response_code = 204 uri = /vpc-routes
25102025-02-28T02:18:59.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58370
25112025-02-28T02:18:59.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58370 req_id = 9ed507e8-61a3-45a7-aa0d-bbd1e48426b0 response_code = 200 uri = /vpc-routes
25122025-02-28T02:18:59.841ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
25132025-02-28T02:18:59.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58370 req_id = a691c9e3-ca22-4cf1-bcd2-3fabd712da54 response_code = 204 uri = /eip-gateways
25142025-02-28T02:18:59.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58370 req_id = 1499b00f-1d51-40a8-af7a-6976e87b281f response_code = 204 uri = /vpc-routes
25152025-02-28T02:18:59.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42177
25162025-02-28T02:18:59.851ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25172025-02-28T02:18:59.893ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25182025-02-28T02:18:59.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 106137 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42177 req_id = 34976df0-c226-4718-9b97-f86b8d36c6e6 response_code = 204 uri = /switch-ports
25192025-02-28T02:18:59.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50059
25202025-02-28T02:18:59.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40987
25212025-02-28T02:18:59.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36432
25222025-02-28T02:18:59.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42177 req_id = d14c09b6-81af-4bc1-b349-65638accc352 response_code = 200 uri = /network-bootstore-config
25232025-02-28T02:18:59.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50059 req_id = 031685a0-b649-453e-8b51-c2b41d2c1909 response_code = 200 uri = /v2p
25242025-02-28T02:18:59.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40987 req_id = 772354f2-afc9-41ae-98d9-6a82e084df59 response_code = 200 uri = /v2p
25252025-02-28T02:18:59.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36432 req_id = 8d58e1e7-2579-4ea3-ba54-2efbe8dcfaf8 response_code = 200 uri = /v2p
25262025-02-28T02:18:59.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46031
25272025-02-28T02:18:59.963ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25282025-02-28T02:18:59.999ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25292025-02-28T02:19:00.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 89190 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46031 req_id = 36631fcf-19f6-4651-ba95-01b204489ab7 response_code = 204 uri = /switch-ports
25302025-02-28T02:19:00.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32792
25312025-02-28T02:19:00.053ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25322025-02-28T02:19:00.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46031 req_id = 33399a0c-52ab-4a2f-aad4-65c75334d3b0 response_code = 200 uri = /network-bootstore-config
25332025-02-28T02:19:00.089ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25342025-02-28T02:19:00.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 87493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32792 req_id = a182f85b-d06b-4c15-80c1-b119452da666 response_code = 204 uri = /switch-ports
25352025-02-28T02:19:00.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32792 req_id = daff6646-0b7f-449a-911b-b3fd4d24d631 response_code = 200 uri = /network-bootstore-config
25362025-02-28T02:19:05.336ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64999
25372025-02-28T02:19:05.336ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64999 req_id = 5e2a71bd-684c-46ac-b553-01780a4ddffc response_code = 200 uri = /baseboard
25382025-02-28T02:19:11.086ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7924 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 61b3a3b1-4247-411c-9d4b-ccd2dd8d1b25 response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
25392025-02-28T02:19:29.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36255
25402025-02-28T02:19:29.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36255 req_id = 71ccd5c5-6110-4bfa-bb35-4770e6e9bdf2 response_code = 200 uri = /vpc-routes
25412025-02-28T02:19:29.456ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
25422025-02-28T02:19:29.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36255 req_id = 6126f493-e18c-4109-8d64-f5326e348591 response_code = 204 uri = /eip-gateways
25432025-02-28T02:19:29.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36255 req_id = 6c96f976-ad0d-4e74-be8e-42337291219a response_code = 204 uri = /vpc-routes
25442025-02-28T02:19:29.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39938
25452025-02-28T02:19:29.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39938 req_id = f6910075-f700-4fd0-9bd0-0ff2689255e7 response_code = 200 uri = /vpc-routes
25462025-02-28T02:19:29.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
25472025-02-28T02:19:29.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39938 req_id = 01111af1-50c8-4094-8ef9-83ea7e6d3194 response_code = 204 uri = /eip-gateways
25482025-02-28T02:19:29.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39938 req_id = 01712dc0-4df0-4f98-9945-e5b8a5472033 response_code = 204 uri = /vpc-routes
25492025-02-28T02:19:29.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52487
25502025-02-28T02:19:29.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25512025-02-28T02:19:29.651ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25522025-02-28T02:19:29.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 96613 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52487 req_id = 41929220-45af-46e1-9f52-fb28d65ac209 response_code = 204 uri = /switch-ports
25532025-02-28T02:19:29.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57182
25542025-02-28T02:19:29.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57205
25552025-02-28T02:19:29.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36082
25562025-02-28T02:19:29.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48415
25572025-02-28T02:19:29.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36082 req_id = ac23926b-0490-45b8-b975-f872f9923a6c response_code = 200 uri = /vpc-routes
25582025-02-28T02:19:29.711ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25592025-02-28T02:19:29.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57205 req_id = c4abb049-78ec-4aa7-8607-4075f81a02e3 response_code = 200 uri = /v2p
25602025-02-28T02:19:29.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52487 req_id = f871fe86-3c48-4047-bc17-07e7c30c78e9 response_code = 200 uri = /network-bootstore-config
25612025-02-28T02:19:29.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 5663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57182 req_id = 6e9941b7-1b94-4890-ac75-8c497c7f686d response_code = 200 uri = /v2p
25622025-02-28T02:19:29.760ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25632025-02-28T02:19:29.764ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
25642025-02-28T02:19:29.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 4682 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36082 req_id = 76831734-55e3-4251-8b4d-28ffef779c83 response_code = 204 uri = /eip-gateways
25652025-02-28T02:19:29.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 881 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36082 req_id = d62df56d-fde4-414e-be02-d981ba11c5f8 response_code = 204 uri = /vpc-routes
25662025-02-28T02:19:29.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 107160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48415 req_id = 1f8eb25a-ee90-47ae-a2ff-562fb43f5399 response_code = 204 uri = /switch-ports
25672025-02-28T02:19:29.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48415 req_id = 93fb40f4-f665-42f6-9706-7ed42e0ce891 response_code = 200 uri = /network-bootstore-config
25682025-02-28T02:19:29.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59222
25692025-02-28T02:19:29.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59222 req_id = 5ae28c0b-0c6f-4d8d-998d-35326c1da48c response_code = 200 uri = /v2p
25702025-02-28T02:19:29.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55067
25712025-02-28T02:19:29.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25722025-02-28T02:19:29.880ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25732025-02-28T02:19:29.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 89546 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55067 req_id = e8174328-fa1d-4c3f-a65b-b110da2b6289 response_code = 204 uri = /switch-ports
25742025-02-28T02:19:29.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55067 req_id = 0f2419fb-60d3-40d9-8b48-9faeb48c9e39 response_code = 200 uri = /network-bootstore-config
25752025-02-28T02:19:35.369ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53298
25762025-02-28T02:19:35.369ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53298 req_id = 52867054-5129-4bde-adcf-0229b9415450 response_code = 200 uri = /baseboard
25772025-02-28T02:19:41.087ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7876 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 413591ec-cf80-4fed-adff-824d39702b6e response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
25782025-02-28T02:19:59.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59369
25792025-02-28T02:19:59.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59369 req_id = 33e58cab-9bdf-47f1-9045-9293eb311316 response_code = 200 uri = /vpc-routes
25802025-02-28T02:19:59.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54171
25812025-02-28T02:19:59.778ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25822025-02-28T02:19:59.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 525 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54171 req_id = 9f737e88-86a6-4cc1-ade7-1cfdf6242bd3 response_code = 200 uri = /artifacts
25832025-02-28T02:19:59.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42086
25842025-02-28T02:19:59.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25852025-02-28T02:19:59.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 478 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42086 req_id = a1a7ec5a-b9fd-48aa-a54e-fcf408b7d543 response_code = 200 uri = /artifacts
25862025-02-28T02:19:59.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
25872025-02-28T02:19:59.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59369 req_id = b745a203-b687-4e75-8010-2180fd809a9f response_code = 204 uri = /eip-gateways
25882025-02-28T02:19:59.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53208
25892025-02-28T02:19:59.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53208 req_id = f39d16a3-6114-44f7-b24a-9584a9cfceb7 response_code = 200 uri = /vpc-routes
25902025-02-28T02:19:59.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62785
25912025-02-28T02:19:59.954ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25922025-02-28T02:19:59.995ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25932025-02-28T02:20:00.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 104699 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62785 req_id = 988058c4-7343-4685-b79c-2a66ee9d22d4 response_code = 204 uri = /switch-ports
25942025-02-28T02:20:00.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64568
25952025-02-28T02:20:00.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58544
25962025-02-28T02:20:00.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44529
25972025-02-28T02:20:00.059ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
25982025-02-28T02:20:00.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53208 req_id = 52772774-75c9-4dcc-89e9-db40fc96c689 response_code = 204 uri = /eip-gateways
25992025-02-28T02:20:00.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62785 req_id = a1776322-c297-4c1a-b69b-ec8691ab1c99 response_code = 200 uri = /network-bootstore-config
26002025-02-28T02:20:00.060ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26012025-02-28T02:20:00.060ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26022025-02-28T02:20:00.060ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-zones.json file = common/src/ledger.rs:177
26032025-02-28T02:20:00.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64568 req_id = e01da90f-5a2d-4c78-9f51-6a7c3394a0e0 response_code = 200 uri = /v2p
26042025-02-28T02:20:00.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58544 req_id = 7e48038a-b287-4fb9-a270-e170dbf69049 response_code = 200 uri = /v2p
26052025-02-28T02:20:00.060ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-zones.json file = common/src/ledger.rs:177
26062025-02-28T02:20:00.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53208 req_id = d73d213b-8b94-4126-af7e-6ccf109d6898 response_code = 204 uri = /vpc-routes
26072025-02-28T02:20:00.074ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26082025-02-28T02:20:00.074ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3a87d4a-d86a-4868-ad38-fc879461da99
26092025-02-28T02:20:00.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38990
26102025-02-28T02:20:00.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38990 req_id = c4251c59-d083-4ed6-9ce4-ad111c3e7ad9 response_code = 200 uri = /vpc-routes
26112025-02-28T02:20:00.100ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26122025-02-28T02:20:00.100ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e
26132025-02-28T02:20:00.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41264
26142025-02-28T02:20:00.136ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26152025-02-28T02:20:00.136ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26162025-02-28T02:20:00.136ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-zones.json file = common/src/ledger.rs:177
26172025-02-28T02:20:00.137ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-zones.json file = common/src/ledger.rs:177
26182025-02-28T02:20:00.144ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26192025-02-28T02:20:00.144ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2
26202025-02-28T02:20:00.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59369 req_id = 6d472299-1e12-42f6-a34c-6b20eaac3080 response_code = 204 uri = /vpc-routes
26212025-02-28T02:20:00.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62271
26222025-02-28T02:20:00.163ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26232025-02-28T02:20:00.163ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26242025-02-28T02:20:00.163ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3a87d4a-d86a-4868-ad38-fc879461da99
26252025-02-28T02:20:00.177ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
26262025-02-28T02:20:00.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 1661 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38990 req_id = 8d3b44b4-bf54-4161-b4ad-fb13fb68641c response_code = 204 uri = /eip-gateways
26272025-02-28T02:20:00.187ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26282025-02-28T02:20:00.188ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7ae93100-6078-4f36-b916-7ea04312348c
26292025-02-28T02:20:00.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 6084 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38990 req_id = 0b4e0220-d430-4dad-9a82-055360ceedd4 response_code = 204 uri = /vpc-routes
26302025-02-28T02:20:00.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 42170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62271 req_id = fbc8c313-1286-4258-86a8-253a5ded07aa response_code = 200 uri = /artifacts
26312025-02-28T02:20:00.204ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26322025-02-28T02:20:00.204ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e
26332025-02-28T02:20:00.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38861
26342025-02-28T02:20:00.215ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26352025-02-28T02:20:00.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52474
26362025-02-28T02:20:00.235ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26372025-02-28T02:20:00.235ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2
26382025-02-28T02:20:00.240ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26392025-02-28T02:20:00.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26402025-02-28T02:20:00.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26412025-02-28T02:20:00.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26422025-02-28T02:20:00.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26432025-02-28T02:20:00.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26442025-02-28T02:20:00.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26452025-02-28T02:20:00.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 910 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52474 req_id = 8989f03e-dc9e-4903-b0b2-0e45310805b5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26462025-02-28T02:20:00.250ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26472025-02-28T02:20:00.251ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a
26482025-02-28T02:20:00.261ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26492025-02-28T02:20:00.269ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26502025-02-28T02:20:00.269ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7ae93100-6078-4f36-b916-7ea04312348c
26512025-02-28T02:20:00.285ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26522025-02-28T02:20:00.285ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_56271d63-ce52-4a9a-beca-d66806dddbb3
26532025-02-28T02:20:00.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57734
26542025-02-28T02:20:00.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57734 req_id = 71ad793e-a3e0-46b4-8973-267ac8cda042 response_code = 200 uri = /v2p
26552025-02-28T02:20:00.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53765
26562025-02-28T02:20:00.314ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26572025-02-28T02:20:00.314ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26582025-02-28T02:20:00.314ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/config/omicron-zones.json file = common/src/ledger.rs:177
26592025-02-28T02:20:00.314ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26602025-02-28T02:20:00.314ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_55ae14e7-5a6e-4245-98d6-55cf62789803
26612025-02-28T02:20:00.319ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/config/omicron-zones.json file = common/src/ledger.rs:177
26622025-02-28T02:20:00.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33993
26632025-02-28T02:20:00.331ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26642025-02-28T02:20:00.331ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a
26652025-02-28T02:20:00.341ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26662025-02-28T02:20:00.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 126122 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38861 req_id = c193700e-f997-4106-81c3-92d50a2697f8 response_code = 204 uri = /switch-ports
26672025-02-28T02:20:00.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38861 req_id = a707fa44-e079-4fdb-89db-e11d0efd2f8b response_code = 200 uri = /network-bootstore-config
26682025-02-28T02:20:00.348ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3a87d4a-d86a-4868-ad38-fc879461da99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26692025-02-28T02:20:00.348ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3a87d4a-d86a-4868-ad38-fc879461da99
26702025-02-28T02:20:00.368ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26712025-02-28T02:20:00.368ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81fb17c7-22e5-4138-98cb-7b91dded8807
26722025-02-28T02:20:00.382ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26732025-02-28T02:20:00.382ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_56271d63-ce52-4a9a-beca-d66806dddbb3
26742025-02-28T02:20:00.391ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26752025-02-28T02:20:00.398ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26762025-02-28T02:20:00.398ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e
26772025-02-28T02:20:00.412ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26782025-02-28T02:20:00.412ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf
26792025-02-28T02:20:00.426ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26802025-02-28T02:20:00.426ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_55ae14e7-5a6e-4245-98d6-55cf62789803
26812025-02-28T02:20:00.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 372419 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44529 req_id = 194a2317-c9c6-49b1-b8ae-e7322f1e55b1 response_code = 200 uri = /inventory
26822025-02-28T02:20:00.440ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26832025-02-28T02:20:00.440ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2
26842025-02-28T02:20:00.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52461
26852025-02-28T02:20:00.454ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26862025-02-28T02:20:00.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26872025-02-28T02:20:00.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26882025-02-28T02:20:00.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26892025-02-28T02:20:00.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26902025-02-28T02:20:00.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26912025-02-28T02:20:00.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26922025-02-28T02:20:00.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 739 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52461 req_id = 62e89eef-a9dc-4d21-80d2-a38a764a7adf response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26932025-02-28T02:20:00.459ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26942025-02-28T02:20:00.459ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81fb17c7-22e5-4138-98cb-7b91dded8807
26952025-02-28T02:20:00.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 147694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33993 req_id = ad39375d-7814-4e33-898a-9f7350009fdd response_code = 204 uri = /switch-ports
26962025-02-28T02:20:00.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33993 req_id = 3b714487-564c-4f0b-a3a7-34841e5a14dd response_code = 200 uri = /network-bootstore-config
26972025-02-28T02:20:00.477ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7ae93100-6078-4f36-b916-7ea04312348c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26982025-02-28T02:20:00.477ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7ae93100-6078-4f36-b916-7ea04312348c
26992025-02-28T02:20:00.495ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27002025-02-28T02:20:00.495ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf
27012025-02-28T02:20:00.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 378514 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41264 req_id = 92136eb7-885d-4ebc-9fc0-1335d2ec70f8 response_code = 200 uri = /inventory
27022025-02-28T02:20:00.520ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96d00a6f-2f4d-4b13-a75f-c89809dc380a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27032025-02-28T02:20:00.520ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96d00a6f-2f4d-4b13-a75f-c89809dc380a
27042025-02-28T02:20:00.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37443
27052025-02-28T02:20:00.539ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 133dc0cc-e8b5-4452-9fb0-21fcd48db8ff, kind: Service { id: b8fab31d-c1c3-47ef-8445-d320ff18b925 }, name: Name("external-dns-b8fab31d-c1c3-47ef-8445-d320ff18b925"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c6dd9be6-dc7c-4ab8-8be3-9a4733ea6fe0, kind: Service { id: 8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08 }, name: Name("external-dns-8c9d62d5-0ae9-4682-a60e-cd4cf5a2aa08"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 80])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 19897aab-338c-4389-a85f-78e65e9b6503, kind: Service { id: 95cefe9d-6cfa-4abd-8c4f-beef4564758f }, name: Name("nexus-95cefe9d-6cfa-4abd-8c4f-beef4564758f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 40d38d65-a08d-476f-be9a-df5df8aeba70, kind: Service { id: 97706d05-7981-4c67-b267-252930b86713 }, name: Name("nexus-97706d05-7981-4c67-b267-252930b86713"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6ed91aac-d8b5-4b8f-a9f0-bb4a0b61418e, kind: Service { id: 93cc49c1-2861-4962-9f80-1961b297cd43 }, name: Name("nexus-93cc49c1-2861-4962-9f80-1961b297cd43"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27062025-02-28T02:20:00.539ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27072025-02-28T02:20:00.539ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27082025-02-28T02:20:00.539ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27092025-02-28T02:20:00.539ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27102025-02-28T02:20:00.539ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27112025-02-28T02:20:00.539ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27122025-02-28T02:20:00.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 660 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37443 req_id = b9f4eb64-7174-4c11-a2c8-bbc0d49779af response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27132025-02-28T02:20:00.545ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56271d63-ce52-4a9a-beca-d66806dddbb3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27142025-02-28T02:20:00.545ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_56271d63-ce52-4a9a-beca-d66806dddbb3
27152025-02-28T02:20:00.574ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 55ae14e7-5a6e-4245-98d6-55cf62789803 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27162025-02-28T02:20:00.574ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_55ae14e7-5a6e-4245-98d6-55cf62789803
27172025-02-28T02:20:00.599ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81fb17c7-22e5-4138-98cb-7b91dded8807 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27182025-02-28T02:20:00.599ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81fb17c7-22e5-4138-98cb-7b91dded8807
27192025-02-28T02:20:00.628ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eda0a87a-f705-4947-9fe8-b01f3de48adf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27202025-02-28T02:20:00.628ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eda0a87a-f705-4947-9fe8-b01f3de48adf
27212025-02-28T02:20:00.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 329613 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53765 req_id = 0472a7cc-4f4b-4b9a-b480-5d213369bf57 response_code = 200 uri = /inventory
27222025-02-28T02:20:05.403ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39034
27232025-02-28T02:20:05.403ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39034 req_id = f65926d7-84d4-44d6-901e-640b122e88a7 response_code = 200 uri = /baseboard
27242025-02-28T02:20:11.086ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7096 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 0b059c7e-9522-4dd0-a124-0c6c979a8c4e response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
27252025-02-28T02:20:29.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38328
27262025-02-28T02:20:29.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38328 req_id = c66d94f8-14fe-46c4-8c7a-1ac362b25dc5 response_code = 200 uri = /vpc-routes
27272025-02-28T02:20:29.583ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
27282025-02-28T02:20:29.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38328 req_id = 335bcbff-5b20-4e0a-8f9f-d1ece210992e response_code = 204 uri = /eip-gateways
27292025-02-28T02:20:29.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38825
27302025-02-28T02:20:29.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38825 req_id = 5dfd8882-3686-415b-b86d-df86c9afa704 response_code = 200 uri = /vpc-routes
27312025-02-28T02:20:29.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38328 req_id = 8c5ec1e3-da30-4c9a-9224-d74edcd81158 response_code = 204 uri = /vpc-routes
27322025-02-28T02:20:29.606ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
27332025-02-28T02:20:29.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38825 req_id = e28b6311-9cc7-4d1c-a482-daf7353a6969 response_code = 204 uri = /eip-gateways
27342025-02-28T02:20:29.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38825 req_id = 16b1ed44-450a-4572-8e5c-c0e4785eea54 response_code = 204 uri = /vpc-routes
27352025-02-28T02:20:29.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52203
27362025-02-28T02:20:29.649ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27372025-02-28T02:20:29.689ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27382025-02-28T02:20:29.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 109494 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52203 req_id = 18baff8c-4d9a-4464-8804-d42824b32259 response_code = 204 uri = /switch-ports
27392025-02-28T02:20:29.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60697
27402025-02-28T02:20:29.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48316
27412025-02-28T02:20:29.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60820
27422025-02-28T02:20:29.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60820 req_id = 730e02aa-dbae-4446-ad7d-aef13b1e0ebd response_code = 200 uri = /v2p
27432025-02-28T02:20:29.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48316 req_id = 39a6bca9-0810-46b3-9261-e30ce14ad5e1 response_code = 200 uri = /vpc-routes
27442025-02-28T02:20:29.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52203 req_id = 832b9479-97a7-4899-87b9-25a3eb94cd3c response_code = 200 uri = /network-bootstore-config
27452025-02-28T02:20:29.760ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27462025-02-28T02:20:29.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64009
27472025-02-28T02:20:29.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64009 req_id = 44b85a62-43ed-4bc3-a5ee-8bd4afb0370e response_code = 200 uri = /v2p
27482025-02-28T02:20:29.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51638
27492025-02-28T02:20:29.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33292
27502025-02-28T02:20:29.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33292 req_id = 76ebbb08-ce39-418c-b285-e076afb4b561 response_code = 200 uri = /v2p
27512025-02-28T02:20:29.803ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27522025-02-28T02:20:29.809ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
27532025-02-28T02:20:29.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48316 req_id = 4dd5eac7-d69a-4736-82fa-4ad9bbd7d8fe response_code = 204 uri = /eip-gateways
27542025-02-28T02:20:29.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 912 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48316 req_id = c96ab5ee-4512-474b-b0e4-a4d66e500ff7 response_code = 204 uri = /vpc-routes
27552025-02-28T02:20:29.868ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27562025-02-28T02:20:29.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 108993 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60697 req_id = cc9b0dbd-6856-4eee-b39e-90ca1c28f349 response_code = 204 uri = /switch-ports
27572025-02-28T02:20:29.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 849 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60697 req_id = bb200d59-efba-4f1d-89b0-ac1adef32eb7 response_code = 200 uri = /network-bootstore-config
27582025-02-28T02:20:29.911ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27592025-02-28T02:20:29.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 190817 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51638 req_id = 18d3321e-3a49-48d5-9178-77c52df3d992 response_code = 204 uri = /switch-ports
27602025-02-28T02:20:29.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51638 req_id = 9961b2de-a283-4f0d-8771-a51dd91bc411 response_code = 200 uri = /network-bootstore-config
27612025-02-28T02:20:35.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48802
27622025-02-28T02:20:35.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48802 req_id = ab0667d4-0a00-40af-940b-dc8928959e62 response_code = 200 uri = /v2p
27632025-02-28T02:20:35.120ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(5667615) }
27642025-02-28T02:20:35.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 911 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48802 req_id = 01463bca-899e-4503-a6f6-cb74a1b1e8bb response_code = 204 uri = /v2p
27652025-02-28T02:20:35.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45369
27662025-02-28T02:20:35.198ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 84bdb226-4c9a-426a-98d7-6b58637abfb6, kind: Instance { id: 2a6ffa25-2475-427b-a505-7b603f28d9af }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5667615), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 84bdb226-4c9a-426a-98d7-6b58637abfb6, kind: Instance { id: 2a6ffa25-2475-427b-a505-7b603f28d9af }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5667615), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 84bdb226-4c9a-426a-98d7-6b58637abfb6, kind: Instance { id: 2a6ffa25-2475-427b-a505-7b603f28d9af }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5667615), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5667615))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 84bdb226-4c9a-426a-98d7-6b58637abfb6, kind: Instance { id: 2a6ffa25-2475-427b-a505-7b603f28d9af }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5667615), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: d4ad61e3-8670-4a28-b323-1d4b53b546eb, slot: 0, read_only: false, vcr_json: .., name: "disk-e99d41ed0bf" }], boot_settings: Some(InstanceBootSettings { order: [d4ad61e3-8670-4a28-b323-1d4b53b546eb] }), cloud_init_bytes: Some(..) } instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af metadata = InstanceMetadata { silo_id: 42f4082f-3adb-4730-b977-db2b68456d8a, project_id: e5a79465-c748-442f-a298-492da6ec4409 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-28T02:20:35.189697759Z }
27672025-02-28T02:20:35.198ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af migration_id = None propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27682025-02-28T02:20:35.198ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af migration_id = None propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 84bdb226-4c9a-426a-98d7-6b58637abfb6, kind: Instance { id: 2a6ffa25-2475-427b-a505-7b603f28d9af }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5667615), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 84bdb226-4c9a-426a-98d7-6b58637abfb6, kind: Instance { id: 2a6ffa25-2475-427b-a505-7b603f28d9af }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5667615), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 84bdb226-4c9a-426a-98d7-6b58637abfb6, kind: Instance { id: 2a6ffa25-2475-427b-a505-7b603f28d9af }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5667615), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5667615))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 84bdb226-4c9a-426a-98d7-6b58637abfb6, kind: Instance { id: 2a6ffa25-2475-427b-a505-7b603f28d9af }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5667615), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: d4ad61e3-8670-4a28-b323-1d4b53b546eb, slot: 0, read_only: false, vcr_json: .., name: "disk-e99d41ed0bf" }], boot_settings: Some(InstanceBootSettings { order: [d4ad61e3-8670-4a28-b323-1d4b53b546eb] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-28T02:20:35.189697759Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27692025-02-28T02:20:35.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 9255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45369 req_id = bd6a2d17-9189-4941-8039-c9548ff7dea3 response_code = 200 uri = /vmms/78d4c35e-c830-45d3-9f27-ee45e3d97918
27702025-02-28T02:20:35.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56182
27712025-02-28T02:20:35.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 812 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56182 req_id = 9a27a58d-44d2-4dd8-9854-85adee58e233 response_code = 200 uri = /vmms/78d4c35e-c830-45d3-9f27-ee45e3d97918/state
27722025-02-28T02:20:35.304ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 5667615 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27732025-02-28T02:20:35.304ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27742025-02-28T02:20:35.343ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918 file = illumos-utils/src/zone.rs:325 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27752025-02-28T02:20:35.367ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918 file = illumos-utils/src/zone.rs:363 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27762025-02-28T02:20:35.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44510
27772025-02-28T02:20:35.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44510 req_id = 8caca8e3-a35a-4b33-b9d7-5ca61b10203c response_code = 200 uri = /vpc-routes
27782025-02-28T02:20:35.437ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52069
27792025-02-28T02:20:35.437ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52069 req_id = 661e0a30-f97d-4017-af1c-7ed6cd63124b response_code = 200 uri = /baseboard
27802025-02-28T02:20:35.454ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {84bdb226-4c9a-426a-98d7-6b58637abfb6: {10.151.1.176: {d9d0ffb0-974f-4d73-81c6-46d9fcaf6fc3}, 10.151.1.175: {d9d0ffb0-974f-4d73-81c6-46d9fcaf6fc3}}} }
27812025-02-28T02:20:37.121ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27822025-02-28T02:20:37.121ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918 zone file = illumos-utils/src/running_zone.rs:489 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 zone = oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918
27832025-02-28T02:20:37.312ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 68.428161ms file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 zone = oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918
27842025-02-28T02:20:37.402ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 97.440135ms file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 zone = oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918
27852025-02-28T02:20:37.517ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 263.030369ms file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 zone = oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918
27862025-02-28T02:20:37.796ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 289.592321ms file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 zone = oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918
27872025-02-28T02:20:38.097ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 463.409229ms file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 zone = oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918
27882025-02-28T02:20:38.571ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 1.226532602s file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 zone = oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918
27892025-02-28T02:20:39.809ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 1.008703423s file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 zone = oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918
27902025-02-28T02:20:40.831ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 1.316328678s file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 zone = oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918
27912025-02-28T02:20:41.087ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7127 local_addr = [fd00:1122:3344:101::1]:52187 method = GET remote_addr = [fd00:1122:3344:101::d]:44981 req_id = 70adad38-fb53-4cd1-b63f-3403cb5bf05c response_code = 200 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 uri = /f5279127-f12d-4326-a7e5-d07a518dbb01
27922025-02-28T02:20:42.181ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918 file = sled-agent/src/instance.rs:2133 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27932025-02-28T02:20:42.190ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 51.955276ms file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27942025-02-28T02:20:42.253ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 64.164851ms file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27952025-02-28T02:20:42.332ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 218.289089ms file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27962025-02-28T02:20:42.560ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918") failed: Property not found. retry in 443.860365ms file = illumos-utils/src/svc.rs:42 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27972025-02-28T02:20:43.017ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27982025-02-28T02:20:43.055ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
27992025-02-28T02:20:43.139ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28002025-02-28T02:20:43.140ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
28012025-02-28T02:20:43.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 7686417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44510 req_id = 98f73a5a-1783-4f45-b461-95ccd3b355c9 response_code = 204 uri = /eip-gateways
28022025-02-28T02:20:43.140ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-02-28T02:20:43.140309097Z } file = sled-agent/src/instance.rs:842 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28032025-02-28T02:20:43.140ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T02:20:43.140309097Z } propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28042025-02-28T02:20:43.142ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T02:20:43.140309097Z }, migration_in: None, migration_out: None }
28052025-02-28T02:20:43.154ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-02-28T02:20:43.154746341Z } file = sled-agent/src/instance.rs:842 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28062025-02-28T02:20:43.154ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T02:20:43.154746341Z } propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28072025-02-28T02:20:43.154ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T02:20:43.154746341Z }, migration_in: None, migration_out: None }
28082025-02-28T02:20:43.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 375 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44510 req_id = 7429a064-d88c-4843-a66c-257f35236a58 response_code = 204 uri = /vpc-routes
28092025-02-28T02:20:52.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64937
28102025-02-28T02:20:52.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 420 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64937 req_id = 3ad7502b-175f-4df1-8bc3-3583f31dce99 response_code = 200 uri = /vmms/78d4c35e-c830-45d3-9f27-ee45e3d97918/state
28112025-02-28T02:20:52.803ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-02-28T02:20:52.803590740Z } file = sled-agent/src/instance.rs:842 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28122025-02-28T02:20:52.803ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T02:20:52.803590740Z } propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28132025-02-28T02:20:52.803ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T02:20:52.803590740Z }, migration_in: None, migration_out: None }
28142025-02-28T02:20:52.846ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-02-28T02:20:52.846392446Z } file = sled-agent/src/instance.rs:842 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28152025-02-28T02:20:52.846ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-02-28T02:20:52.846392446Z } propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28162025-02-28T02:20:52.846ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28172025-02-28T02:20:52.846ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28182025-02-28T02:20:52.847ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28192025-02-28T02:20:52.847ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/8bbd7b1a-3a9d-4082-9365-c7fb79577908/debug/bundle/zone", "/pool/int/ca68e244-d998-48e2-aae1-cc4418d41537/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/b3a87d4a-d86a-4868-ad38-fc879461da99/crypt/debug", "/pool/ext/cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crypt/debug", "/pool/ext/4888f2e4-7bea-4a2f-8f7b-a5b5f93f9cd2/crypt/debug", "/pool/ext/7ae93100-6078-4f36-b916-7ea04312348c/crypt/debug", "/pool/ext/96d00a6f-2f4d-4b13-a75f-c89809dc380a/crypt/debug", "/pool/ext/56271d63-ce52-4a9a-beca-d66806dddbb3/crypt/debug", "/pool/ext/55ae14e7-5a6e-4245-98d6-55cf62789803/crypt/debug", "/pool/ext/81fb17c7-22e5-4138-98cb-7b91dded8807/crypt/debug", "/pool/ext/eda0a87a-f705-4947-9fe8-b01f3de48adf/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918
28202025-02-28T02:20:53.493ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918", bundle_id: 9b0e31b5-575c-4e27-b752-cf5077b2bac8 }, time_created: 2025-02-28T02:20:52.848528786Z, version: 0, cause: TerminatedInstance }
28212025-02-28T02:20:53.493ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_78d4c35e-c830-45d3-9f27-ee45e3d97918 file = sled-agent/src/instance.rs:1376 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28222025-02-28T02:20:55.273ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28232025-02-28T02:20:55.291ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(5667615), kind: System }
28242025-02-28T02:20:55.291ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(5667615), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28252025-02-28T02:20:55.291ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T02:20:55.291718179Z }, migration_in: None, migration_out: None }
28262025-02-28T02:20:55.314ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T02:20:55.291718179Z }, migration_in: None, migration_out: None }
28272025-02-28T02:20:55.319ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = 2a6ffa25-2475-427b-a505-7b603f28d9af propolis_id = 78d4c35e-c830-45d3-9f27-ee45e3d97918
28282025-02-28T02:20:55.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55449
28292025-02-28T02:20:55.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55449 req_id = 7a1cc8d6-2b18-4c45-8170-9042036e76d2 response_code = 200 uri = /vpc-routes
28302025-02-28T02:20:55.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {84bdb226-4c9a-426a-98d7-6b58637abfb6: {10.151.1.176: {d9d0ffb0-974f-4d73-81c6-46d9fcaf6fc3}, 10.151.1.175: {d9d0ffb0-974f-4d73-81c6-46d9fcaf6fc3}}} }
28312025-02-28T02:20:55.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55449 req_id = 29135e9e-ffa3-4def-aec9-0fbc7694f0bc response_code = 204 uri = /eip-gateways
28322025-02-28T02:20:55.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56797
28332025-02-28T02:20:55.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56797 req_id = 5b030f1a-9f44-4b0e-8808-216ed00b5b10 response_code = 200 uri = /v2p
28342025-02-28T02:20:55.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55449 req_id = 30ad7140-b3c9-4140-9375-fd4b4a5b060b response_code = 204 uri = /vpc-routes
28352025-02-28T02:20:55.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46029
28362025-02-28T02:20:55.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46029 req_id = cc1321ba-ae3e-4f38-94db-8766fcd55c35 response_code = 200 uri = /v2p
28372025-02-28T02:20:56.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52079
28382025-02-28T02:20:56.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52079 req_id = ee1903cd-3f81-437d-aee2-434e03f320d2 response_code = 200 uri = /vpc-routes
28392025-02-28T02:20:56.054ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
28402025-02-28T02:20:56.054ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01
28412025-02-28T02:20:56.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52079 req_id = 2716d9e2-2def-496b-b393-9d7f1e5ed0c3 response_code = 204 uri = /eip-gateways
28422025-02-28T02:20:56.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52079 req_id = ec123a8c-b71b-497e-bc87-b5736df6cf17 response_code = 204 uri = /vpc-routes
28432025-02-28T02:20:56.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61135
28442025-02-28T02:20:56.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61135 req_id = 2c3d7a24-7f2d-45a8-8273-97e10777e6dd response_code = 200 uri = /vpc-routes
28452025-02-28T02:20:56.704ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = f5279127-f12d-4326-a7e5-d07a518dbb01 values = ExternalIpGatewayMap { mappings: {} }
28462025-02-28T02:20:56.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61135 req_id = ed1736ca-443c-4a9b-93d1-518506020e65 response_code = 204 uri = /eip-gateways
28472025-02-28T02:20:56.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.15.1/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61135 req_id = 2f9c3000-9261-4321-9c51-a15ce8e7e569 response_code = 204 uri = /vpc-routes