Max level shown:
1 [ Mar 2 04:53:36 Enabled. ]
2 [ Mar 2 04:53:36 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Mar 2 04:53:36 Method "start" exited with status 0. ]
4 [ Mar 2 04:53:36 Rereading configuration. ]
5 [ Mar 2 04:53:36 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-03-02T04:53:36.179ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-03-02T04:53:36.180ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:294
92025-03-02T04:53:36.233ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:301
102025-03-02T04:53:36.233ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-03-02T04:53:36.345ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-03-02T04:53:36.355ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-03-02T04:53:36.362ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:311 path = /var/run/oxide/
142025-03-02T04:53:36.969ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/pre_server.rs:105 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-03-02T04:53:37.109ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-03-02T04:53:37.109ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-03-02T04:53:37.109ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-03-02T04:53:37.109ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-03-02T04:53:37.109ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-03-02T04:53:37.109ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-03-02T04:53:37.112ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-03-02T04:53:37.112ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-03-02T04:53:37.112ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-03-02T04:53:37.113ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-03-02T04:53:37.113ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-03-02T04:53:37.113ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-03-02T04:53:37.113ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-03-02T04:53:37.113ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-03-02T04:53:37.113ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-03-02T04:53:37.125ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-03-02T04:53:37.125ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool)
322025-03-02T04:53:37.222ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal }
332025-03-02T04:53:37.589ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-03-02T04:53:37.589ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-03-02T04:53:37.589ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-03-02T04:53:37.589ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-03-02T04:53:37.589ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-03-02T04:53:37.589ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-03-02T04:53:37.589ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-03-02T04:53:37.598ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-03-02T04:53:37.598ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 137ad444-dc66-45be-a069-b93fb154c65f (zpool)
422025-03-02T04:53:37.686ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal }
432025-03-02T04:53:38.049ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-03-02T04:53:38.049ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-03-02T04:53:38.049ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-03-02T04:53:38.049ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-03-02T04:53:38.049ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-03-02T04:53:38.049ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-03-02T04:53:38.049ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
522025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542025-03-02T04:53:38.049ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-03-02T04:53:38.049ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
562025-03-02T04:53:38.049ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
572025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-03-02T04:53:38.049ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-03-02T04:53:38.049ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-03-02T04:53:38.049ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-03-02T04:53:38.049ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-03-02T04:53:38.049ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-03-02T04:53:38.049ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-03-02T04:53:38.049ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-03-02T04:53:38.049ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-03-02T04:53:38.049ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-03-02T04:53:38.049ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-03-02T04:53:38.049ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-03-02T04:53:38.049ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-03-02T04:53:38.049ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-03-02T04:53:38.049ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-03-02T04:53:38.049ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-03-02T04:53:38.049ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-03-02T04:53:38.049ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822025-03-02T04:53:38.049ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
832025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-03-02T04:53:38.049ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-03-02T04:53:38.049ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872025-03-02T04:53:38.049ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
882025-03-02T04:53:38.049ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-03-02T04:53:38.049ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-03-02T04:53:38.049ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952025-03-02T04:53:38.049ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962025-03-02T04:53:38.049ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972025-03-02T04:53:38.049ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-03-02T04:53:38.049ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-03-02T04:53:38.049ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-03-02T04:53:38.049ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-03-02T04:53:38.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-03-02T04:53:38.049ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-03-02T04:53:38.049ZINFOSledAgent (bootstore): No ledger in /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-03-02T04:53:38.049ZINFOSledAgent (bootstore): No ledger in /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-03-02T04:53:38.049ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-03-02T04:53:38.049ZINFOSledAgent (bootstore): No ledger in /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-03-02T04:53:38.049ZINFOSledAgent (bootstore): No ledger in /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-03-02T04:53:38.049ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-03-02T04:53:38.049ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-03-02T04:53:38.049ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-03-02T04:53:38.061ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:793
1132025-03-02T04:53:38.061ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3546, tv_nsec: 829073919 } time_to_next_cleanup = 599.999925019s
1142025-03-02T04:53:38.061ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
1152025-03-02T04:53:38.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-03-02T04:53:38.063ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-03-02T04:53:38.064ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-03-02T04:53:38.064ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-03-02T04:53:38.066ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-03-02T04:53:38.066ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1191
1212025-03-02T04:53:38.066ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-03-02T04:53:38.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-03-02T04:53:38.066ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-03-02T04:53:38.066ZINFOSledAgent (RSS): No ledger in /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/rss-started.marker file = common/src/ledger.rs:188
1252025-03-02T04:53:38.066ZINFOSledAgent (RSS): No ledger in /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/rss-started.marker file = common/src/ledger.rs:188
1262025-03-02T04:53:38.066ZINFOSledAgent (RSS): No ledger in /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-03-02T04:53:38.066ZINFOSledAgent (RSS): No ledger in /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-03-02T04:53:38.066ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1240
1292025-03-02T04:53:38.066ZINFOSledAgent (RSS): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-03-02T04:53:38.066ZINFOSledAgent (RSS): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-03-02T04:53:38.067ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1272
1322025-03-02T04:53:38.067ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-03-02T04:53:38.067ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-03-02T04:53:38.067ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1303
1352025-03-02T04:53:38.067ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-03-02T04:53:38.067ZINFOSledAgent (bootstore): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-03-02T04:53:38.067ZINFOSledAgent (bootstore): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-03-02T04:53:38.067ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-03-02T04:53:38.067ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: fee17c45-a85b-405f-9e58-2ca0ab03dea9 (sled), rack_id: d6094382-b327-4998-b53d-b2d98a53005b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-03-02T04:53:38.067ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4353
1412025-03-02T04:53:38.067ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4759
1422025-03-02T04:53:38.072ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1432025-03-02T04:53:38.078ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1442025-03-02T04:53:38.078ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1452025-03-02T04:53:38.082ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-03-02T04:53:38.082ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-03-02T04:53:38.085ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:34079
1482025-03-02T04:53:38.085ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: fee17c45-a85b-405f-9e58-2ca0ab03dea9 (sled), rack_id: d6094382-b327-4998-b53d-b2d98a53005b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:366
1492025-03-02T04:53:38.085ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:381
1502025-03-02T04:53:38.085ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-03-02T04:53:38.085ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-03-02T04:53:38.085ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-03-02T04:53:38.085ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-03-02T04:53:38.085ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:422 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-03-02T04:53:38.085ZINFOSledAgent (StorageManager): No ledger in /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-03-02T04:53:38.085ZINFOSledAgent (StorageManager): No ledger in /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-03-02T04:53:38.085ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-03-02T04:53:38.085ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-03-02T04:53:38.085ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-03-02T04:53:38.085ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-03-02T04:53:38.085ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-03-02T04:53:38.096ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-03-02T04:53:38.114ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-03-02T04:53:38.131ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-03-02T04:53:38.145ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
1662025-03-02T04:53:38.145ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-03-02T04:53:38.145ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
1682025-03-02T04:53:38.145ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d6094382-b327-4998-b53d-b2d98a53005b, sled_id: fee17c45-a85b-405f-9e58-2ca0ab03dea9 }
1692025-03-02T04:53:38.148ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1fd45c15-f4eb-4df4-929d-474589dfa0bf", "content-length": "124", "date": "Sun, 02 Mar 2025 04:53:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1fd45c15-f4eb-4df4-929d-474589dfa0bf" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 103.990882ms
1702025-03-02T04:53:38.158ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_31981b9f-a8b9-4039-bebc-cee38cd23b26/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-03-02T04:53:38.182ZINFOSledAgent: successfully created encrypted zvol: name="oxi_31981b9f-a8b9-4039-bebc-cee38cd23b26/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-03-02T04:53:38.182ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_31981b9f-a8b9-4039-bebc-cee38cd23b26/swap" file = sled-agent/src/swap_device.rs:96
1732025-03-02T04:53:38.187ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
1742025-03-02T04:53:38.187ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-03-02T04:53:38.187ZINFOSledAgent (BackingFs): Ensuring dataset oxi_31981b9f-a8b9-4039-bebc-cee38cd23b26/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-03-02T04:53:38.253ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d6094382-b327-4998-b53d-b2d98a53005b, sled_id: fee17c45-a85b-405f-9e58-2ca0ab03dea9 }
1772025-03-02T04:53:38.253ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b73a00d2-76a6-47df-abc6-6d3bf908baf6", "content-length": "124", "date": "Sun, 02 Mar 2025 04:53:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b73a00d2-76a6-47df-abc6-6d3bf908baf6" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 171.412762ms
1782025-03-02T04:53:38.255ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-03-02T04:53:38.426ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d6094382-b327-4998-b53d-b2d98a53005b, sled_id: fee17c45-a85b-405f-9e58-2ca0ab03dea9 }
1802025-03-02T04:53:38.427ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fe3ec1e2-2b02-4c1d-93ea-a0c017b7d496", "content-length": "124", "date": "Sun, 02 Mar 2025 04:53:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fe3ec1e2-2b02-4c1d-93ea-a0c017b7d496" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 166.936711ms
1812025-03-02T04:53:38.474ZINFOSledAgent (BackingFs): Mounting oxi_31981b9f-a8b9-4039-bebc-cee38cd23b26/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-03-02T04:53:38.486ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-03-02T04:53:38.486ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-03-02T04:53:38.486ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-03-02T04:53:38.486ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-03-02T04:53:38.595ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d6094382-b327-4998-b53d-b2d98a53005b, sled_id: fee17c45-a85b-405f-9e58-2ca0ab03dea9 }
1872025-03-02T04:53:38.596ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "06f9b4eb-e48c-4d98-9ec4-fcbc30ef4096", "content-length": "124", "date": "Sun, 02 Mar 2025 04:53:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "06f9b4eb-e48c-4d98-9ec4-fcbc30ef4096" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 174.384337ms
1882025-03-02T04:53:38.771ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d6094382-b327-4998-b53d-b2d98a53005b, sled_id: fee17c45-a85b-405f-9e58-2ca0ab03dea9 }
1892025-03-02T04:53:38.771ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c3f0e359-9688-41c8-bc8a-cbf1592717e4", "content-length": "124", "date": "Sun, 02 Mar 2025 04:53:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c3f0e359-9688-41c8-bc8a-cbf1592717e4" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 235.384517ms
1902025-03-02T04:53:39.008ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d6094382-b327-4998-b53d-b2d98a53005b, sled_id: fee17c45-a85b-405f-9e58-2ca0ab03dea9 }
1912025-03-02T04:53:39.008ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e2e1eaca-0a11-4f05-a405-3623b1f8d0f7", "content-length": "124", "date": "Sun, 02 Mar 2025 04:53:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e2e1eaca-0a11-4f05-a405-3623b1f8d0f7" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 148.20617ms
1922025-03-02T04:53:39.157ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d6094382-b327-4998-b53d-b2d98a53005b, sled_id: fee17c45-a85b-405f-9e58-2ca0ab03dea9 }
1932025-03-02T04:53:39.158ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5cd64565-4b76-4d9e-ac53-61349b2a9b75", "content-length": "124", "date": "Sun, 02 Mar 2025 04:53:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5cd64565-4b76-4d9e-ac53-61349b2a9b75" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 439.560626ms
1942025-03-02T04:53:39.227ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
1952025-03-02T04:53:39.232ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:41054 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
1962025-03-02T04:53:39.232ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
1972025-03-02T04:53:39.232ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:41054 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
1982025-03-02T04:53:39.233ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 260.178416ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
1992025-03-02T04:53:39.234ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2002025-03-02T04:53:39.234ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2012025-03-02T04:53:39.235ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:977 underlay_address = fd00:1122:3344:101::1
2022025-03-02T04:53:39.235ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-03-02T04:53:39.495ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 266.67026ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2042025-03-02T04:53:39.598ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: d6094382-b327-4998-b53d-b2d98a53005b, sled_id: fee17c45-a85b-405f-9e58-2ca0ab03dea9 }
2052025-03-02T04:53:39.763ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 627.09436ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2062025-03-02T04:53:40.392ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.616660934s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2072025-03-02T04:53:42.212ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2787
2082025-03-02T04:53:42.212ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:3015
2092025-03-02T04:53:42.212ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2657
2102025-03-02T04:53:42.212ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2704
2112025-03-02T04:53:42.212ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3096
2122025-03-02T04:53:42.212ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3141
2132025-03-02T04:53:42.214ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2923
2142025-03-02T04:53:42.215ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2698
2152025-03-02T04:53:42.215ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='82eb71c7-b95c-4ddf-ad29-cdb1ecd3ea7f'/> <propval type="astring" name="rack_id" value='d6094382-b327-4998-b53d-b2d98a53005b'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fef0:3d27'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='d6094382-b327-4998-b53d-b2d98a53005b'/> <propval type="astring" name="sled_id" value='fee17c45-a85b-405f-9e58-2ca0ab03dea9'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='d6094382-b327-4998-b53d-b2d98a53005b'/> <propval type="astring" name="sled_id" value='fee17c45-a85b-405f-9e58-2ca0ab03dea9'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='fee17c45-a85b-405f-9e58-2ca0ab03dea9'/> <propval type="astring" name="rack_uuid" value='d6094382-b327-4998-b53d-b2d98a53005b'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='fee17c45-a85b-405f-9e58-2ca0ab03dea9'/> <propval type="astring" name="rack_uuid" value='d6094382-b327-4998-b53d-b2d98a53005b'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-03-02T04:53:42.215ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_switch
2172025-03-02T04:53:42.526ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 73.832275ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-03-02T04:53:42.742ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 118.930929ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-03-02T04:53:42.922ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 101.731848ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-03-02T04:53:43.011ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.955248455s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2212025-03-02T04:53:43.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 511.856303ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-03-02T04:53:43.898ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.124229482s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-03-02T04:53:45.036ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 943.710684ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-03-02T04:53:46.201ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.0137049s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-03-02T04:53:47.352ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.394096994s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2262025-03-02T04:53:49.100ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.653066447s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2272025-03-02T04:53:49.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2282025-03-02T04:53:49.138ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2292025-03-02T04:53:49.139ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2302025-03-02T04:53:49.139ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:495
2312025-03-02T04:53:49.139ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322025-03-02T04:53:49.139ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-03-02T04:53:49.140ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-03-02T04:53:49.140ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352025-03-02T04:53:49.140ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362025-03-02T04:53:49.140ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
2372025-03-02T04:53:49.140ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:34079
2382025-03-02T04:53:49.327ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2392025-03-02T04:53:49.327ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2402025-03-02T04:53:49.328ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12680823185059767592 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2412025-03-02T04:53:49.328ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8433966563301122876 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2422025-03-02T04:53:49.332ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4377 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2432025-03-02T04:53:49.332ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4393
2442025-03-02T04:53:49.332ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:535 zone = oxz_switch
2452025-03-02T04:53:49.544ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2462025-03-02T04:53:49.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50041
2472025-03-02T04:53:49.574ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2482025-03-02T04:53:49.574ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2492025-03-02T04:53:49.574ZINFOSledAgent (ServiceManager): No ledger in /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-zones.json file = common/src/ledger.rs:188
2502025-03-02T04:53:49.574ZINFOSledAgent (ServiceManager): No ledger in /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-zones.json file = common/src/ledger.rs:188
2512025-03-02T04:53:49.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50041 req_id = e657ec16-6735-40c4-b7b7-0c44f3f370d2 response_code = 200 uri = /inventory
2522025-03-02T04:53:49.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48293
2532025-03-02T04:53:49.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48293 req_id = 11af1368-3c86-445d-ac8f-ad15f82c06b9 response_code = 200 uri = /sled-role
2542025-03-02T04:53:49.638ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0b5e9641-9278-4cef-8c3d-d119385fefce (physical_disk), pool_id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 15ec6db0-c8c5-447d-9cfc-2f75d0024f3a (physical_disk), pool_id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 3c010cf2-0820-4a06-b2ef-840a84312793 (physical_disk), pool_id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 45f76322-dc16-447e-9c66-4a602dec690f (physical_disk), pool_id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 768f02b4-940c-4371-adfb-7f5b9d96901f (physical_disk), pool_id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a07f7914-bd89-46cf-9e9b-128543ab97d7 (physical_disk), pool_id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: a23d27e2-25a6-4e76-a467-e6d3ed1a2482 (physical_disk), pool_id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: bb3eef43-225b-4ee9-954f-9b396c420692 (physical_disk), pool_id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d85e637a-ec3d-49ad-a0f3-2ab779663ca1 (physical_disk), pool_id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:386 sled_address = [fd00:1122:3344:101::1]:12345
2552025-03-02T04:53:49.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51761
2562025-03-02T04:53:49.638ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2572025-03-02T04:53:49.638ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0b5e9641-9278-4cef-8c3d-d119385fefce (physical_disk), pool_id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 15ec6db0-c8c5-447d-9cfc-2f75d0024f3a (physical_disk), pool_id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 3c010cf2-0820-4a06-b2ef-840a84312793 (physical_disk), pool_id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 45f76322-dc16-447e-9c66-4a602dec690f (physical_disk), pool_id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 768f02b4-940c-4371-adfb-7f5b9d96901f (physical_disk), pool_id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a07f7914-bd89-46cf-9e9b-128543ab97d7 (physical_disk), pool_id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: a23d27e2-25a6-4e76-a467-e6d3ed1a2482 (physical_disk), pool_id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: bb3eef43-225b-4ee9-954f-9b396c420692 (physical_disk), pool_id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d85e637a-ec3d-49ad-a0f3-2ab779663ca1 (physical_disk), pool_id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2582025-03-02T04:53:49.638ZINFOSledAgent (StorageManager): No ledger in /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2592025-03-02T04:53:49.638ZINFOSledAgent (StorageManager): No ledger in /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602025-03-02T04:53:49.638ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2612025-03-02T04:53:49.638ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2622025-03-02T04:53:49.638ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2632025-03-02T04:53:49.638ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2642025-03-02T04:53:49.638ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2652025-03-02T04:53:49.649ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2662025-03-02T04:53:49.649ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool)
2672025-03-02T04:53:49.746ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }
2682025-03-02T04:53:49.754ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2692025-03-02T04:53:49.754ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2702025-03-02T04:53:49.754ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2712025-03-02T04:53:49.754ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2722025-03-02T04:53:49.754ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-03-02T04:53:49.754ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742025-03-02T04:53:49.754ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2752025-03-02T04:53:49.789ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2762025-03-02T04:53:49.797ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crypt/zone file = sled-storage/src/dataset.rs:302
2772025-03-02T04:53:49.935ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 file = sled-storage/src/dataset.rs:388
2782025-03-02T04:53:49.943ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792025-03-02T04:53:49.943ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802025-03-02T04:53:49.943ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812025-03-02T04:53:49.943ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822025-03-02T04:53:49.943ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832025-03-02T04:53:49.953ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842025-03-02T04:53:49.953ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool)
2852025-03-02T04:53:50.052ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }
2862025-03-02T04:53:50.061ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2872025-03-02T04:53:50.061ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2882025-03-02T04:53:50.061ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2892025-03-02T04:53:50.061ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2902025-03-02T04:53:50.061ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-03-02T04:53:50.061ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-03-02T04:53:50.061ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2932025-03-02T04:53:50.094ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942025-03-02T04:53:50.102ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone file = sled-storage/src/dataset.rs:302
2952025-03-02T04:53:50.140ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fee17c45-a85b-405f-9e58-2ca0ab03dea9) file = sled-agent/src/probe_manager.rs:238 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
2962025-03-02T04:53:50.242ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6 file = sled-storage/src/dataset.rs:388
2972025-03-02T04:53:50.250ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982025-03-02T04:53:50.250ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992025-03-02T04:53:50.250ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002025-03-02T04:53:50.250ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012025-03-02T04:53:50.250ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022025-03-02T04:53:50.259ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032025-03-02T04:53:50.259ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool)
3042025-03-02T04:53:50.351ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }
3052025-03-02T04:53:50.359ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3062025-03-02T04:53:50.359ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3072025-03-02T04:53:50.359ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3082025-03-02T04:53:50.359ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3092025-03-02T04:53:50.359ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-03-02T04:53:50.359ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112025-03-02T04:53:50.359ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3122025-03-02T04:53:50.395ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132025-03-02T04:53:50.403ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe/crypt/zone file = sled-storage/src/dataset.rs:302
3142025-03-02T04:53:50.540ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe file = sled-storage/src/dataset.rs:388
3152025-03-02T04:53:50.548ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162025-03-02T04:53:50.548ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172025-03-02T04:53:50.548ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182025-03-02T04:53:50.548ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192025-03-02T04:53:50.548ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202025-03-02T04:53:50.558ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212025-03-02T04:53:50.558ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool)
3222025-03-02T04:53:50.646ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }
3232025-03-02T04:53:50.653ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3242025-03-02T04:53:50.653ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3252025-03-02T04:53:50.653ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3262025-03-02T04:53:50.653ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3272025-03-02T04:53:50.653ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-03-02T04:53:50.653ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292025-03-02T04:53:50.653ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3302025-03-02T04:53:50.688ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312025-03-02T04:53:50.695ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/zone file = sled-storage/src/dataset.rs:302
3322025-03-02T04:53:50.823ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c file = sled-storage/src/dataset.rs:388
3332025-03-02T04:53:50.830ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342025-03-02T04:53:50.830ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352025-03-02T04:53:50.830ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362025-03-02T04:53:50.830ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372025-03-02T04:53:50.830ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382025-03-02T04:53:50.839ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392025-03-02T04:53:50.839ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool)
3402025-03-02T04:53:50.931ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }
3412025-03-02T04:53:50.939ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3422025-03-02T04:53:50.939ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3432025-03-02T04:53:50.939ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3442025-03-02T04:53:50.939ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3452025-03-02T04:53:50.939ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-03-02T04:53:50.939ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472025-03-02T04:53:50.939ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3482025-03-02T04:53:50.973ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492025-03-02T04:53:50.981ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db/crypt/zone file = sled-storage/src/dataset.rs:302
3502025-03-02T04:53:51.126ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db file = sled-storage/src/dataset.rs:388
3512025-03-02T04:53:51.133ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522025-03-02T04:53:51.133ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532025-03-02T04:53:51.134ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542025-03-02T04:53:51.134ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552025-03-02T04:53:51.134ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562025-03-02T04:53:51.143ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572025-03-02T04:53:51.143ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool)
3582025-03-02T04:53:51.240ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }
3592025-03-02T04:53:51.248ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3602025-03-02T04:53:51.248ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3612025-03-02T04:53:51.248ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3622025-03-02T04:53:51.248ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3632025-03-02T04:53:51.248ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-03-02T04:53:51.248ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-03-02T04:53:51.248ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3662025-03-02T04:53:51.252ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fee17c45-a85b-405f-9e58-2ca0ab03dea9) file = sled-agent/src/probe_manager.rs:238 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
3672025-03-02T04:53:51.284ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682025-03-02T04:53:51.292ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_02f51c32-d098-4db1-aebc-508861ba7b69/crypt/zone file = sled-storage/src/dataset.rs:302
3692025-03-02T04:53:51.434ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_02f51c32-d098-4db1-aebc-508861ba7b69 file = sled-storage/src/dataset.rs:388
3702025-03-02T04:53:51.442ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712025-03-02T04:53:51.442ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722025-03-02T04:53:51.442ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732025-03-02T04:53:51.442ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742025-03-02T04:53:51.442ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752025-03-02T04:53:51.452ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762025-03-02T04:53:51.452ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool)
3772025-03-02T04:53:51.549ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }
3782025-03-02T04:53:51.557ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3792025-03-02T04:53:51.557ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3802025-03-02T04:53:51.557ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3812025-03-02T04:53:51.557ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3822025-03-02T04:53:51.557ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-03-02T04:53:51.557ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842025-03-02T04:53:51.558ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3852025-03-02T04:53:51.594ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862025-03-02T04:53:51.602ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone file = sled-storage/src/dataset.rs:302
3872025-03-02T04:53:51.742ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6172af12-6fa7-4d40-b551-2b1c147126ca file = sled-storage/src/dataset.rs:388
3882025-03-02T04:53:51.751ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892025-03-02T04:53:51.751ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902025-03-02T04:53:51.751ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912025-03-02T04:53:51.751ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922025-03-02T04:53:51.751ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932025-03-02T04:53:51.760ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942025-03-02T04:53:51.760ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool)
3952025-03-02T04:53:51.861ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }
3962025-03-02T04:53:51.870ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3972025-03-02T04:53:51.870ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3982025-03-02T04:53:51.870ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3992025-03-02T04:53:51.870ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4002025-03-02T04:53:51.870ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-03-02T04:53:51.870ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022025-03-02T04:53:51.870ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4032025-03-02T04:53:51.907ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042025-03-02T04:53:51.915ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone file = sled-storage/src/dataset.rs:302
4052025-03-02T04:53:52.063ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_59d556b1-49a0-4ea6-b384-37f0944c2057 file = sled-storage/src/dataset.rs:388
4062025-03-02T04:53:52.070ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072025-03-02T04:53:52.070ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082025-03-02T04:53:52.070ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092025-03-02T04:53:52.070ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102025-03-02T04:53:52.070ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112025-03-02T04:53:52.080ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122025-03-02T04:53:52.080ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool)
4132025-03-02T04:53:52.194ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }
4142025-03-02T04:53:52.203ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4152025-03-02T04:53:52.203ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4162025-03-02T04:53:52.203ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4172025-03-02T04:53:52.203ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4182025-03-02T04:53:52.203ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192025-03-02T04:53:52.203ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-03-02T04:53:52.203ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4212025-03-02T04:53:52.244ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222025-03-02T04:53:52.252ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/zone file = sled-storage/src/dataset.rs:302
4232025-03-02T04:53:52.255ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fee17c45-a85b-405f-9e58-2ca0ab03dea9) file = sled-agent/src/probe_manager.rs:238 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
4242025-03-02T04:53:52.395ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505 file = sled-storage/src/dataset.rs:388
4252025-03-02T04:53:52.404ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262025-03-02T04:53:52.404ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272025-03-02T04:53:52.404ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282025-03-02T04:53:52.404ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 31981b9f-a8b9-4039-bebc-cee38cd23b26 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 137ad444-dc66-45be-a069-b93fb154c65f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292025-03-02T04:53:52.404ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302025-03-02T04:53:52.404ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312025-03-02T04:53:52.404ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322025-03-02T04:53:52.404ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
4332025-03-02T04:53:52.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342025-03-02T04:53:52.404ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
4352025-03-02T04:53:52.404ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
4362025-03-02T04:53:52.404ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
4372025-03-02T04:53:52.404ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
4382025-03-02T04:53:52.404ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
4392025-03-02T04:53:52.404ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402025-03-02T04:53:52.404ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
4412025-03-02T04:53:52.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2766320 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51761 req_id = 00f9e7bb-bf9b-41d8-873b-60c784b4af67 response_code = 200 uri = /omicron-physical-disks
4422025-03-02T04:53:52.437ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0c1c5b49-ca28-4a8d-8f00-080ccefedcbe (dataset): DatasetConfig { id: 0c1c5b49-ca28-4a8d-8f00-080ccefedcbe (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f638f9f-636f-44e3-b86f-2114651205c5 (dataset): DatasetConfig { id: 0f638f9f-636f-44e3-b86f-2114651205c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11e0fc27-9d2a-47be-9765-444341c1ed34 (dataset): DatasetConfig { id: 11e0fc27-9d2a-47be-9765-444341c1ed34 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 167eb722-3f69-4049-81de-aec4db147c5b (dataset): DatasetConfig { id: 167eb722-3f69-4049-81de-aec4db147c5b (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e7a65d9-807e-4ec7-860b-dc2eb4833c9d (dataset): DatasetConfig { id: 1e7a65d9-807e-4ec7-860b-dc2eb4833c9d (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2074e898-0016-41a4-b74d-ea8ba9ecd5c9 (dataset): DatasetConfig { id: 2074e898-0016-41a4-b74d-ea8ba9ecd5c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20f23c5a-d74d-4533-aaec-c48f2c45722c (dataset): DatasetConfig { id: 20f23c5a-d74d-4533-aaec-c48f2c45722c (dataset), name: DatasetName { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 236f6fb8-824d-4dfb-8236-fc4fe5e24726 (dataset): DatasetConfig { id: 236f6fb8-824d-4dfb-8236-fc4fe5e24726 (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33683353-7506-4fd1-9f56-22bb6128ddaa (dataset): DatasetConfig { id: 33683353-7506-4fd1-9f56-22bb6128ddaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 34d6d360-73ba-4589-a91e-4ec301136eb5 (dataset): DatasetConfig { id: 34d6d360-73ba-4589-a91e-4ec301136eb5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 376849c7-f43f-4b79-9b16-a69935caee18 (dataset): DatasetConfig { id: 376849c7-f43f-4b79-9b16-a69935caee18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3aa03789-7db6-47df-8b26-db1b0b3db401 (dataset): DatasetConfig { id: 3aa03789-7db6-47df-8b26-db1b0b3db401 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b56afa1-a7d6-47ad-aa10-1b78189645c7 (dataset): DatasetConfig { id: 3b56afa1-a7d6-47ad-aa10-1b78189645c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e255103-7d68-41fd-af33-10a480376047 (dataset): DatasetConfig { id: 3e255103-7d68-41fd-af33-10a480376047 (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 423401b3-cc16-44de-b9d9-205bc3341bba (dataset): DatasetConfig { id: 423401b3-cc16-44de-b9d9-205bc3341bba (dataset), name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47cc37a3-8a3f-4b94-b342-47a4c6335fc0 (dataset): DatasetConfig { id: 47cc37a3-8a3f-4b94-b342-47a4c6335fc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47ed4f86-5455-4e3e-b43d-8ed5a68be45c (dataset): DatasetConfig { id: 47ed4f86-5455-4e3e-b43d-8ed5a68be45c (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f12d3e1-b4c5-49f1-9a70-c4cfd9be7105 (dataset): DatasetConfig { id: 4f12d3e1-b4c5-49f1-9a70-c4cfd9be7105 (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 541c854c-f076-496b-9801-36b7fe28891c (dataset): DatasetConfig { id: 541c854c-f076-496b-9801-36b7fe28891c (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 574e975a-4ff8-4766-b215-b3d07734f282 (dataset): DatasetConfig { id: 574e975a-4ff8-4766-b215-b3d07734f282 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 575d1177-75df-441f-a914-dc303d7a5017 (dataset): DatasetConfig { id: 575d1177-75df-441f-a914-dc303d7a5017 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5813e4f3-8486-4ba7-8784-14f7772c2e67 (dataset): DatasetConfig { id: 5813e4f3-8486-4ba7-8784-14f7772c2e67 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bce1b1a-0977-465a-927a-4d7e13c1ecd4 (dataset): DatasetConfig { id: 5bce1b1a-0977-465a-927a-4d7e13c1ecd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61f9ac5e-42a3-4496-a2e0-76e7e38e18e3 (dataset): DatasetConfig { id: 61f9ac5e-42a3-4496-a2e0-76e7e38e18e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63aa67da-d6c1-4f7c-bb81-b0ae4a446988 (dataset): DatasetConfig { id: 63aa67da-d6c1-4f7c-bb81-b0ae4a446988 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 682c08de-1ece-4542-9b86-13b1f67fb17f (dataset): DatasetConfig { id: 682c08de-1ece-4542-9b86-13b1f67fb17f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 69d8ab5a-287c-42cc-bfa2-a1db5066d7b2 (dataset): DatasetConfig { id: 69d8ab5a-287c-42cc-bfa2-a1db5066d7b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c2330f8-1508-4759-9200-c68e23d799e7 (dataset): DatasetConfig { id: 6c2330f8-1508-4759-9200-c68e23d799e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7225230f-d65c-4d41-9cb9-060f8844df9c (dataset): DatasetConfig { id: 7225230f-d65c-4d41-9cb9-060f8844df9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 729bca48-1488-4036-a8eb-b8e61d20fbf7 (dataset): DatasetConfig { id: 729bca48-1488-4036-a8eb-b8e61d20fbf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7338f993-a52d-47b3-9abd-cd19d70c590d (dataset): DatasetConfig { id: 7338f993-a52d-47b3-9abd-cd19d70c590d (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7673823e-8687-45a9-8d33-a58b4c9b58cc (dataset): DatasetConfig { id: 7673823e-8687-45a9-8d33-a58b4c9b58cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7dfae396-ef73-4f66-a1ca-f385ebb802a9 (dataset): DatasetConfig { id: 7dfae396-ef73-4f66-a1ca-f385ebb802a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83161b7f-eee1-4657-90d7-3239e21e154f (dataset): DatasetConfig { id: 83161b7f-eee1-4657-90d7-3239e21e154f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84ac11d6-96e1-4632-9568-deae99c0d776 (dataset): DatasetConfig { id: 84ac11d6-96e1-4632-9568-deae99c0d776 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8501c442-24e2-4c91-a319-262140262421 (dataset): DatasetConfig { id: 8501c442-24e2-4c91-a319-262140262421 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 858c21ad-eb3c-45ef-8915-211929e48fe8 (dataset): DatasetConfig { id: 858c21ad-eb3c-45ef-8915-211929e48fe8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 937cdc2e-bf0b-4c6a-9a07-de4294fabfce (dataset): DatasetConfig { id: 937cdc2e-bf0b-4c6a-9a07-de4294fabfce (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 942d38ff-5cdf-4ec6-b65f-b51c74025003 (dataset): DatasetConfig { id: 942d38ff-5cdf-4ec6-b65f-b51c74025003 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98ad9a0a-3f3a-485d-bef9-46644d7a9dac (dataset): DatasetConfig { id: 98ad9a0a-3f3a-485d-bef9-46644d7a9dac (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9feeeba7-f43b-4634-824d-ac2edcc60bfb (dataset): DatasetConfig { id: 9feeeba7-f43b-4634-824d-ac2edcc60bfb (dataset), name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a4a408ae-12d6-431e-9914-3ad8a9e158ed (dataset): DatasetConfig { id: a4a408ae-12d6-431e-9914-3ad8a9e158ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8b211e0-8ed0-4782-adda-5d843d5a8a65 (dataset): DatasetConfig { id: a8b211e0-8ed0-4782-adda-5d843d5a8a65 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad5deea0-3cd7-4224-896f-683906950b22 (dataset): DatasetConfig { id: ad5deea0-3cd7-4224-896f-683906950b22 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2e20c28-2510-4584-bd25-074151c0b35e (dataset): DatasetConfig { id: b2e20c28-2510-4584-bd25-074151c0b35e (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b791e07a-2663-43d0-88fb-3c6a22a4aef8 (dataset): DatasetConfig { id: b791e07a-2663-43d0-88fb-3c6a22a4aef8 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd0af4fc-5689-4ec8-9d4b-c8a0dfe14aa7 (dataset): DatasetConfig { id: bd0af4fc-5689-4ec8-9d4b-c8a0dfe14aa7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3b9a7d5-43eb-486e-8ac6-7190843778bb (dataset): DatasetConfig { id: c3b9a7d5-43eb-486e-8ac6-7190843778bb (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c615ea69-6e80-4ceb-ab7c-8b2e4d8b1f40 (dataset): DatasetConfig { id: c615ea69-6e80-4ceb-ab7c-8b2e4d8b1f40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c62c6ec8-6289-433b-b841-22a286bfa2ec (dataset): DatasetConfig { id: c62c6ec8-6289-433b-b841-22a286bfa2ec (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9892d92-1ee1-438a-9ea3-0f52a56d32fd (dataset): DatasetConfig { id: c9892d92-1ee1-438a-9ea3-0f52a56d32fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d1815ca3-2407-4ad3-8363-418565cf05e3 (dataset): DatasetConfig { id: d1815ca3-2407-4ad3-8363-418565cf05e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc3e8577-741b-407c-9557-4b8f9351edb9 (dataset): DatasetConfig { id: dc3e8577-741b-407c-9557-4b8f9351edb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df0dd3cb-5ca2-41d3-8675-879ba56f4aa3 (dataset): DatasetConfig { id: df0dd3cb-5ca2-41d3-8675-879ba56f4aa3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e31c43cb-d549-49e2-b335-80c352f2cbe7 (dataset): DatasetConfig { id: e31c43cb-d549-49e2-b335-80c352f2cbe7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4b2806e-87d5-42e1-831c-cfac8bbde6d3 (dataset): DatasetConfig { id: e4b2806e-87d5-42e1-831c-cfac8bbde6d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e92bc519-48e7-428e-82e9-ba90d6f522e0 (dataset): DatasetConfig { id: e92bc519-48e7-428e-82e9-ba90d6f522e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec15892d-de93-49a9-b1d5-0c0d20c978de (dataset): DatasetConfig { id: ec15892d-de93-49a9-b1d5-0c0d20c978de (dataset), name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edbb9cef-e484-431c-8602-71b474ea0e7e (dataset): DatasetConfig { id: edbb9cef-e484-431c-8602-71b474ea0e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2ac1b0c-8850-4abb-99a0-c7cd88e4f5ae (dataset): DatasetConfig { id: f2ac1b0c-8850-4abb-99a0-c7cd88e4f5ae (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2edcb8c-a169-4726-b3f6-3fc8d9011209 (dataset): DatasetConfig { id: f2edcb8c-a169-4726-b3f6-3fc8d9011209 (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4adc001-cc80-49ad-8fb3-0412383aad83 (dataset): DatasetConfig { id: f4adc001-cc80-49ad-8fb3-0412383aad83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f74be30d-72c8-4a8f-a0fd-c6382bb6ba00 (dataset): DatasetConfig { id: f74be30d-72c8-4a8f-a0fd-c6382bb6ba00 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f7e0e470-a2dd-43e2-97c6-cf8b9da88017 (dataset): DatasetConfig { id: f7e0e470-a2dd-43e2-97c6-cf8b9da88017 (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f96e696b-3965-4faf-a14a-59d9684e94fd (dataset): DatasetConfig { id: f96e696b-3965-4faf-a14a-59d9684e94fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fef58fa4-e4c0-4b6a-b148-f6428ca09f30 (dataset): DatasetConfig { id: fef58fa4-e4c0-4b6a-b148-f6428ca09f30 (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:461 sled_address = [fd00:1122:3344:101::1]:12345
4432025-03-02T04:53:52.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36154
4442025-03-02T04:53:52.438ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
4452025-03-02T04:53:52.438ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0c1c5b49-ca28-4a8d-8f00-080ccefedcbe (dataset): DatasetConfig { id: 0c1c5b49-ca28-4a8d-8f00-080ccefedcbe (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f638f9f-636f-44e3-b86f-2114651205c5 (dataset): DatasetConfig { id: 0f638f9f-636f-44e3-b86f-2114651205c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11e0fc27-9d2a-47be-9765-444341c1ed34 (dataset): DatasetConfig { id: 11e0fc27-9d2a-47be-9765-444341c1ed34 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 167eb722-3f69-4049-81de-aec4db147c5b (dataset): DatasetConfig { id: 167eb722-3f69-4049-81de-aec4db147c5b (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e7a65d9-807e-4ec7-860b-dc2eb4833c9d (dataset): DatasetConfig { id: 1e7a65d9-807e-4ec7-860b-dc2eb4833c9d (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2074e898-0016-41a4-b74d-ea8ba9ecd5c9 (dataset): DatasetConfig { id: 2074e898-0016-41a4-b74d-ea8ba9ecd5c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20f23c5a-d74d-4533-aaec-c48f2c45722c (dataset): DatasetConfig { id: 20f23c5a-d74d-4533-aaec-c48f2c45722c (dataset), name: DatasetName { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 236f6fb8-824d-4dfb-8236-fc4fe5e24726 (dataset): DatasetConfig { id: 236f6fb8-824d-4dfb-8236-fc4fe5e24726 (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33683353-7506-4fd1-9f56-22bb6128ddaa (dataset): DatasetConfig { id: 33683353-7506-4fd1-9f56-22bb6128ddaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 34d6d360-73ba-4589-a91e-4ec301136eb5 (dataset): DatasetConfig { id: 34d6d360-73ba-4589-a91e-4ec301136eb5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 376849c7-f43f-4b79-9b16-a69935caee18 (dataset): DatasetConfig { id: 376849c7-f43f-4b79-9b16-a69935caee18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3aa03789-7db6-47df-8b26-db1b0b3db401 (dataset): DatasetConfig { id: 3aa03789-7db6-47df-8b26-db1b0b3db401 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b56afa1-a7d6-47ad-aa10-1b78189645c7 (dataset): DatasetConfig { id: 3b56afa1-a7d6-47ad-aa10-1b78189645c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e255103-7d68-41fd-af33-10a480376047 (dataset): DatasetConfig { id: 3e255103-7d68-41fd-af33-10a480376047 (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 423401b3-cc16-44de-b9d9-205bc3341bba (dataset): DatasetConfig { id: 423401b3-cc16-44de-b9d9-205bc3341bba (dataset), name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47cc37a3-8a3f-4b94-b342-47a4c6335fc0 (dataset): DatasetConfig { id: 47cc37a3-8a3f-4b94-b342-47a4c6335fc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47ed4f86-5455-4e3e-b43d-8ed5a68be45c (dataset): DatasetConfig { id: 47ed4f86-5455-4e3e-b43d-8ed5a68be45c (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f12d3e1-b4c5-49f1-9a70-c4cfd9be7105 (dataset): DatasetConfig { id: 4f12d3e1-b4c5-49f1-9a70-c4cfd9be7105 (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 541c854c-f076-496b-9801-36b7fe28891c (dataset): DatasetConfig { id: 541c854c-f076-496b-9801-36b7fe28891c (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 574e975a-4ff8-4766-b215-b3d07734f282 (dataset): DatasetConfig { id: 574e975a-4ff8-4766-b215-b3d07734f282 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 575d1177-75df-441f-a914-dc303d7a5017 (dataset): DatasetConfig { id: 575d1177-75df-441f-a914-dc303d7a5017 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5813e4f3-8486-4ba7-8784-14f7772c2e67 (dataset): DatasetConfig { id: 5813e4f3-8486-4ba7-8784-14f7772c2e67 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bce1b1a-0977-465a-927a-4d7e13c1ecd4 (dataset): DatasetConfig { id: 5bce1b1a-0977-465a-927a-4d7e13c1ecd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61f9ac5e-42a3-4496-a2e0-76e7e38e18e3 (dataset): DatasetConfig { id: 61f9ac5e-42a3-4496-a2e0-76e7e38e18e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63aa67da-d6c1-4f7c-bb81-b0ae4a446988 (dataset): DatasetConfig { id: 63aa67da-d6c1-4f7c-bb81-b0ae4a446988 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 682c08de-1ece-4542-9b86-13b1f67fb17f (dataset): DatasetConfig { id: 682c08de-1ece-4542-9b86-13b1f67fb17f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 69d8ab5a-287c-42cc-bfa2-a1db5066d7b2 (dataset): DatasetConfig { id: 69d8ab5a-287c-42cc-bfa2-a1db5066d7b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c2330f8-1508-4759-9200-c68e23d799e7 (dataset): DatasetConfig { id: 6c2330f8-1508-4759-9200-c68e23d799e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7225230f-d65c-4d41-9cb9-060f8844df9c (dataset): DatasetConfig { id: 7225230f-d65c-4d41-9cb9-060f8844df9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 729bca48-1488-4036-a8eb-b8e61d20fbf7 (dataset): DatasetConfig { id: 729bca48-1488-4036-a8eb-b8e61d20fbf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7338f993-a52d-47b3-9abd-cd19d70c590d (dataset): DatasetConfig { id: 7338f993-a52d-47b3-9abd-cd19d70c590d (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7673823e-8687-45a9-8d33-a58b4c9b58cc (dataset): DatasetConfig { id: 7673823e-8687-45a9-8d33-a58b4c9b58cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7dfae396-ef73-4f66-a1ca-f385ebb802a9 (dataset): DatasetConfig { id: 7dfae396-ef73-4f66-a1ca-f385ebb802a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83161b7f-eee1-4657-90d7-3239e21e154f (dataset): DatasetConfig { id: 83161b7f-eee1-4657-90d7-3239e21e154f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84ac11d6-96e1-4632-9568-deae99c0d776 (dataset): DatasetConfig { id: 84ac11d6-96e1-4632-9568-deae99c0d776 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8501c442-24e2-4c91-a319-262140262421 (dataset): DatasetConfig { id: 8501c442-24e2-4c91-a319-262140262421 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 858c21ad-eb3c-45ef-8915-211929e48fe8 (dataset): DatasetConfig { id: 858c21ad-eb3c-45ef-8915-211929e48fe8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 937cdc2e-bf0b-4c6a-9a07-de4294fabfce (dataset): DatasetConfig { id: 937cdc2e-bf0b-4c6a-9a07-de4294fabfce (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 942d38ff-5cdf-4ec6-b65f-b51c74025003 (dataset): DatasetConfig { id: 942d38ff-5cdf-4ec6-b65f-b51c74025003 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98ad9a0a-3f3a-485d-bef9-46644d7a9dac (dataset): DatasetConfig { id: 98ad9a0a-3f3a-485d-bef9-46644d7a9dac (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9feeeba7-f43b-4634-824d-ac2edcc60bfb (dataset): DatasetConfig { id: 9feeeba7-f43b-4634-824d-ac2edcc60bfb (dataset), name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a4a408ae-12d6-431e-9914-3ad8a9e158ed (dataset): DatasetConfig { id: a4a408ae-12d6-431e-9914-3ad8a9e158ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8b211e0-8ed0-4782-adda-5d843d5a8a65 (dataset): DatasetConfig { id: a8b211e0-8ed0-4782-adda-5d843d5a8a65 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad5deea0-3cd7-4224-896f-683906950b22 (dataset): DatasetConfig { id: ad5deea0-3cd7-4224-896f-683906950b22 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2e20c28-2510-4584-bd25-074151c0b35e (dataset): DatasetConfig { id: b2e20c28-2510-4584-bd25-074151c0b35e (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b791e07a-2663-43d0-88fb-3c6a22a4aef8 (dataset): DatasetConfig { id: b791e07a-2663-43d0-88fb-3c6a22a4aef8 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd0af4fc-5689-4ec8-9d4b-c8a0dfe14aa7 (dataset): DatasetConfig { id: bd0af4fc-5689-4ec8-9d4b-c8a0dfe14aa7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3b9a7d5-43eb-486e-8ac6-7190843778bb (dataset): DatasetConfig { id: c3b9a7d5-43eb-486e-8ac6-7190843778bb (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c615ea69-6e80-4ceb-ab7c-8b2e4d8b1f40 (dataset): DatasetConfig { id: c615ea69-6e80-4ceb-ab7c-8b2e4d8b1f40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c62c6ec8-6289-433b-b841-22a286bfa2ec (dataset): DatasetConfig { id: c62c6ec8-6289-433b-b841-22a286bfa2ec (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9892d92-1ee1-438a-9ea3-0f52a56d32fd (dataset): DatasetConfig { id: c9892d92-1ee1-438a-9ea3-0f52a56d32fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d1815ca3-2407-4ad3-8363-418565cf05e3 (dataset): DatasetConfig { id: d1815ca3-2407-4ad3-8363-418565cf05e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc3e8577-741b-407c-9557-4b8f9351edb9 (dataset): DatasetConfig { id: dc3e8577-741b-407c-9557-4b8f9351edb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df0dd3cb-5ca2-41d3-8675-879ba56f4aa3 (dataset): DatasetConfig { id: df0dd3cb-5ca2-41d3-8675-879ba56f4aa3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e31c43cb-d549-49e2-b335-80c352f2cbe7 (dataset): DatasetConfig { id: e31c43cb-d549-49e2-b335-80c352f2cbe7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4b2806e-87d5-42e1-831c-cfac8bbde6d3 (dataset): DatasetConfig { id: e4b2806e-87d5-42e1-831c-cfac8bbde6d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e92bc519-48e7-428e-82e9-ba90d6f522e0 (dataset): DatasetConfig { id: e92bc519-48e7-428e-82e9-ba90d6f522e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec15892d-de93-49a9-b1d5-0c0d20c978de (dataset): DatasetConfig { id: ec15892d-de93-49a9-b1d5-0c0d20c978de (dataset), name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edbb9cef-e484-431c-8602-71b474ea0e7e (dataset): DatasetConfig { id: edbb9cef-e484-431c-8602-71b474ea0e7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2ac1b0c-8850-4abb-99a0-c7cd88e4f5ae (dataset): DatasetConfig { id: f2ac1b0c-8850-4abb-99a0-c7cd88e4f5ae (dataset), name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2edcb8c-a169-4726-b3f6-3fc8d9011209 (dataset): DatasetConfig { id: f2edcb8c-a169-4726-b3f6-3fc8d9011209 (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4adc001-cc80-49ad-8fb3-0412383aad83 (dataset): DatasetConfig { id: f4adc001-cc80-49ad-8fb3-0412383aad83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f74be30d-72c8-4a8f-a0fd-c6382bb6ba00 (dataset): DatasetConfig { id: f74be30d-72c8-4a8f-a0fd-c6382bb6ba00 (dataset), name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f7e0e470-a2dd-43e2-97c6-cf8b9da88017 (dataset): DatasetConfig { id: f7e0e470-a2dd-43e2-97c6-cf8b9da88017 (dataset), name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f96e696b-3965-4faf-a14a-59d9684e94fd (dataset): DatasetConfig { id: f96e696b-3965-4faf-a14a-59d9684e94fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fef58fa4-e4c0-4b6a-b148-f6428ca09f30 (dataset): DatasetConfig { id: fef58fa4-e4c0-4b6a-b148-f6428ca09f30 (dataset), name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4462025-03-02T04:53:52.438ZINFOSledAgent (StorageManager): No ledger in /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-03-02T04:53:52.438ZINFOSledAgent (StorageManager): No ledger in /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482025-03-02T04:53:52.438ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4492025-03-02T04:53:52.454ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4502025-03-02T04:53:52.454ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4512025-03-02T04:53:52.454ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4522025-03-02T04:53:52.505ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532025-03-02T04:53:52.505ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4542025-03-02T04:53:52.505ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/zone/oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301"), full_name: "oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/zone/oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301" } file = sled-storage/src/manager.rs:1431
4552025-03-02T04:53:52.564ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562025-03-02T04:53:52.564ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4572025-03-02T04:53:52.564ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone" } file = sled-storage/src/manager.rs:1431
4582025-03-02T04:53:52.593ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-03-02T04:53:52.593ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4602025-03-02T04:53:52.593ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4612025-03-02T04:53:52.640ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-03-02T04:53:52.640ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-03-02T04:53:52.640ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148" } file = sled-storage/src/manager.rs:1431
4642025-03-02T04:53:52.699ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-03-02T04:53:52.699ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662025-03-02T04:53:52.699ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a" } file = sled-storage/src/manager.rs:1431
4672025-03-02T04:53:52.756ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-03-02T04:53:52.756ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4692025-03-02T04:53:52.756ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6c14f7f3-ae98-4e2b-8048-0bd7ddd632db/crypt/zone"), full_name: "oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db/crypt/zone" } file = sled-storage/src/manager.rs:1431
4702025-03-02T04:53:52.785ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-03-02T04:53:52.785ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722025-03-02T04:53:52.785ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone/oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662"), full_name: "oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone/oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662" } file = sled-storage/src/manager.rs:1431
4732025-03-02T04:53:52.843ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-03-02T04:53:52.844ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4752025-03-02T04:53:52.844ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/debug"), full_name: "oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/debug" } file = sled-storage/src/manager.rs:1431
4762025-03-02T04:53:52.872ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-03-02T04:53:52.872ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-03-02T04:53:52.872ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b8159dea-4574-4646-9e75-83a2e5fdd3fe/crypt/zone/oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba"), full_name: "oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe/crypt/zone/oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba" } file = sled-storage/src/manager.rs:1431
4792025-03-02T04:53:52.930ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-03-02T04:53:52.930ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812025-03-02T04:53:52.930ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4822025-03-02T04:53:52.979ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-03-02T04:53:52.979ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4842025-03-02T04:53:52.979ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/zone"), full_name: "oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/zone" } file = sled-storage/src/manager.rs:1431
4852025-03-02T04:53:53.007ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-03-02T04:53:53.007ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872025-03-02T04:53:53.007ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5" } file = sled-storage/src/manager.rs:1431
4882025-03-02T04:53:53.069ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-03-02T04:53:53.069ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902025-03-02T04:53:53.069ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/02f51c32-d098-4db1-aebc-508861ba7b69/crypt/zone/oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651"), full_name: "oxp_02f51c32-d098-4db1-aebc-508861ba7b69/crypt/zone/oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651" } file = sled-storage/src/manager.rs:1431
4912025-03-02T04:53:53.128ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-03-02T04:53:53.128ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4932025-03-02T04:53:53.128ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe/crucible" } file = sled-storage/src/manager.rs:1431
4942025-03-02T04:53:53.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952025-03-02T04:53:53.175ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962025-03-02T04:53:53.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4972025-03-02T04:53:53.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982025-03-02T04:53:53.225ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992025-03-02T04:53:53.225ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5002025-03-02T04:53:53.257ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fee17c45-a85b-405f-9e58-2ca0ab03dea9) file = sled-agent/src/probe_manager.rs:238 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
5012025-03-02T04:53:53.274ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022025-03-02T04:53:53.274ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032025-03-02T04:53:53.274ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone/oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b"), full_name: "oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone/oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b" } file = sled-storage/src/manager.rs:1431
5042025-03-02T04:53:53.332ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052025-03-02T04:53:53.332ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062025-03-02T04:53:53.332ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone/oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone/oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc" } file = sled-storage/src/manager.rs:1431
5072025-03-02T04:53:53.391ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-03-02T04:53:53.391ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092025-03-02T04:53:53.391ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5102025-03-02T04:53:53.438ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-03-02T04:53:53.438ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122025-03-02T04:53:53.438ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone/oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone/oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815" } file = sled-storage/src/manager.rs:1431
5132025-03-02T04:53:53.497ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-03-02T04:53:53.497ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152025-03-02T04:53:53.497ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone/oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone/oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b" } file = sled-storage/src/manager.rs:1431
5162025-03-02T04:53:53.554ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-03-02T04:53:53.554ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5182025-03-02T04:53:53.554ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5192025-03-02T04:53:53.602ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-03-02T04:53:53.602ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5212025-03-02T04:53:53.602ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5222025-03-02T04:53:53.652ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-03-02T04:53:53.652ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5242025-03-02T04:53:53.652ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db/crucible" } file = sled-storage/src/manager.rs:1431
5252025-03-02T04:53:53.703ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-03-02T04:53:53.703ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5272025-03-02T04:53:53.703ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crypt/debug"), full_name: "oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crypt/debug" } file = sled-storage/src/manager.rs:1431
5282025-03-02T04:53:53.732ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-03-02T04:53:53.732ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5302025-03-02T04:53:53.732ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone/oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone/oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6" } file = sled-storage/src/manager.rs:1431
5312025-03-02T04:53:53.792ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-03-02T04:53:53.792ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332025-03-02T04:53:53.792ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5342025-03-02T04:53:53.842ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-03-02T04:53:53.842ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5362025-03-02T04:53:53.842ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone"), full_name: "oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone" } file = sled-storage/src/manager.rs:1431
5372025-03-02T04:53:53.871ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-03-02T04:53:53.871ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5392025-03-02T04:53:53.871ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/02f51c32-d098-4db1-aebc-508861ba7b69/crypt/debug"), full_name: "oxp_02f51c32-d098-4db1-aebc-508861ba7b69/crypt/debug" } file = sled-storage/src/manager.rs:1431
5402025-03-02T04:53:53.901ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-03-02T04:53:53.901ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-03-02T04:53:53.901ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd" } file = sled-storage/src/manager.rs:1431
5432025-03-02T04:53:53.960ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-03-02T04:53:53.960ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452025-03-02T04:53:53.960ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6c14f7f3-ae98-4e2b-8048-0bd7ddd632db/crypt/zone/oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19"), full_name: "oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db/crypt/zone/oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19" } file = sled-storage/src/manager.rs:1431
5462025-03-02T04:53:54.021ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-03-02T04:53:54.021ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5482025-03-02T04:53:54.021ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crypt/zone"), full_name: "oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crypt/zone" } file = sled-storage/src/manager.rs:1431
5492025-03-02T04:53:54.050ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-03-02T04:53:54.050ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-03-02T04:53:54.050ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505/crucible" } file = sled-storage/src/manager.rs:1431
5522025-03-02T04:53:54.099ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-03-02T04:53:54.099ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542025-03-02T04:53:54.099ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crucible" } file = sled-storage/src/manager.rs:1431
5552025-03-02T04:53:54.146ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-03-02T04:53:54.146ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5572025-03-02T04:53:54.146ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6c14f7f3-ae98-4e2b-8048-0bd7ddd632db/crypt/debug"), full_name: "oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db/crypt/debug" } file = sled-storage/src/manager.rs:1431
5582025-03-02T04:53:54.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-03-02T04:53:54.175ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602025-03-02T04:53:54.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crypt/zone/oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2"), full_name: "oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crypt/zone/oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2" } file = sled-storage/src/manager.rs:1431
5612025-03-02T04:53:54.235ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-03-02T04:53:54.235ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5632025-03-02T04:53:54.235ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/02f51c32-d098-4db1-aebc-508861ba7b69/crypt/zone/oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635"), full_name: "oxp_02f51c32-d098-4db1-aebc-508861ba7b69/crypt/zone/oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635" } file = sled-storage/src/manager.rs:1431
5642025-03-02T04:53:54.260ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fee17c45-a85b-405f-9e58-2ca0ab03dea9) file = sled-agent/src/probe_manager.rs:238 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
5652025-03-02T04:53:54.294ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-03-02T04:53:54.294ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5672025-03-02T04:53:54.294ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705" } file = sled-storage/src/manager.rs:1431
5682025-03-02T04:53:54.353ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-03-02T04:53:54.353ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5702025-03-02T04:53:54.353ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/debug"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/debug" } file = sled-storage/src/manager.rs:1431
5712025-03-02T04:53:54.382ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-03-02T04:53:54.382ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5732025-03-02T04:53:54.382ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b8159dea-4574-4646-9e75-83a2e5fdd3fe/crypt/debug"), full_name: "oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe/crypt/debug" } file = sled-storage/src/manager.rs:1431
5742025-03-02T04:53:54.410ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752025-03-02T04:53:54.410ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5762025-03-02T04:53:54.410ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone/oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/zone/oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a" } file = sled-storage/src/manager.rs:1431
5772025-03-02T04:53:54.470ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5782025-03-02T04:53:54.470ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5792025-03-02T04:53:54.470ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/zone/oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1"), full_name: "oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/zone/oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1" } file = sled-storage/src/manager.rs:1431
5802025-03-02T04:53:54.529ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812025-03-02T04:53:54.529ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5822025-03-02T04:53:54.529ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crucible" } file = sled-storage/src/manager.rs:1431
5832025-03-02T04:53:54.575ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842025-03-02T04:53:54.575ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5852025-03-02T04:53:54.575ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone/oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7" } file = sled-storage/src/manager.rs:1431
5862025-03-02T04:53:54.633ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872025-03-02T04:53:54.633ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5882025-03-02T04:53:54.633ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crucible" } file = sled-storage/src/manager.rs:1431
5892025-03-02T04:53:54.680ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-03-02T04:53:54.680ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912025-03-02T04:53:54.680ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crucible" } file = sled-storage/src/manager.rs:1431
5922025-03-02T04:53:54.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-03-02T04:53:54.727ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5942025-03-02T04:53:54.727ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone/oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858"), full_name: "oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone/oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858" } file = sled-storage/src/manager.rs:1431
5952025-03-02T04:53:54.784ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-03-02T04:53:54.784ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972025-03-02T04:53:54.784ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/zone/oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e"), full_name: "oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/zone/oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e" } file = sled-storage/src/manager.rs:1431
5982025-03-02T04:53:54.844ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-03-02T04:53:54.844ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6002025-03-02T04:53:54.844ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/zone" } file = sled-storage/src/manager.rs:1431
6012025-03-02T04:53:54.873ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-03-02T04:53:54.873ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6032025-03-02T04:53:54.873ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/debug"), full_name: "oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/debug" } file = sled-storage/src/manager.rs:1431
6042025-03-02T04:53:54.902ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-03-02T04:53:54.902ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-03-02T04:53:54.902ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crypt/zone/oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429"), full_name: "oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crypt/zone/oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429" } file = sled-storage/src/manager.rs:1431
6072025-03-02T04:53:54.959ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-03-02T04:53:54.959ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-03-02T04:53:54.959ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/zone/oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e"), full_name: "oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/zone/oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e" } file = sled-storage/src/manager.rs:1431
6102025-03-02T04:53:55.020ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-03-02T04:53:55.020ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-03-02T04:53:55.020ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone/oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392"), full_name: "oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/zone/oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392" } file = sled-storage/src/manager.rs:1431
6132025-03-02T04:53:55.082ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-03-02T04:53:55.082ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6152025-03-02T04:53:55.082ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b8159dea-4574-4646-9e75-83a2e5fdd3fe/crypt/zone"), full_name: "oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe/crypt/zone" } file = sled-storage/src/manager.rs:1431
6162025-03-02T04:53:55.113ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-03-02T04:53:55.113ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6182025-03-02T04:53:55.113ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/debug"), full_name: "oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/debug" } file = sled-storage/src/manager.rs:1431
6192025-03-02T04:53:55.144ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-03-02T04:53:55.144ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6212025-03-02T04:53:55.144ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/zone"), full_name: "oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/zone" } file = sled-storage/src/manager.rs:1431
6222025-03-02T04:53:55.172ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-03-02T04:53:55.172ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242025-03-02T04:53:55.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b8159dea-4574-4646-9e75-83a2e5fdd3fe/crypt/zone/oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11"), full_name: "oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe/crypt/zone/oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11" } file = sled-storage/src/manager.rs:1431
6252025-03-02T04:53:55.233ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262025-03-02T04:53:55.233ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272025-03-02T04:53:55.233ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6282025-03-02T04:53:55.262ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fee17c45-a85b-405f-9e58-2ca0ab03dea9) file = sled-agent/src/probe_manager.rs:238 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
6292025-03-02T04:53:55.283ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302025-03-02T04:53:55.283ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6312025-03-02T04:53:55.283ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/zone/oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902"), full_name: "oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/zone/oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902" } file = sled-storage/src/manager.rs:1431
6322025-03-02T04:53:55.343ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332025-03-02T04:53:55.343ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6342025-03-02T04:53:55.343ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/02f51c32-d098-4db1-aebc-508861ba7b69/crypt/zone/oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833"), full_name: "oxp_02f51c32-d098-4db1-aebc-508861ba7b69/crypt/zone/oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833" } file = sled-storage/src/manager.rs:1431
6352025-03-02T04:53:55.401ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362025-03-02T04:53:55.401ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6372025-03-02T04:53:55.401ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6382025-03-02T04:53:55.451ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6392025-03-02T04:53:55.451ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6402025-03-02T04:53:55.451ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/debug"), full_name: "oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/debug" } file = sled-storage/src/manager.rs:1431
6412025-03-02T04:53:55.480ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6422025-03-02T04:53:55.480ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6432025-03-02T04:53:55.480ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crucible" } file = sled-storage/src/manager.rs:1431
6442025-03-02T04:53:55.528ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452025-03-02T04:53:55.528ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6462025-03-02T04:53:55.528ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/02f51c32-d098-4db1-aebc-508861ba7b69/crypt/zone"), full_name: "oxp_02f51c32-d098-4db1-aebc-508861ba7b69/crypt/zone" } file = sled-storage/src/manager.rs:1431
6472025-03-02T04:53:55.557ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482025-03-02T04:53:55.557ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6492025-03-02T04:53:55.557ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_02f51c32-d098-4db1-aebc-508861ba7b69/crucible" } file = sled-storage/src/manager.rs:1431
6502025-03-02T04:53:55.604ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-03-02T04:53:55.605ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522025-03-02T04:53:55.605ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
6532025-03-02T04:53:55.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3167627 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36154 req_id = 0204946d-84cd-4c22-8e98-7f2765d61763 response_code = 200 uri = /datasets
6542025-03-02T04:53:55.637ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 7b1d175f-bda6-4078-98b5-1cf73342bf0a (service), filesystem_pool: Some(ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 3bf56dce-8353-46bb-a2f0-982fbd876e0a (service), filesystem_pool: Some(ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 742da26a-88eb-42ac-9329-e125fe787858 (service), filesystem_pool: Some(ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:542 sled_address = [fd00:1122:3344:101::1]:12345
6552025-03-02T04:53:55.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48971
6562025-03-02T04:53:55.638ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6572025-03-02T04:53:55.638ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582025-03-02T04:53:55.647ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592025-03-02T04:53:55.647ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602025-03-02T04:53:55.655ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612025-03-02T04:53:55.655ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622025-03-02T04:53:55.664ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6632025-03-02T04:53:55.664ZINFOSledAgent (ServiceManager): No ledger in /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-zones.json file = common/src/ledger.rs:188
6642025-03-02T04:53:55.664ZINFOSledAgent (ServiceManager): No ledger in /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-03-02T04:53:55.664ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6662025-03-02T04:53:55.664ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-03-02T04:53:55.708ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-03-02T04:53:55.708ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-03-02T04:53:55.708ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-03-02T04:53:55.763ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a file = illumos-utils/src/zone.rs:325
6712025-03-02T04:53:55.766ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a file = illumos-utils/src/zone.rs:325
6722025-03-02T04:53:55.770ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858 file = illumos-utils/src/zone.rs:325
6732025-03-02T04:53:55.783ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a file = illumos-utils/src/zone.rs:363
6742025-03-02T04:53:55.788ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a file = illumos-utils/src/zone.rs:363
6752025-03-02T04:53:55.792ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858 file = illumos-utils/src/zone.rs:363
6762025-03-02T04:53:56.264ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fee17c45-a85b-405f-9e58-2ca0ab03dea9) file = sled-agent/src/probe_manager.rs:238 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
6772025-03-02T04:53:57.515ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782025-03-02T04:53:57.515ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6792025-03-02T04:53:57.515ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a
6802025-03-02T04:53:58.004ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812025-03-02T04:53:58.488ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6822025-03-02T04:53:58.488ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832025-03-02T04:53:58.488ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6842025-03-02T04:53:58.496ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a") failed: Property not found. retry in 28.397366ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a
6852025-03-02T04:53:58.496ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a
6862025-03-02T04:53:58.500ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858
6872025-03-02T04:53:58.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a") failed: Property not found. retry in 128.346778ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a
6882025-03-02T04:53:58.572ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4401
6892025-03-02T04:53:58.572ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4411 gateway = fd00:1122:3344:101::1
6902025-03-02T04:53:58.579ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4425 gateway = fd00:1122:3344:101::1
6912025-03-02T04:53:58.579ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4490
6922025-03-02T04:53:58.632ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a") failed: Property not found. retry in 41.510125ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a
6932025-03-02T04:53:58.639ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858") failed: Property not found. retry in 25.856452ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858
6942025-03-02T04:53:58.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a") failed: Property not found. retry in 213.621008ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a
6952025-03-02T04:53:58.681ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858") failed: Property not found. retry in 54.993418ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858
6962025-03-02T04:53:58.688ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a") failed: Property not found. retry in 53.717741ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a
6972025-03-02T04:53:59.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a") failed: Property not found. retry in 149.401428ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a
6982025-03-02T04:53:59.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858") failed: Property not found. retry in 175.90064ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858
6992025-03-02T04:53:59.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a") failed: Property not found. retry in 424.347277ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a
7002025-03-02T04:53:59.080ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4531
7012025-03-02T04:53:59.081ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4558
7022025-03-02T04:53:59.124ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1416943677105534462 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
7032025-03-02T04:53:59.129ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9539329824435654494 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
7042025-03-02T04:53:59.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a") failed: Property not found. retry in 423.02105ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a
7052025-03-02T04:53:59.184ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4571
7062025-03-02T04:53:59.184ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4442
7072025-03-02T04:53:59.216ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858") failed: Property not found. retry in 232.178897ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858
7082025-03-02T04:53:59.267ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4484
7092025-03-02T04:53:59.267ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4538 rack_subnet = fd00:1122:3344::
7102025-03-02T04:53:59.308ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4549
7112025-03-02T04:53:59.308ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4622
7122025-03-02T04:53:59.335ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12680823185059767592 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
7132025-03-02T04:53:59.335ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8433966563301122876 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
7142025-03-02T04:53:59.399ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4654
7152025-03-02T04:53:59.399ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4660
7162025-03-02T04:53:59.461ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858") failed: Property not found. retry in 1.112458821s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858
7172025-03-02T04:53:59.480ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a") failed: Property not found. retry in 944.164437ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a
7182025-03-02T04:53:59.509ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4701
7192025-03-02T04:53:59.509ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4574
7202025-03-02T04:53:59.612ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4607
7212025-03-02T04:53:59.612ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7222025-03-02T04:53:59.613ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a") failed: Property not found. retry in 989.213772ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a
7232025-03-02T04:53:59.646ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/fee17c45-a85b-405f-9e58-2ca0ab03dea9) file = sled-agent/src/nexus.rs:530 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
7242025-03-02T04:53:59.646ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7252025-03-02T04:53:59.679ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7262025-03-02T04:53:59.679ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7272025-03-02T04:53:59.680ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7282025-03-02T04:53:59.680ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7292025-03-02T04:53:59.717ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
7302025-03-02T04:53:59.769ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7312025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7322025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7332025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7342025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7352025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7362025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7372025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7382025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7392025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7402025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7412025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7422025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7432025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7442025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7452025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7462025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7472025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7482025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7492025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7502025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7512025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7522025-03-02T04:53:59.769ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7532025-03-02T04:54:00.435ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a") failed: Property not found. retry in 857.199552ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a
7542025-03-02T04:54:00.584ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858") failed: Property not found. retry in 756.193724ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858
7552025-03-02T04:54:00.613ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a") failed: Property not found. retry in 1.047623755s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a
7562025-03-02T04:54:01.302ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a") failed: Property not found. retry in 1.282947653s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a
7572025-03-02T04:54:01.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858") failed: Property not found. retry in 1.315266717s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858
7582025-03-02T04:54:01.668ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a") failed: Property not found. retry in 1.30777183s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a
7592025-03-02T04:54:02.595ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a") failed: Property not found. retry in 1.391912323s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a
7602025-03-02T04:54:02.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858") failed: Property not found. retry in 1.282155374s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858
7612025-03-02T04:54:02.986ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a") failed: Property not found. retry in 1.165418934s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a
7622025-03-02T04:54:04.174ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_3bf56dce-8353-46bb-a2f0-982fbd876e0a
7632025-03-02T04:54:04.174ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_7b1d175f-bda6-4078-98b5-1cf73342bf0a
7642025-03-02T04:54:04.174ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_742da26a-88eb-42ac-9329-e125fe787858
7652025-03-02T04:54:04.174ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7662025-03-02T04:54:04.174ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672025-03-02T04:54:04.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8537108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48971 req_id = a7c588f1-301d-4cfe-801d-3c3830d0f802 response_code = 204 uri = /omicron-zones
7682025-03-02T04:54:04.176ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:659
7692025-03-02T04:54:04.641ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 80.676479ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:679
7702025-03-02T04:54:04.741ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:659
7712025-03-02T04:54:04.798ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:659
7722025-03-02T04:54:04.848ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:695
7732025-03-02T04:54:04.848ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7742025-03-02T04:54:04.880ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7752025-03-02T04:54:04.881ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7762025-03-02T04:54:04.881ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7772025-03-02T04:54:04.911ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 7b1d175f-bda6-4078-98b5-1cf73342bf0a (service), filesystem_pool: Some(ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 3bf56dce-8353-46bb-a2f0-982fbd876e0a (service), filesystem_pool: Some(ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 742da26a-88eb-42ac-9329-e125fe787858 (service), filesystem_pool: Some(ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 36a3de1c-4a11-43f4-9843-a580d77a29d2 (service), filesystem_pool: Some(ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 3085557b-d1e9-44b4-8ca0-2de26ef45911, kind: Service { id: 36a3de1c-4a11-43f4-9843-a580d77a29d2 }, name: Name("ntp-36a3de1c-4a11-43f4-9843-a580d77a29d2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 182])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:542 sled_address = [fd00:1122:3344:101::1]:12345
7782025-03-02T04:54:04.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51792
7792025-03-02T04:54:04.912ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7802025-03-02T04:54:04.912ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812025-03-02T04:54:04.923ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7822025-03-02T04:54:04.923ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832025-03-02T04:54:04.934ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7842025-03-02T04:54:04.934ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7852025-03-02T04:54:04.943ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7862025-03-02T04:54:04.943ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-zones.json file = common/src/ledger.rs:177
7872025-03-02T04:54:04.943ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-zones.json file = common/src/ledger.rs:177
7882025-03-02T04:54:04.943ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7892025-03-02T04:54:04.944ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7902025-03-02T04:54:04.954ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7912025-03-02T04:54:04.987ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7922025-03-02T04:54:04.988ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7932025-03-02T04:54:04.988ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7942025-03-02T04:54:05.018ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 158, 182]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7952025-03-02T04:54:05.018ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = boundary_ntp
7962025-03-02T04:54:05.018ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7972025-03-02T04:54:05.018ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7982025-03-02T04:54:05.019ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7992025-03-02T04:54:05.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8002025-03-02T04:54:05.042ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2 file = illumos-utils/src/zone.rs:325
8012025-03-02T04:54:05.060ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2 file = illumos-utils/src/zone.rs:363
8022025-03-02T04:54:05.714ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8032025-03-02T04:54:05.714ZINFOSledAgent (ServiceManager): Booting oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8042025-03-02T04:54:05.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2") failed: Property not found. retry in 42.742975ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8052025-03-02T04:54:05.903ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2") failed: Property not found. retry in 52.800674ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8062025-03-02T04:54:05.967ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2") failed: Property not found. retry in 146.287212ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8072025-03-02T04:54:06.127ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2") failed: Property not found. retry in 515.818521ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8082025-03-02T04:54:06.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2") failed: Property not found. retry in 520.659099ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8092025-03-02T04:54:07.183ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2") failed: Property not found. retry in 937.623242ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8102025-03-02T04:54:08.130ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2") failed: Property not found. retry in 617.609171ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8112025-03-02T04:54:08.757ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2") failed: Property not found. retry in 1.223584121s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8122025-03-02T04:54:09.127ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1416943677105534462 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8132025-03-02T04:54:09.128ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9539329824435654494 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8142025-03-02T04:54:09.336ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12680823185059767592 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8152025-03-02T04:54:09.336ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8433966563301122876 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8162025-03-02T04:54:09.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2") failed: Property not found. retry in 729.811936ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8172025-03-02T04:54:10.741ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2
8182025-03-02T04:54:10.741ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8192025-03-02T04:54:10.742ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8202025-03-02T04:54:10.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5830187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51792 req_id = 1ab9c00a-1444-4414-aba0-2112ba4c152c response_code = 204 uri = /omicron-zones
8212025-03-02T04:54:10.744ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:736
8222025-03-02T04:54:10.775ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8232025-03-02T04:54:10.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48027
8242025-03-02T04:54:10.787ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8252025-03-02T04:54:10.787ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 11333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48027 req_id = e3ef7043-da65-4e58-a182-32bbd0aa5d96 response_code = 500 uri = /timesync
8262025-03-02T04:54:10.789ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8272025-03-02T04:54:10.893ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8282025-03-02T04:54:10.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44688
8292025-03-02T04:54:13.980ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15711479004522327820 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8302025-03-02T04:54:14.009ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9238165204630289429 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8312025-03-02T04:54:14.177ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14598744395360462621 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8322025-03-02T04:54:14.903ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8332025-03-02T04:54:14.903ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4009697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44688 req_id = 60e7cc34-f5da-48e8-a096-42cf1f9e63f1 response_code = 500 uri = /timesync
8342025-03-02T04:54:14.906ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8352025-03-02T04:54:15.019ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8362025-03-02T04:54:15.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46457
8372025-03-02T04:54:15.028ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8382025-03-02T04:54:15.029ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8872 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46457 req_id = 1ac21b91-70d9-4615-928f-3c596d231fed response_code = 500 uri = /timesync
8392025-03-02T04:54:15.033ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8402025-03-02T04:54:15.258ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8412025-03-02T04:54:15.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35967
8422025-03-02T04:54:15.265ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_36a3de1c-4a11-43f4-9843-a580d77a29d2': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8432025-03-02T04:54:15.266ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 7699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35967 req_id = fc28cfde-5609-4ba9-b50b-b0e5ee05756c response_code = 500 uri = /timesync
8442025-03-02T04:54:15.268ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8452025-03-02T04:54:15.503ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8462025-03-02T04:54:15.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51305
8472025-03-02T04:54:18.629ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1416943677105534462 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8482025-03-02T04:54:18.629ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9539329824435654494 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8492025-03-02T04:54:18.837ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12680823185059767592 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8502025-03-02T04:54:18.837ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8433966563301122876 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8512025-03-02T04:54:19.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4009401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51305 req_id = a52653de-d0ff-4828-9fad-c5fd1a6747f7 response_code = 200 uri = /timesync
8522025-03-02T04:54:19.015ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740891256.4507637, correction: 0.03321832 } file = sled-agent/src/rack_setup/service.rs:744
8532025-03-02T04:54:19.015ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8542025-03-02T04:54:19.160ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8552025-03-02T04:54:19.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62744
8562025-03-02T04:54:19.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8758 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62744 req_id = 5bef5cda-c5fb-4d63-b4c8-e4a5a67ea59b response_code = 200 uri = /timesync
8572025-03-02T04:54:19.171ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740891256.4507637, correction: 0.034871619 } file = sled-agent/src/rack_setup/service.rs:744
8582025-03-02T04:54:19.171ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8592025-03-02T04:54:19.378ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8602025-03-02T04:54:19.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46294
8612025-03-02T04:54:19.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8507 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46294 req_id = 83b43cfb-01c3-4dae-95e8-d7d72b4b0f8b response_code = 200 uri = /timesync
8622025-03-02T04:54:19.389ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740891256.4507637, correction: 0.034283787 } file = sled-agent/src/rack_setup/service.rs:744
8632025-03-02T04:54:19.389ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8642025-03-02T04:54:19.656ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8652025-03-02T04:54:19.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45533
8662025-03-02T04:54:19.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9488 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45533 req_id = 3f9e9827-c767-4af7-8dff-4bd2f01634d1 response_code = 200 uri = /timesync
8672025-03-02T04:54:19.667ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740891256.4507637, correction: 0.033531856 } file = sled-agent/src/rack_setup/service.rs:744
8682025-03-02T04:54:19.667ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8692025-03-02T04:54:20.156ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8702025-03-02T04:54:20.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33430
8712025-03-02T04:54:20.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8559 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33430 req_id = 70efec9b-d8d7-44fe-8c98-3435529d3831 response_code = 200 uri = /timesync
8722025-03-02T04:54:20.169ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740891256.4507637, correction: 0.032384198 } file = sled-agent/src/rack_setup/service.rs:744
8732025-03-02T04:54:20.169ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8742025-03-02T04:54:20.247ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6036452914745542751 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8752025-03-02T04:54:20.248ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16702143253262257815 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8762025-03-02T04:54:20.297ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 151.413527ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
8772025-03-02T04:54:20.641ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8782025-03-02T04:54:20.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42353
8792025-03-02T04:54:20.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8541 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42353 req_id = 0db56849-c3bf-451d-a155-36016f8080ab response_code = 200 uri = /timesync
8802025-03-02T04:54:20.652ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740891256.4507637, correction: 0.031074695 } file = sled-agent/src/rack_setup/service.rs:744
8812025-03-02T04:54:20.652ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8822025-03-02T04:54:21.132ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8832025-03-02T04:54:21.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37930
8842025-03-02T04:54:21.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8561 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37930 req_id = dc7a5ae3-2ac2-428b-8e44-b7934ec1b8a1 response_code = 200 uri = /timesync
8852025-03-02T04:54:21.144ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740891256.4507637, correction: 0.029748898 } file = sled-agent/src/rack_setup/service.rs:744
8862025-03-02T04:54:21.144ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8872025-03-02T04:54:21.782ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8882025-03-02T04:54:21.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39360
8892025-03-02T04:54:21.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8778 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39360 req_id = 4275ebc8-a609-4d5d-b01c-13c600045b82 response_code = 200 uri = /timesync
8902025-03-02T04:54:21.793ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740891256.4507637, correction: 0.028104009 } file = sled-agent/src/rack_setup/service.rs:744
8912025-03-02T04:54:21.793ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:766
8922025-03-02T04:54:22.621ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:716
8932025-03-02T04:54:22.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49370
8942025-03-02T04:54:22.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 20445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49370 req_id = 7e0ff218-043e-4e65-a3ff-5f05c41827fd response_code = 200 uri = /timesync
8952025-03-02T04:54:22.646ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1740891261.6833603, correction: 0.025831738 } file = sled-agent/src/rack_setup/service.rs:744
8962025-03-02T04:54:22.646ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1379
8972025-03-02T04:54:22.678ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7b1d175f-bda6-4078-98b5-1cf73342bf0a (service), filesystem_pool: Some(ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 3bf56dce-8353-46bb-a2f0-982fbd876e0a (service), filesystem_pool: Some(ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 742da26a-88eb-42ac-9329-e125fe787858 (service), filesystem_pool: Some(ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 36a3de1c-4a11-43f4-9843-a580d77a29d2 (service), filesystem_pool: Some(ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 3085557b-d1e9-44b4-8ca0-2de26ef45911, kind: Service { id: 36a3de1c-4a11-43f4-9843-a580d77a29d2 }, name: Name("ntp-36a3de1c-4a11-43f4-9843-a580d77a29d2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 182])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 99c68c0f-109c-4ac0-aa9b-2187550b7705 (service), filesystem_pool: Some(ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f2140c70-cf9e-49bb-8619-692b7f15a4fc (service), filesystem_pool: Some(ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: c6542cf5-b94b-428e-aabe-de1318a35662 (service), filesystem_pool: Some(ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 463b12e1-8590-4ef8-902a-0df06d656301 (service), filesystem_pool: Some(ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b1007c30-5686-456d-9655-40f2f59a403e (service), filesystem_pool: Some(ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:542 sled_address = [fd00:1122:3344:101::1]:12345
8982025-03-02T04:54:22.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54422
8992025-03-02T04:54:22.678ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9002025-03-02T04:54:22.678ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9012025-03-02T04:54:22.689ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9022025-03-02T04:54:22.689ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: InternalDns }, responder: ... }
9032025-03-02T04:54:22.700ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9042025-03-02T04:54:22.700ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9052025-03-02T04:54:22.709ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9062025-03-02T04:54:22.709ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9072025-03-02T04:54:22.719ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9082025-03-02T04:54:22.719ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Cockroach }, responder: ... }
9092025-03-02T04:54:22.729ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9102025-03-02T04:54:22.729ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9112025-03-02T04:54:22.738ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9122025-03-02T04:54:22.738ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9132025-03-02T04:54:22.747ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9142025-03-02T04:54:22.747ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Cockroach }, responder: ... }
9152025-03-02T04:54:22.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9162025-03-02T04:54:22.756ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-zones.json file = common/src/ledger.rs:177
9172025-03-02T04:54:22.756ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-zones.json file = common/src/ledger.rs:177
9182025-03-02T04:54:22.756ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
9192025-03-02T04:54:22.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9202025-03-02T04:54:22.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9212025-03-02T04:54:22.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9222025-03-02T04:54:22.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9232025-03-02T04:54:22.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9242025-03-02T04:54:22.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9252025-03-02T04:54:22.931ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc file = illumos-utils/src/zone.rs:325
9262025-03-02T04:54:22.935ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e file = illumos-utils/src/zone.rs:325
9272025-03-02T04:54:22.939ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662 file = illumos-utils/src/zone.rs:325
9282025-03-02T04:54:22.943ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301 file = illumos-utils/src/zone.rs:325
9292025-03-02T04:54:22.947ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705 file = illumos-utils/src/zone.rs:325
9302025-03-02T04:54:22.952ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc file = illumos-utils/src/zone.rs:363
9312025-03-02T04:54:22.957ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e file = illumos-utils/src/zone.rs:363
9322025-03-02T04:54:22.962ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662 file = illumos-utils/src/zone.rs:363
9332025-03-02T04:54:22.967ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301 file = illumos-utils/src/zone.rs:363
9342025-03-02T04:54:22.971ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705 file = illumos-utils/src/zone.rs:363
9352025-03-02T04:54:26.918ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f2140c70-cf9e-49bb-8619-692b7f15a4fc'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9362025-03-02T04:54:26.918ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9372025-03-02T04:54:26.925ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='463b12e1-8590-4ef8-902a-0df06d656301'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9382025-03-02T04:54:26.925ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9392025-03-02T04:54:26.944ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='99c68c0f-109c-4ac0-aa9b-2187550b7705'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9402025-03-02T04:54:26.945ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9412025-03-02T04:54:26.951ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b1007c30-5686-456d-9655-40f2f59a403e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9422025-03-02T04:54:26.951ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9432025-03-02T04:54:27.066ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 52.232782ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9442025-03-02T04:54:27.076ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 70.809099ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9452025-03-02T04:54:27.084ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 56.791968ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9462025-03-02T04:54:27.091ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 56.160478ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9472025-03-02T04:54:27.091ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c6542cf5-b94b-428e-aabe-de1318a35662'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9482025-03-02T04:54:27.091ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9492025-03-02T04:54:27.128ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 126.045902ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9502025-03-02T04:54:27.267ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 63.070116ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9512025-03-02T04:54:27.650ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 238.043407ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9522025-03-02T04:54:27.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 80.317284ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9532025-03-02T04:54:27.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 64.821588ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9542025-03-02T04:54:27.686ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 189.522197ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9552025-03-02T04:54:27.702ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 63.184681ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9562025-03-02T04:54:27.750ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 277.792868ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9572025-03-02T04:54:27.760ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 187.442228ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9582025-03-02T04:54:27.776ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 55.652444ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9592025-03-02T04:54:27.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 141.134274ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9602025-03-02T04:54:27.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 399.655496ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9612025-03-02T04:54:27.951ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 270.354818ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9622025-03-02T04:54:27.981ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 461.186877ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9632025-03-02T04:54:28.032ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 221.778213ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9642025-03-02T04:54:28.041ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 374.585849ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9652025-03-02T04:54:28.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 639.294686ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9662025-03-02T04:54:28.268ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 674.719575ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9672025-03-02T04:54:28.320ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 616.888442ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9682025-03-02T04:54:28.428ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 688.514304ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9692025-03-02T04:54:28.430ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37919
9702025-03-02T04:54:28.430ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37919 req_id = e4069833-2491-4833-afd1-09e122444030 response_code = 200 uri = /baseboard
9712025-03-02T04:54:28.454ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 430.019728ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9722025-03-02T04:54:28.886ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 1.475731279s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9732025-03-02T04:54:28.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 939.331261ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9742025-03-02T04:54:28.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 836.184565ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9752025-03-02T04:54:28.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 867.23818ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9762025-03-02T04:54:29.128ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 698.563157ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9772025-03-02T04:54:29.797ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 1.373643127s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9782025-03-02T04:54:29.835ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 515.398455ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9792025-03-02T04:54:29.843ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 930.457966ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9802025-03-02T04:54:29.851ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.067799669s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9812025-03-02T04:54:30.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 608.524701ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9822025-03-02T04:54:30.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 605.705989ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9832025-03-02T04:54:30.785ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 1.334806376s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9842025-03-02T04:54:30.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 979.777138ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9852025-03-02T04:54:30.980ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 741.316214ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9862025-03-02T04:54:30.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 790.752709ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9872025-03-02T04:54:31.183ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 635.018172ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9882025-03-02T04:54:31.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.110652991s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9892025-03-02T04:54:31.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 1.29527944s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9902025-03-02T04:54:31.829ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 508.501497ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9912025-03-02T04:54:31.921ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.217277611s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9922025-03-02T04:54:32.133ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 718.186846ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9932025-03-02T04:54:32.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 1.343110948s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9942025-03-02T04:54:32.853ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.175841869s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
9952025-03-02T04:54:32.861ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 874.379462ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
9962025-03-02T04:54:33.097ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 1.464787731s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
9972025-03-02T04:54:33.147ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.490896407s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
9982025-03-02T04:54:33.699ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 957.859697ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
9992025-03-02T04:54:33.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 1.002007793s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10002025-03-02T04:54:34.037ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.203426113s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10012025-03-02T04:54:34.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 568.820334ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
10022025-03-02T04:54:34.646ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 973.910833ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10032025-03-02T04:54:34.665ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 1.393724576s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
10042025-03-02T04:54:34.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 739.172804ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10052025-03-02T04:54:35.148ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 1.041551353s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
10062025-03-02T04:54:35.248ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.464457868s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10072025-03-02T04:54:35.500ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 500.011613ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10082025-03-02T04:54:35.516ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 331.698628ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
10092025-03-02T04:54:35.628ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.472479502s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10102025-03-02T04:54:36.008ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 587.041496ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10112025-03-02T04:54:36.066ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 716.249689ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
10122025-03-02T04:54:36.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 889.054264ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
10132025-03-02T04:54:36.605ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 840.078474ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10142025-03-02T04:54:36.724ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.354799999s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10152025-03-02T04:54:36.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 513.677207ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
10162025-03-02T04:54:37.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 970.451645ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
10172025-03-02T04:54:37.111ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.392003148s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10182025-03-02T04:54:37.318ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 1.430533802s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
10192025-03-02T04:54:37.456ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 797.602088ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10202025-03-02T04:54:38.078ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 908.333993ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
10212025-03-02T04:54:38.091ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.241357555s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10222025-03-02T04:54:38.265ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 1.359935317s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10232025-03-02T04:54:38.513ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.235015015s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10242025-03-02T04:54:38.757ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 1.166240729s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
10252025-03-02T04:54:38.996ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 1.130462059s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
10262025-03-02T04:54:39.340ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.488564638s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10272025-03-02T04:54:39.634ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 837.35937ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10282025-03-02T04:54:39.756ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.423862215s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10292025-03-02T04:54:39.933ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 677.229991ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
10302025-03-02T04:54:40.136ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc") failed: Property not found. retry in 1.288318254s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
10312025-03-02T04:54:40.481ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 1.188213457s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10322025-03-02T04:54:40.620ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 604.12429ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
10332025-03-02T04:54:40.839ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 918.925767ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10342025-03-02T04:54:41.192ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 613.684167ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10352025-03-02T04:54:41.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705") failed: Property not found. retry in 756.498497ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
10362025-03-02T04:54:41.679ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 1.344604535s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10372025-03-02T04:54:41.767ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.280527424s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10382025-03-02T04:54:41.814ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 502.494235ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10392025-03-02T04:54:42.327ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 718.1435ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10402025-03-02T04:54:43.034ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 1.026646449s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10412025-03-02T04:54:43.056ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 598.048211ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10422025-03-02T04:54:43.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 629.86678ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10432025-03-02T04:54:43.665ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 918.636222ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10442025-03-02T04:54:43.704ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 809.686058ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10452025-03-02T04:54:44.070ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 803.877926ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10462025-03-02T04:54:44.617ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 624.130765ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10472025-03-02T04:54:44.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.165317425s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10482025-03-02T04:54:44.885ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 539.517082ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10492025-03-02T04:54:45.253ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.028453136s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10502025-03-02T04:54:45.436ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 944.195304ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10512025-03-02T04:54:45.807ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.468860339s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10522025-03-02T04:54:46.291ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 830.185302ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10532025-03-02T04:54:46.390ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 1.498934384s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10542025-03-02T04:54:47.265ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.136719386s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10552025-03-02T04:54:47.287ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 822.116863ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10562025-03-02T04:54:47.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 1.374043402s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10572025-03-02T04:54:48.119ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 602.601736ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10582025-03-02T04:54:48.411ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.052888366s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10592025-03-02T04:54:48.731ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.361600208s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10602025-03-02T04:54:49.283ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 1.414037867s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10612025-03-02T04:54:49.474ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 786.707204ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10622025-03-02T04:54:50.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 976.386463ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10632025-03-02T04:54:50.269ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 996.331711ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10642025-03-02T04:54:50.706ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 621.668078ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10652025-03-02T04:54:50.885ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.10669805s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
10662025-03-02T04:54:51.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e") failed: Property not found. retry in 1.411782096s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10672025-03-02T04:54:51.274ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662") failed: Property not found. retry in 1.434496247s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10682025-03-02T04:54:51.337ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301") failed: Property not found. retry in 1.246604595s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10692025-03-02T04:54:52.729ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_f2140c70-cf9e-49bb-8619-692b7f15a4fc
10702025-03-02T04:54:52.729ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_b1007c30-5686-456d-9655-40f2f59a403e
10712025-03-02T04:54:52.729ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_c6542cf5-b94b-428e-aabe-de1318a35662
10722025-03-02T04:54:52.729ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301
10732025-03-02T04:54:52.729ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_99c68c0f-109c-4ac0-aa9b-2187550b7705
10742025-03-02T04:54:52.729ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10752025-03-02T04:54:52.730ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10762025-03-02T04:54:52.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30027081 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54422 req_id = 7f9ea600-85b8-48d0-b8c0-a8e1196cfeb7 response_code = 204 uri = /omicron-zones
10772025-03-02T04:54:52.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57901
10782025-03-02T04:54:52.791ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26677 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57901 req_id = 30c505de-840c-443a-87ba-c1112c8fc0d1 response_code = 500 uri = /cockroachdb
10792025-03-02T04:54:52.791ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "30c505de-840c-443a-87ba-c1112c8fc0d1", "content-length": "124", "date": "Sun, 02 Mar 2025 04:54:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "30c505de-840c-443a-87ba-c1112c8fc0d1" } file = sled-agent/src/rack_setup/service.rs:1145 retry_after = 134.796072ms
10802025-03-02T04:54:52.953ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25413 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57901 req_id = 8b09ab9e-b4e3-402d-8bf6-096197dc4948 response_code = 500 uri = /cockroachdb
10812025-03-02T04:54:52.953ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8b09ab9e-b4e3-402d-8bf6-096197dc4948", "content-length": "124", "date": "Sun, 02 Mar 2025 04:54:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8b09ab9e-b4e3-402d-8bf6-096197dc4948" } file = sled-agent/src/rack_setup/service.rs:1145 retry_after = 102.227376ms
10822025-03-02T04:54:53.081ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_463b12e1-8590-4ef8-902a-0df06d656301 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25113 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57901 req_id = 1b5ef6b6-f54c-4444-8a35-9da86316faac response_code = 500 uri = /cockroachdb
10832025-03-02T04:54:53.082ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1b5ef6b6-f54c-4444-8a35-9da86316faac", "content-length": "124", "date": "Sun, 02 Mar 2025 04:54:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1b5ef6b6-f54c-4444-8a35-9da86316faac" } file = sled-agent/src/rack_setup/service.rs:1145 retry_after = 87.566018ms
10842025-03-02T04:54:53.197ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3852
10852025-03-02T04:55:04.843ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3870
10862025-03-02T04:55:14.604ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3893
10872025-03-02T04:55:14.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 21433516 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57901 req_id = 582e73f7-5ef5-49f8-a819-e38424a6ba27 response_code = 204 uri = /cockroachdb
10882025-03-02T04:55:14.606ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43847
10892025-03-02T04:55:14.614ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.874151224s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
10902025-03-02T04:55:14.648ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 7b1d175f-bda6-4078-98b5-1cf73342bf0a (service), filesystem_pool: Some(ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 3bf56dce-8353-46bb-a2f0-982fbd876e0a (service), filesystem_pool: Some(ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 742da26a-88eb-42ac-9329-e125fe787858 (service), filesystem_pool: Some(ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 36a3de1c-4a11-43f4-9843-a580d77a29d2 (service), filesystem_pool: Some(ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 3085557b-d1e9-44b4-8ca0-2de26ef45911, kind: Service { id: 36a3de1c-4a11-43f4-9843-a580d77a29d2 }, name: Name("ntp-36a3de1c-4a11-43f4-9843-a580d77a29d2"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 182])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 99c68c0f-109c-4ac0-aa9b-2187550b7705 (service), filesystem_pool: Some(ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f2140c70-cf9e-49bb-8619-692b7f15a4fc (service), filesystem_pool: Some(ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: c6542cf5-b94b-428e-aabe-de1318a35662 (service), filesystem_pool: Some(ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 463b12e1-8590-4ef8-902a-0df06d656301 (service), filesystem_pool: Some(ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b1007c30-5686-456d-9655-40f2f59a403e (service), filesystem_pool: Some(ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 (service), filesystem_pool: Some(ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4a50e69a-1735-4503-96cb-55c6cc854815 (service), filesystem_pool: Some(ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: feddb706-b221-4d1f-920c-1d1979b5460b (service), filesystem_pool: Some(ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: aebed526-5e03-4a58-86b5-1baf17c88392 (service), filesystem_pool: Some(ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 091811f5-b683-4991-98f0-82afb4d1f635 (service), filesystem_pool: Some(ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 8aaa536c-c534-4dd2-aad0-92d8934e5eba (service), filesystem_pool: Some(ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: 2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd (service), filesystem_pool: Some(ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: acc49265-3961-4520-93b6-bb9b4fc5d651 (service), filesystem_pool: Some(ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 7b619950-99d0-488b-9954-6b9ef9834bb5 (service), filesystem_pool: Some(ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 28ee5168-f880-46c7-a679-0530bc63079e (service), filesystem_pool: Some(ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: df985c63-b44a-4fd4-8b12-f708887b0148 (service), filesystem_pool: Some(ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: c7c2bb20-ca3c-4c35-b095-8b585febadb6 (service), filesystem_pool: Some(ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 0ed41899-6e2b-4aeb-aa04-c1d221d0209b (service), filesystem_pool: Some(ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: d940a624-3b91-4e79-a2b7-069dd76c5ef1 (service), filesystem_pool: Some(ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2c206a3a-e41b-48dd-bcdb-ffde60bb2902 (service), filesystem_pool: Some(ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ff186d9f-3cbf-463d-996d-c68628384e11 (service), filesystem_pool: Some(ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 5084cf4b-dd65-4af8-a6eb-85ba7e9dd429 (service), filesystem_pool: Some(ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f7607767-d555-4808-b87a-3cad72f3fd19 (service), filesystem_pool: Some(ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 9ae2af37-6165-4f8f-8100-b19e0f9ec833 (service), filesystem_pool: Some(ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:542 sled_address = [fd00:1122:3344:101::1]:12345
10912025-03-02T04:55:14.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51096
10922025-03-02T04:55:14.649ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10932025-03-02T04:55:14.649ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10942025-03-02T04:55:14.664ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10952025-03-02T04:55:14.664ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: InternalDns }, responder: ... }
10962025-03-02T04:55:14.675ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10972025-03-02T04:55:14.675ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10982025-03-02T04:55:14.684ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10992025-03-02T04:55:14.684ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11002025-03-02T04:55:14.693ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11012025-03-02T04:55:14.693ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Cockroach }, responder: ... }
11022025-03-02T04:55:14.702ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11032025-03-02T04:55:14.702ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11042025-03-02T04:55:14.713ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11052025-03-02T04:55:14.713ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11062025-03-02T04:55:14.721ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11072025-03-02T04:55:14.721ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Cockroach }, responder: ... }
11082025-03-02T04:55:14.729ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11092025-03-02T04:55:14.729ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11102025-03-02T04:55:14.737ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11112025-03-02T04:55:14.737ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11122025-03-02T04:55:14.748ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11132025-03-02T04:55:14.748ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11142025-03-02T04:55:14.758ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11152025-03-02T04:55:14.758ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, kind: Crucible }, responder: ... }
11162025-03-02T04:55:14.769ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11172025-03-02T04:55:14.769ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, kind: Crucible }, responder: ... }
11182025-03-02T04:55:14.780ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11192025-03-02T04:55:14.780ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, kind: Crucible }, responder: ... }
11202025-03-02T04:55:14.788ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11212025-03-02T04:55:14.788ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, kind: Crucible }, responder: ... }
11222025-03-02T04:55:14.796ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11232025-03-02T04:55:14.796ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, kind: Crucible }, responder: ... }
11242025-03-02T04:55:14.806ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11252025-03-02T04:55:14.806ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, kind: Crucible }, responder: ... }
11262025-03-02T04:55:14.818ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11272025-03-02T04:55:14.818ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, kind: Crucible }, responder: ... }
11282025-03-02T04:55:14.830ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11292025-03-02T04:55:14.830ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, kind: Crucible }, responder: ... }
11302025-03-02T04:55:14.841ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11312025-03-02T04:55:14.841ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, kind: Crucible }, responder: ... }
11322025-03-02T04:55:14.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11332025-03-02T04:55:14.856ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-zones.json file = common/src/ledger.rs:177
11342025-03-02T04:55:14.856ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-zones.json file = common/src/ledger.rs:177
11352025-03-02T04:55:14.856ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
11362025-03-02T04:55:14.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11372025-03-02T04:55:14.991ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11382025-03-02T04:55:14.992ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11392025-03-02T04:55:15.034ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11402025-03-02T04:55:15.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11412025-03-02T04:55:15.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11422025-03-02T04:55:15.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11432025-03-02T04:55:15.073ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11442025-03-02T04:55:15.073ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11452025-03-02T04:55:15.073ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11462025-03-02T04:55:15.073ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11472025-03-02T04:55:15.238ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11482025-03-02T04:55:15.240ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11492025-03-02T04:55:15.254ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11502025-03-02T04:55:15.254ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11512025-03-02T04:55:15.255ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11522025-03-02T04:55:15.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11532025-03-02T04:55:15.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11542025-03-02T04:55:15.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11552025-03-02T04:55:15.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11562025-03-02T04:55:15.293ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6 file = illumos-utils/src/zone.rs:325
11572025-03-02T04:55:15.299ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b file = illumos-utils/src/zone.rs:325
11582025-03-02T04:55:15.304ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd file = illumos-utils/src/zone.rs:325
11592025-03-02T04:55:15.310ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902 file = illumos-utils/src/zone.rs:325
11602025-03-02T04:55:15.316ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19 file = illumos-utils/src/zone.rs:325
11612025-03-02T04:55:15.321ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11 file = illumos-utils/src/zone.rs:325
11622025-03-02T04:55:15.326ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651 file = illumos-utils/src/zone.rs:325
11632025-03-02T04:55:15.331ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833 file = illumos-utils/src/zone.rs:325
11642025-03-02T04:55:15.453ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6 file = illumos-utils/src/zone.rs:363
11652025-03-02T04:55:15.458ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b file = illumos-utils/src/zone.rs:363
11662025-03-02T04:55:15.463ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd file = illumos-utils/src/zone.rs:363
11672025-03-02T04:55:15.468ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902 file = illumos-utils/src/zone.rs:363
11682025-03-02T04:55:15.474ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19 file = illumos-utils/src/zone.rs:363
11692025-03-02T04:55:15.480ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11 file = illumos-utils/src/zone.rs:363
11702025-03-02T04:55:15.485ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651 file = illumos-utils/src/zone.rs:363
11712025-03-02T04:55:15.490ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833 file = illumos-utils/src/zone.rs:363
11722025-03-02T04:55:15.495ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5 file = illumos-utils/src/zone.rs:325
11732025-03-02T04:55:15.501ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba file = illumos-utils/src/zone.rs:325
11742025-03-02T04:55:15.508ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148 file = illumos-utils/src/zone.rs:325
11752025-03-02T04:55:15.515ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e file = illumos-utils/src/zone.rs:325
11762025-03-02T04:55:15.522ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429 file = illumos-utils/src/zone.rs:325
11772025-03-02T04:55:15.529ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1 file = illumos-utils/src/zone.rs:325
11782025-03-02T04:55:15.606ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11792025-03-02T04:55:15.607ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5 file = illumos-utils/src/zone.rs:363
11802025-03-02T04:55:15.640ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba file = illumos-utils/src/zone.rs:363
11812025-03-02T04:55:15.673ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148 file = illumos-utils/src/zone.rs:363
11822025-03-02T04:55:15.709ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e file = illumos-utils/src/zone.rs:363
11832025-03-02T04:55:15.737ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429 file = illumos-utils/src/zone.rs:363
11842025-03-02T04:55:15.754ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1 file = illumos-utils/src/zone.rs:363
11852025-03-02T04:55:15.829ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11862025-03-02T04:55:15.887ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11872025-03-02T04:55:15.951ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11882025-03-02T04:55:16.163ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11892025-03-02T04:55:16.166ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11902025-03-02T04:55:16.166ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11912025-03-02T04:55:16.225ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 237, 0]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11922025-03-02T04:55:16.225ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
11932025-03-02T04:55:16.234ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11942025-03-02T04:55:16.234ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11952025-03-02T04:55:16.295ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 141, 180]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11962025-03-02T04:55:16.295ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
11972025-03-02T04:55:16.297ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11982025-03-02T04:55:16.297ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11992025-03-02T04:55:16.376ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 242, 53]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12002025-03-02T04:55:16.376ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
12012025-03-02T04:55:16.379ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12022025-03-02T04:55:16.379ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12032025-03-02T04:55:16.505ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 141, 2]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12042025-03-02T04:55:16.505ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
12052025-03-02T04:55:16.506ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12062025-03-02T04:55:16.506ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12072025-03-02T04:55:16.558ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 198, 192]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12082025-03-02T04:55:16.558ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
12092025-03-02T04:55:16.559ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12102025-03-02T04:55:16.559ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12112025-03-02T04:55:16.561ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12122025-03-02T04:55:16.561ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12132025-03-02T04:55:16.561ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12142025-03-02T04:55:16.561ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12152025-03-02T04:55:16.563ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12162025-03-02T04:55:16.563ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12172025-03-02T04:55:16.566ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12182025-03-02T04:55:16.566ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12192025-03-02T04:55:16.577ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12202025-03-02T04:55:16.579ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12212025-03-02T04:55:16.579ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12222025-03-02T04:55:16.583ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12232025-03-02T04:55:16.587ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12242025-03-02T04:55:16.593ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12252025-03-02T04:55:16.631ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12262025-03-02T04:55:16.635ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12272025-03-02T04:55:16.641ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12282025-03-02T04:55:16.641ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12292025-03-02T04:55:16.755ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b file = illumos-utils/src/zone.rs:325
12302025-03-02T04:55:16.865ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815 file = illumos-utils/src/zone.rs:325
12312025-03-02T04:55:16.883ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635 file = illumos-utils/src/zone.rs:325
12322025-03-02T04:55:16.897ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b file = illumos-utils/src/zone.rs:363
12332025-03-02T04:55:16.911ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392 file = illumos-utils/src/zone.rs:325
12342025-03-02T04:55:16.921ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7 file = illumos-utils/src/zone.rs:325
12352025-03-02T04:55:16.931ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815 file = illumos-utils/src/zone.rs:363
12362025-03-02T04:55:16.944ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635 file = illumos-utils/src/zone.rs:363
12372025-03-02T04:55:16.956ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392 file = illumos-utils/src/zone.rs:363
12382025-03-02T04:55:16.966ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7 file = illumos-utils/src/zone.rs:363
12392025-03-02T04:55:23.408ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12402025-03-02T04:55:23.411ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12412025-03-02T04:55:23.411ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
12422025-03-02T04:55:23.493ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12432025-03-02T04:55:23.493ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
12442025-03-02T04:55:23.498ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
12452025-03-02T04:55:23.636ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9a28542f-0b01-4432-bfdb-b637bedcee4d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12462025-03-02T04:55:23.636ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
12472025-03-02T04:55:23.646ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_02f51c32-d098-4db1-aebc-508861ba7b69/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='13be5d5c-436c-4df9-8aa0-000ff30be98a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12482025-03-02T04:55:23.647ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c5c52eae-8f61-4cda-b78c-f134553ab160'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12492025-03-02T04:55:23.649ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9bbfb7e2-ee11-43d1-ae94-b4aa20f5a7da'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12502025-03-02T04:55:23.649ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c7108bd6-f894-404a-9c0a-eb9ecaa26362'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12512025-03-02T04:55:23.649ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
12522025-03-02T04:55:23.676ZINFOSledAgent (ServiceManager): Booting oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
12532025-03-02T04:55:23.686ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0536ce0e-985c-4f70-9766-a67a2f0754ae'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12542025-03-02T04:55:23.687ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7701280a-1c12-4c96-88cc-6ece08bedfcf'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12552025-03-02T04:55:23.687ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6172af12-6fa7-4d40-b551-2b1c147126ca/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7db1336e-3ba8-4015-81eb-9651ab27f243'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12562025-03-02T04:55:23.687ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_59d556b1-49a0-4ea6-b384-37f0944c2057/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2d934dbb-720e-4352-99f7-3794079e6dee'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12572025-03-02T04:55:23.688ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
12582025-03-02T04:55:23.698ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
12592025-03-02T04:55:23.707ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
12602025-03-02T04:55:23.715ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
12612025-03-02T04:55:23.725ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
12622025-03-02T04:55:23.734ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
12632025-03-02T04:55:24.031ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 29.599344ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
12642025-03-02T04:55:24.045ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 53.601519ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
12652025-03-02T04:55:24.059ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 50.510441ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
12662025-03-02T04:55:24.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 29.891202ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
12672025-03-02T04:55:24.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 38.838088ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
12682025-03-02T04:55:24.099ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 64.74019ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
12692025-03-02T04:55:24.113ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 45.340802ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
12702025-03-02T04:55:24.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 44.336479ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
12712025-03-02T04:55:26.522ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 35.153264ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
12722025-03-02T04:55:26.970ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 73.44331ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
12732025-03-02T04:55:27.543ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 98.758821ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
12742025-03-02T04:55:27.653ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 25.379529ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
12752025-03-02T04:55:27.734ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 63.90798ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
12762025-03-02T04:55:27.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 85.708088ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
12772025-03-02T04:55:28.279ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 123.094992ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
12782025-03-02T04:55:28.420ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 71.594258ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
12792025-03-02T04:55:28.445ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 61.699068ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
12802025-03-02T04:55:28.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 131.852217ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
12812025-03-02T04:55:28.512ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 120.680876ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
12822025-03-02T04:55:28.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 93.446798ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
12832025-03-02T04:55:28.540ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 94.925948ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
12842025-03-02T04:55:28.543ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='8aaa536c-c534-4dd2-aad0-92d8934e5eba'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12852025-03-02T04:55:28.569ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 139.250669ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
12862025-03-02T04:55:28.592ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 122.77637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
12872025-03-02T04:55:28.605ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 60.820869ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
12882025-03-02T04:55:28.616ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 106.437852ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
12892025-03-02T04:55:28.630ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 254.654064ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
12902025-03-02T04:55:28.643ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 148.439361ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
12912025-03-02T04:55:28.657ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 243.744384ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
12922025-03-02T04:55:28.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 227.569018ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
12932025-03-02T04:55:28.687ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 101.051052ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
12942025-03-02T04:55:28.700ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 105.654661ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
12952025-03-02T04:55:28.715ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 177.161554ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
12962025-03-02T04:55:28.734ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 212.653855ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
12972025-03-02T04:55:28.734ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
12982025-03-02T04:55:28.756ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 382.55667ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
12992025-03-02T04:55:28.769ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 238.60736ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
13002025-03-02T04:55:28.781ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 205.127302ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
13012025-03-02T04:55:28.794ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 274.093918ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
13022025-03-02T04:55:28.807ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 286.793955ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
13032025-03-02T04:55:28.820ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 275.212754ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
13042025-03-02T04:55:28.831ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 395.197665ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
13052025-03-02T04:55:28.950ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 590.155114ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
13062025-03-02T04:55:29.000ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 460.359383ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
13072025-03-02T04:55:29.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 404.599685ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
13082025-03-02T04:55:29.035ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 367.489952ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
13092025-03-02T04:55:29.054ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 362.617773ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
13102025-03-02T04:55:29.055ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13112025-03-02T04:55:29.056ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13122025-03-02T04:55:29.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 230.502119ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
13132025-03-02T04:55:29.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 306.715699ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
13142025-03-02T04:55:29.111ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 448.468776ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
13152025-03-02T04:55:29.111ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
13162025-03-02T04:55:29.135ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 972.485872ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
13172025-03-02T04:55:29.153ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 1.040611485s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
13182025-03-02T04:55:29.153ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
13192025-03-02T04:55:29.177ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 1.070077527s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
13202025-03-02T04:55:29.191ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 29.935511ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
13212025-03-02T04:55:29.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 102.182808ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
13222025-03-02T04:55:29.254ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 1.13077116s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
13232025-03-02T04:55:29.320ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 999.372192ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
13242025-03-02T04:55:29.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 278.406652ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
13252025-03-02T04:55:29.372ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 52.480492ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
13262025-03-02T04:55:29.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 41.422625ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
13272025-03-02T04:55:29.578ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 89.67746ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
13282025-03-02T04:55:29.608ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 905.395685ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
13292025-03-02T04:55:29.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 402.637561ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
13302025-03-02T04:55:29.653ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 909.445466ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
13312025-03-02T04:55:29.672ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 458.524639ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
13322025-03-02T04:55:29.723ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 857.487046ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
13332025-03-02T04:55:29.740ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 117.379742ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
13342025-03-02T04:55:29.755ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 1.119506455s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
13352025-03-02T04:55:29.774ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 336.976293ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
13362025-03-02T04:55:29.789ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 95.045349ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
13372025-03-02T04:55:29.807ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 755.958607ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
13382025-03-02T04:55:29.877ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 318.582021ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
13392025-03-02T04:55:29.898ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 202.092519ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
13402025-03-02T04:55:30.069ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 1.320228171s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
13412025-03-02T04:55:30.122ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 377.308845ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
13422025-03-02T04:55:30.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 516.943682ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
13432025-03-02T04:55:30.165ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 727.051526ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
13442025-03-02T04:55:30.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 725.76262ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
13452025-03-02T04:55:30.216ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 1.352515327s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
13462025-03-02T04:55:30.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 735.834986ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
13472025-03-02T04:55:30.269ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 1.439814366s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
13482025-03-02T04:55:30.341ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 1.190022148s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
13492025-03-02T04:55:30.404ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 683.412645ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
13502025-03-02T04:55:30.518ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.06685971s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
13512025-03-02T04:55:30.533ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 819.720824ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
13522025-03-02T04:55:30.580ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 579.4261ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
13532025-03-02T04:55:30.599ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 1.137740358s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
13542025-03-02T04:55:30.616ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 1.433488654s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
13552025-03-02T04:55:30.678ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 1.296984709s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
13562025-03-02T04:55:30.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 1.315879569s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
13572025-03-02T04:55:30.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.018919835s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
13582025-03-02T04:55:30.933ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 1.380135798s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
13592025-03-02T04:55:30.987ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 984.86472ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
13602025-03-02T04:55:31.105ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 1.134871345s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
13612025-03-02T04:55:31.173ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 1.035104031s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
13622025-03-02T04:55:31.341ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13632025-03-02T04:55:31.342ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13642025-03-02T04:55:31.342ZINFOSledAgent (ServiceManager): Booting oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
13652025-03-02T04:55:31.356ZINFOSledAgent (ServiceManager): Booting oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
13662025-03-02T04:55:31.390ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 1.363922361s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
13672025-03-02T04:55:31.410ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 1.371795428s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
13682025-03-02T04:55:31.410ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13692025-03-02T04:55:31.410ZINFOSledAgent (ServiceManager): Booting oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
13702025-03-02T04:55:31.553ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 664.298368ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
13712025-03-02T04:55:31.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 511.766629ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
13722025-03-02T04:55:31.612ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.119592868s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
13732025-03-02T04:55:31.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 25.765638ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
13742025-03-02T04:55:31.709ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 62.651531ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
13752025-03-02T04:55:31.730ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 1.080036501s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
13762025-03-02T04:55:31.746ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 149.013979ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
13772025-03-02T04:55:31.763ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 57.760304ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
13782025-03-02T04:55:31.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 546.550779ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
13792025-03-02T04:55:31.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 82.917121ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
13802025-03-02T04:55:31.928ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 105.60032ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
13812025-03-02T04:55:31.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 265.887604ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
13822025-03-02T04:55:31.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.27697472s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
13832025-03-02T04:55:31.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 1.190688741s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
13842025-03-02T04:55:32.003ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 663.477687ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
13852025-03-02T04:55:32.018ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 266.328136ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
13862025-03-02T04:55:32.048ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 192.837503ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
13872025-03-02T04:55:32.066ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 1.001881542s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
13882025-03-02T04:55:32.117ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 912.617238ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
13892025-03-02T04:55:32.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 217.248091ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
13902025-03-02T04:55:32.232ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 506.780905ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
13912025-03-02T04:55:32.242ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 992.050403ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
13922025-03-02T04:55:32.252ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 1.342722539s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
13932025-03-02T04:55:32.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 696.360634ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
13942025-03-02T04:55:32.275ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 219.034156ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
13952025-03-02T04:55:32.296ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 408.348169ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
13962025-03-02T04:55:32.325ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 936.103698ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
13972025-03-02T04:55:32.415ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 926.246291ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
13982025-03-02T04:55:32.449ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 1.181776416s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
13992025-03-02T04:55:32.509ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 543.462861ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
14002025-03-02T04:55:32.683ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 1.292418886s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
14012025-03-02T04:55:32.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 650.488958ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
14022025-03-02T04:55:32.741ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.326412827s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
14032025-03-02T04:55:32.752ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 1.316114503s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
14042025-03-02T04:55:32.765ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 544.536246ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
14052025-03-02T04:55:32.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 546.260399ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
14062025-03-02T04:55:32.821ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 781.73681ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
14072025-03-02T04:55:32.971ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 1.101483005s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
14082025-03-02T04:55:33.043ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 1.33952296s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
14092025-03-02T04:55:33.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 1.105370432s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
14102025-03-02T04:55:33.078ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 1.491140289s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
14112025-03-02T04:55:33.191ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 1.001495239s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
14122025-03-02T04:55:33.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 597.547007ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
14132025-03-02T04:55:33.259ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 1.427702008s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
14142025-03-02T04:55:33.274ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 806.277215ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
14152025-03-02T04:55:33.322ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 856.334221ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
14162025-03-02T04:55:33.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 792.771313ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
14172025-03-02T04:55:33.358ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 1.287380839s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
14182025-03-02T04:55:33.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 1.100896915s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
14192025-03-02T04:55:33.606ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 1.008014438s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
14202025-03-02T04:55:33.617ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 835.474845ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
14212025-03-02T04:55:33.640ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 697.42125ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
14222025-03-02T04:55:33.851ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.493425344s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
14232025-03-02T04:55:33.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 1.081281571s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
14242025-03-02T04:55:34.080ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 853.375269ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
14252025-03-02T04:55:34.091ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.319831899s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
14262025-03-02T04:55:34.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 1.413302571s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
14272025-03-02T04:55:34.111ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 1.367839356s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
14282025-03-02T04:55:34.153ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 914.77208ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
14292025-03-02T04:55:34.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 971.420991ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
14302025-03-02T04:55:34.192ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 1.071453956s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
14312025-03-02T04:55:34.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 1.192635043s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
14322025-03-02T04:55:34.350ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 1.302871112s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
14332025-03-02T04:55:34.408ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 978.082294ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
14342025-03-02T04:55:34.477ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 1.062302404s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
14352025-03-02T04:55:34.494ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 894.94162ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
14362025-03-02T04:55:34.607ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 880.340678ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
14372025-03-02T04:55:34.657ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 857.744917ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
14382025-03-02T04:55:34.737ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 987.553508ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
14392025-03-02T04:55:34.738ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.463312053s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
14402025-03-02T04:55:34.751ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 1.297979536s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
14412025-03-02T04:55:34.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 854.564454ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
14422025-03-02T04:55:35.082ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 1.153494881s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
14432025-03-02T04:55:35.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 767.142706ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
14442025-03-02T04:55:35.166ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 1.460526199s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
14452025-03-02T04:55:35.273ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 604.518322ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
14462025-03-02T04:55:35.353ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.458484599s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
14472025-03-02T04:55:35.433ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 551.003582ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
14482025-03-02T04:55:35.442ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 715.981053ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
14492025-03-02T04:55:35.449ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 1.10988677s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
14502025-03-02T04:55:35.457ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 614.034813ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
14512025-03-02T04:55:35.488ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 878.079784ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
14522025-03-02T04:55:35.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 547.68999ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
14532025-03-02T04:55:35.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 818.710351ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
14542025-03-02T04:55:35.532ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 603.931737ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
14552025-03-02T04:55:35.548ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 949.872082ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
14562025-03-02T04:55:35.662ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 1.141508863s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
14572025-03-02T04:55:35.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 684.364979ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
14582025-03-02T04:55:35.815ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 790.527992ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
14592025-03-02T04:55:35.872ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 1.079934538s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
14602025-03-02T04:55:35.887ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 637.096658ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
14612025-03-02T04:55:35.995ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 919.464365ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
14622025-03-02T04:55:36.053ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 706.358883ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
14632025-03-02T04:55:36.061ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 1.202355292s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
14642025-03-02T04:55:36.081ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 822.729187ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
14652025-03-02T04:55:36.145ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 1.366790132s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
14662025-03-02T04:55:36.167ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 892.647678ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
14672025-03-02T04:55:36.245ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 945.252798ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
14682025-03-02T04:55:36.352ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 976.870032ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
14692025-03-02T04:55:36.375ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 540.589591ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
14702025-03-02T04:55:36.437ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 1.012391232s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
14712025-03-02T04:55:36.625ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 1.48215264s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
14722025-03-02T04:55:36.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 1.123590801s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
14732025-03-02T04:55:36.641ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 1.422466622s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
14742025-03-02T04:55:36.649ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 851.461707ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
14752025-03-02T04:55:36.656ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 1.113572565s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
14762025-03-02T04:55:36.768ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 609.041251ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
14772025-03-02T04:55:36.814ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 1.361646005s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
14782025-03-02T04:55:36.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 794.877933ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
14792025-03-02T04:55:36.916ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 882.766553ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
14802025-03-02T04:55:36.927ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 514.06479ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
14812025-03-02T04:55:36.938ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 825.377967ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
14822025-03-02T04:55:36.961ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 1.177029466s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
14832025-03-02T04:55:37.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 797.77344ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
14842025-03-02T04:55:37.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 1.199521946s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
14852025-03-02T04:55:37.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 963.26521ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
14862025-03-02T04:55:37.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 962.552456ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
14872025-03-02T04:55:37.386ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 1.295374118s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
14882025-03-02T04:55:37.452ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 1.241871535s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
14892025-03-02T04:55:37.462ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 1.356900304s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
14902025-03-02T04:55:37.510ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 1.220294757s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
14912025-03-02T04:55:37.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 1.161935488s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
14922025-03-02T04:55:37.630ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.488644409s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
14932025-03-02T04:55:37.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 508.109873ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
14942025-03-02T04:55:37.775ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 732.421637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
14952025-03-02T04:55:37.782ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 638.308273ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
14962025-03-02T04:55:37.808ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 821.190979ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
14972025-03-02T04:55:37.876ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 656.443858ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
14982025-03-02T04:55:38.074ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 731.430189ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
14992025-03-02T04:55:38.119ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 514.478588ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
15002025-03-02T04:55:38.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 1.494411846s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
15012025-03-02T04:55:38.187ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 728.193958ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
15022025-03-02T04:55:38.245ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 1.236149408s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
15032025-03-02T04:55:38.286ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 729.130006ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
15042025-03-02T04:55:38.314ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 1.014489528s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
15052025-03-02T04:55:38.410ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 1.115657643s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
15062025-03-02T04:55:38.431ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 927.22504ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
15072025-03-02T04:55:38.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 634.098923ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
15082025-03-02T04:55:38.544ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 935.520282ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
15092025-03-02T04:55:38.643ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.331015012s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
15102025-03-02T04:55:38.655ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 667.818216ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
15112025-03-02T04:55:38.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 839.084169ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
15122025-03-02T04:55:38.706ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 1.154883353s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
15132025-03-02T04:55:38.716ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 526.19109ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
15142025-03-02T04:55:38.745ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 909.144439ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
15152025-03-02T04:55:38.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 897.862115ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
15162025-03-02T04:55:38.848ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 1.066405863s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
15172025-03-02T04:55:38.937ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 841.891373ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
15182025-03-02T04:55:39.035ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 821.328045ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
15192025-03-02T04:55:39.083ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15202025-03-02T04:55:39.083ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
15212025-03-02T04:55:39.131ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.278594537s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
15222025-03-02T04:55:39.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 822.791625ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
15232025-03-02T04:55:39.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 926.144435ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
15242025-03-02T04:55:39.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 863.995333ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
15252025-03-02T04:55:39.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 56.00472ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
15262025-03-02T04:55:39.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 981.561587ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
15272025-03-02T04:55:39.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 934.562973ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
15282025-03-02T04:55:39.419ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 65.737857ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
15292025-03-02T04:55:39.493ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 1.423487561s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
15302025-03-02T04:55:39.501ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 280.342674ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
15312025-03-02T04:55:39.512ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 1.336983603s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
15322025-03-02T04:55:39.537ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 1.274777684s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
15332025-03-02T04:55:39.548ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 1.491885452s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
15342025-03-02T04:55:39.655ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 1.481296911s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
15352025-03-02T04:55:39.665ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 587.443991ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
15362025-03-02T04:55:39.748ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 1.073647614s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
15372025-03-02T04:55:39.820ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 1.104070195s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
15382025-03-02T04:55:39.831ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 267.375064ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
15392025-03-02T04:55:39.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 1.31816289s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
15402025-03-02T04:55:39.879ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 1.282992261s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
15412025-03-02T04:55:39.928ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 1.08101948s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
15422025-03-02T04:55:39.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 552.951012ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
15432025-03-02T04:55:40.005ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 1.261003229s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
15442025-03-02T04:55:40.110ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 725.298848ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
15452025-03-02T04:55:40.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 1.224715333s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
15462025-03-02T04:55:40.758ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 706.495558ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
15472025-03-02T04:55:40.768ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 794.623526ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
15482025-03-02T04:55:40.776ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 1.030674876s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
15492025-03-02T04:55:40.784ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 712.550602ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
15502025-03-02T04:55:40.792ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.342022443s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
15512025-03-02T04:55:40.800ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 686.518615ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
15522025-03-02T04:55:40.820ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 799.42922ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
15532025-03-02T04:55:40.831ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 1.169060912s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
15542025-03-02T04:55:40.845ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 551.348007ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
15552025-03-02T04:55:40.859ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 1.43173033s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
15562025-03-02T04:55:40.925ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 1.134446056s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
15572025-03-02T04:55:40.933ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 773.956189ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
15582025-03-02T04:55:41.018ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 665.946571ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
15592025-03-02T04:55:41.051ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 699.430628ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
15602025-03-02T04:55:41.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 1.013045351s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
15612025-03-02T04:55:41.173ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 868.128234ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
15622025-03-02T04:55:41.198ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 919.732602ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
15632025-03-02T04:55:41.277ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 954.397458ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
15642025-03-02T04:55:41.406ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 899.267026ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
15652025-03-02T04:55:41.431ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 908.601962ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
15662025-03-02T04:55:41.476ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 820.200004ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
15672025-03-02T04:55:41.496ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 1.480036099s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
15682025-03-02T04:55:41.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.488133384s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
15692025-03-02T04:55:41.572ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 977.700734ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
15702025-03-02T04:55:41.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 756.122683ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
15712025-03-02T04:55:41.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 503.861627ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
15722025-03-02T04:55:41.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 1.166699009s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
15732025-03-02T04:55:41.760ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 1.13762152s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
15742025-03-02T04:55:41.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 858.496393ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
15752025-03-02T04:55:42.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 940.415233ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
15762025-03-02T04:55:42.050ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 620.455413ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
15772025-03-02T04:55:42.069ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 1.088704886s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
15782025-03-02T04:55:42.129ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 861.342024ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
15792025-03-02T04:55:42.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.17802899s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
15802025-03-02T04:55:42.175ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b") failed: Property not found. retry in 1.134975143s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
15812025-03-02T04:55:42.206ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1") failed: Property not found. retry in 1.120801865s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
15822025-03-02T04:55:42.240ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 1.135148557s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
15832025-03-02T04:55:42.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 898.726465ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
15842025-03-02T04:55:42.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651") failed: Property not found. retry in 1.44268771s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
15852025-03-02T04:55:42.316ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 713.793523ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
15862025-03-02T04:55:42.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 509.573516ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
15872025-03-02T04:55:42.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 751.601407ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
15882025-03-02T04:55:42.560ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 870.343089ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
15892025-03-02T04:55:42.681ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11") failed: Property not found. retry in 1.185820956s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
15902025-03-02T04:55:42.691ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 1.382750902s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
15912025-03-02T04:55:42.870ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e") failed: Property not found. retry in 1.47838494s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
15922025-03-02T04:55:42.893ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 789.768428ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
15932025-03-02T04:55:42.906ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6") failed: Property not found. retry in 1.283921808s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
15942025-03-02T04:55:42.960ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19") failed: Property not found. retry in 645.123792ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
15952025-03-02T04:55:42.987ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148") failed: Property not found. retry in 756.792891ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
15962025-03-02T04:55:42.999ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902") failed: Property not found. retry in 960.747624ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
15972025-03-02T04:55:43.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.005047172s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
15982025-03-02T04:55:43.039ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 1.246619737s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
15992025-03-02T04:55:43.162ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833") failed: Property not found. retry in 935.51597ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
16002025-03-02T04:55:43.174ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 1.125548961s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
16012025-03-02T04:55:43.213ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5") failed: Property not found. retry in 715.687482ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
16022025-03-02T04:55:43.340ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.254739533s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
16032025-03-02T04:55:43.388ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429") failed: Property not found. retry in 1.418476717s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
16042025-03-02T04:55:43.442ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 721.876095ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
16052025-03-02T04:55:43.643ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41712
16062025-03-02T04:55:43.648ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1405 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41712 req_id = bcc96caf-6d07-4f37-b679-de058b3ce418 response_code = 200 uri = /baseboard
16072025-03-02T04:55:43.696ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 750.630937ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
16082025-03-02T04:55:44.033ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.286293279s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
16092025-03-02T04:55:44.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 1.139530659s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
16102025-03-02T04:55:44.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 1.023534999s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
16112025-03-02T04:55:44.301ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 546.542266ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
16122025-03-02T04:55:44.314ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 821.478892ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
16132025-03-02T04:55:44.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 858.664259ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
16142025-03-02T04:55:44.612ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 901.610181ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
16152025-03-02T04:55:44.867ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 864.81504ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
16162025-03-02T04:55:45.155ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 834.765651ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
16172025-03-02T04:55:45.223ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 1.192181871s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
16182025-03-02T04:55:45.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 814.241674ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
16192025-03-02T04:55:45.332ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 976.102675ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
16202025-03-02T04:55:45.344ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 797.670775ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
16212025-03-02T04:55:45.538ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.132178342s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
16222025-03-02T04:55:45.757ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 675.216623ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
16232025-03-02T04:55:46.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 809.090681ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
16242025-03-02T04:55:46.080ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 1.40637783s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
16252025-03-02T04:55:46.159ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 1.420797557s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
16262025-03-02T04:55:46.321ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.294474796s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
16272025-03-02T04:55:46.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 682.312382ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
16282025-03-02T04:55:46.445ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 1.206154091s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
16292025-03-02T04:55:46.684ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.120243145s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
16302025-03-02T04:55:46.828ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 592.947535ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
16312025-03-02T04:55:47.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 1.412156247s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
16322025-03-02T04:55:47.435ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 571.265596ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
16332025-03-02T04:55:47.506ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 753.185485ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
16342025-03-02T04:55:47.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 681.827323ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
16352025-03-02T04:55:47.627ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 524.055692ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
16362025-03-02T04:55:47.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 1.346007679s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
16372025-03-02T04:55:47.821ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 852.738826ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
16382025-03-02T04:55:48.021ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 576.743245ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
16392025-03-02T04:55:48.166ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba") failed: Property not found. retry in 1.45186355s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
16402025-03-02T04:55:48.275ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392") failed: Property not found. retry in 1.155915767s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
16412025-03-02T04:55:48.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635") failed: Property not found. retry in 1.365708834s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
16422025-03-02T04:55:48.550ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b") failed: Property not found. retry in 645.329555ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
16432025-03-02T04:55:48.612ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815") failed: Property not found. retry in 644.948284ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
16442025-03-02T04:55:48.687ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7") failed: Property not found. retry in 1.034924565s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
16452025-03-02T04:55:49.024ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd") failed: Property not found. retry in 1.141171212s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
16462025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_c7c2bb20-ca3c-4c35-b095-8b585febadb6
16472025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_4a50e69a-1735-4503-96cb-55c6cc854815
16482025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_0ed41899-6e2b-4aeb-aa04-c1d221d0209b
16492025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_clickhouse_2705d4d1-66e3-42f6-9e0e-5e5ddcfd1ebd
16502025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_2c206a3a-e41b-48dd-bcdb-ffde60bb2902
16512025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_091811f5-b683-4991-98f0-82afb4d1f635
16522025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_f7607767-d555-4808-b87a-3cad72f3fd19
16532025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_ff186d9f-3cbf-463d-996d-c68628384e11
16542025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_acc49265-3961-4520-93b6-bb9b4fc5d651
16552025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_9ae2af37-6165-4f8f-8100-b19e0f9ec833
16562025-03-02T04:55:50.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_feddb706-b221-4d1f-920c-1d1979b5460b
16572025-03-02T04:55:50.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_aebed526-5e03-4a58-86b5-1baf17c88392
16582025-03-02T04:55:50.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_7b619950-99d0-488b-9954-6b9ef9834bb5
16592025-03-02T04:55:50.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_oximeter_8aaa536c-c534-4dd2-aad0-92d8934e5eba
16602025-03-02T04:55:50.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_c54e30d8-f5a2-495b-b2d8-a78319addcd7
16612025-03-02T04:55:50.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_df985c63-b44a-4fd4-8b12-f708887b0148
16622025-03-02T04:55:50.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_28ee5168-f880-46c7-a679-0530bc63079e
16632025-03-02T04:55:50.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_5084cf4b-dd65-4af8-a6eb-85ba7e9dd429
16642025-03-02T04:55:50.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_d940a624-3b91-4e79-a2b7-069dd76c5ef1
16652025-03-02T04:55:50.202ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16662025-03-02T04:55:50.206ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16672025-03-02T04:55:50.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35578159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51096 req_id = 3314b69d-813a-485e-829e-c43be22079aa response_code = 204 uri = /omicron-zones
16682025-03-02T04:55:50.257ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1402
16692025-03-02T04:55:50.526ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:791
16702025-03-02T04:55:50.528ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:804
16712025-03-02T04:55:50.568ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1004
16722025-03-02T04:55:51.588ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.755999717s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
16732025-03-02T04:55:51.588ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16742025-03-02T04:55:51.735ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16752025-03-02T04:55:51.834ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16762025-03-02T04:55:51.966ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16772025-03-02T04:55:52.117ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16782025-03-02T04:55:52.385ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16792025-03-02T04:55:52.567ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16802025-03-02T04:55:52.978ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16812025-03-02T04:55:53.490ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16822025-03-02T04:55:53.887ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16832025-03-02T04:55:54.376ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16842025-03-02T04:55:55.188ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16852025-03-02T04:55:55.893ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16862025-03-02T04:55:56.554ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/d6094382-b327-4998-b53d-b2d98a53005b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1066
16872025-03-02T04:55:57.976ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6b048285-2455-4723-9c90-9989a5d8a92c", "content-length": "173", "date": "Sun, 02 Mar 2025 04:55:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d6094382-b327-4998-b53d-b2d98a53005b\"", request_id: "6b048285-2455-4723-9c90-9989a5d8a92c" } file = sled-agent/src/rack_setup/service.rs:1066
16882025-03-02T04:55:59.784ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1e3f5ab7-ac31-4af2-b530-3c9044e806ea", "content-length": "173", "date": "Sun, 02 Mar 2025 04:55:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d6094382-b327-4998-b53d-b2d98a53005b\"", request_id: "1e3f5ab7-ac31-4af2-b530-3c9044e806ea" } file = sled-agent/src/rack_setup/service.rs:1066
16892025-03-02T04:56:00.829ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4155046e-3b1a-43f7-940b-8fe7a4eab576", "content-length": "173", "date": "Sun, 02 Mar 2025 04:56:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d6094382-b327-4998-b53d-b2d98a53005b\"", request_id: "4155046e-3b1a-43f7-940b-8fe7a4eab576" } file = sled-agent/src/rack_setup/service.rs:1066
16902025-03-02T04:56:04.234ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "25ab8270-54bb-4c8b-9e3f-5ad20390c01c", "content-length": "173", "date": "Sun, 02 Mar 2025 04:56:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fee17c45-a85b-405f-9e58-2ca0ab03dea9\"", request_id: "25ab8270-54bb-4c8b-9e3f-5ad20390c01c" } file = sled-agent/src/rack_setup/service.rs:1066
16912025-03-02T04:56:06.831ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d86ff9c8-79b4-43cc-b767-acb0a35ad491", "content-length": "173", "date": "Sun, 02 Mar 2025 04:56:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fee17c45-a85b-405f-9e58-2ca0ab03dea9\"", request_id: "d86ff9c8-79b4-43cc-b767-acb0a35ad491" } file = sled-agent/src/rack_setup/service.rs:1066
16922025-03-02T04:56:10.937ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a0e5681c-aad5-4e98-801a-1c2f188f82da", "content-length": "173", "date": "Sun, 02 Mar 2025 04:56:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fee17c45-a85b-405f-9e58-2ca0ab03dea9\"", request_id: "a0e5681c-aad5-4e98-801a-1c2f188f82da" } file = sled-agent/src/rack_setup/service.rs:1066
16932025-03-02T04:56:13.685ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52440
16942025-03-02T04:56:13.686ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52440 req_id = 5123999e-cb34-4b4c-8e1d-bfd7285a5791 response_code = 200 uri = /baseboard
16952025-03-02T04:56:14.072ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8e7b1a3b-f664-4aad-9a53-4b1f33bee94c", "content-length": "173", "date": "Sun, 02 Mar 2025 04:56:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fee17c45-a85b-405f-9e58-2ca0ab03dea9\"", request_id: "8e7b1a3b-f664-4aad-9a53-4b1f33bee94c" } file = sled-agent/src/rack_setup/service.rs:1066
16962025-03-02T04:56:19.278ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "33322b05-c55a-419b-933b-5e568fa65017", "content-length": "173", "date": "Sun, 02 Mar 2025 04:56:19 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fee17c45-a85b-405f-9e58-2ca0ab03dea9\"", request_id: "33322b05-c55a-419b-933b-5e568fa65017" } file = sled-agent/src/rack_setup/service.rs:1066
16972025-03-02T04:56:21.912ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f0efe890-5980-480c-ba6e-89a1db0f8407", "content-length": "173", "date": "Sun, 02 Mar 2025 04:56:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fee17c45-a85b-405f-9e58-2ca0ab03dea9\"", request_id: "f0efe890-5980-480c-ba6e-89a1db0f8407" } file = sled-agent/src/rack_setup/service.rs:1066
16982025-03-02T04:56:21.957ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
16992025-03-02T04:56:22.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57514
17002025-03-02T04:56:22.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17012025-03-02T04:56:22.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17022025-03-02T04:56:22.090ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-zones.json file = common/src/ledger.rs:177
17032025-03-02T04:56:22.092ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-zones.json file = common/src/ledger.rs:177
17042025-03-02T04:56:22.104ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17052025-03-02T04:56:22.104ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107
17062025-03-02T04:56:22.126ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17072025-03-02T04:56:22.126ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6
17082025-03-02T04:56:22.148ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17092025-03-02T04:56:22.148ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe
17102025-03-02T04:56:22.167ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17112025-03-02T04:56:22.167ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c
17122025-03-02T04:56:22.187ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17132025-03-02T04:56:22.187ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db
17142025-03-02T04:56:22.204ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17152025-03-02T04:56:22.205ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_02f51c32-d098-4db1-aebc-508861ba7b69
17162025-03-02T04:56:22.222ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17172025-03-02T04:56:22.222ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6172af12-6fa7-4d40-b551-2b1c147126ca
17182025-03-02T04:56:22.242ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17192025-03-02T04:56:22.242ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_59d556b1-49a0-4ea6-b384-37f0944c2057
17202025-03-02T04:56:22.261ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17212025-03-02T04:56:22.261ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505
17222025-03-02T04:56:22.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 184919 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57514 req_id = 45836c11-cd2e-4230-8608-f0b032b47d8b response_code = 200 uri = /inventory
17232025-03-02T04:56:26.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47848
17242025-03-02T04:56:26.323ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17252025-03-02T04:56:26.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17262025-03-02T04:56:26.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17272025-03-02T04:56:26.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17282025-03-02T04:56:26.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17292025-03-02T04:56:26.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17302025-03-02T04:56:26.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17312025-03-02T04:56:26.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8690 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47848 req_id = 4d092e6c-895a-4e47-9b15-6badc64fcd81 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17322025-03-02T04:56:26.324ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1076
17332025-03-02T04:56:26.327ZINFOSledAgent (RSS): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17342025-03-02T04:56:26.328ZINFOSledAgent (RSS): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17352025-03-02T04:56:26.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53661
17362025-03-02T04:56:26.560ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17372025-03-02T04:56:26.560ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17382025-03-02T04:56:26.560ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-zones.json file = common/src/ledger.rs:177
17392025-03-02T04:56:26.560ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-zones.json file = common/src/ledger.rs:177
17402025-03-02T04:56:26.573ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17412025-03-02T04:56:26.573ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107
17422025-03-02T04:56:26.597ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17432025-03-02T04:56:26.597ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6
17442025-03-02T04:56:26.621ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17452025-03-02T04:56:26.621ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe
17462025-03-02T04:56:26.642ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17472025-03-02T04:56:26.642ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c
17482025-03-02T04:56:26.663ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17492025-03-02T04:56:26.663ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db
17502025-03-02T04:56:26.682ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17512025-03-02T04:56:26.682ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_02f51c32-d098-4db1-aebc-508861ba7b69
17522025-03-02T04:56:26.704ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17532025-03-02T04:56:26.704ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6172af12-6fa7-4d40-b551-2b1c147126ca
17542025-03-02T04:56:26.725ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17552025-03-02T04:56:26.726ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_59d556b1-49a0-4ea6-b384-37f0944c2057
17562025-03-02T04:56:26.745ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17572025-03-02T04:56:26.745ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505
17582025-03-02T04:56:26.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196348 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53661 req_id = 3dc906f4-c9e9-4b7a-befe-c56481a79b13 response_code = 200 uri = /inventory
17592025-03-02T04:56:26.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48952
17602025-03-02T04:56:26.995ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17612025-03-02T04:56:26.995ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17622025-03-02T04:56:26.995ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17632025-03-02T04:56:26.995ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17642025-03-02T04:56:26.995ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17652025-03-02T04:56:26.995ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17662025-03-02T04:56:26.995ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17672025-03-02T04:56:26.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48952 req_id = e48ba5fe-77a0-4dae-bf49-e3770fe4c818 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17682025-03-02T04:56:27.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35283
17692025-03-02T04:56:27.073ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17702025-03-02T04:56:27.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17712025-03-02T04:56:27.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17722025-03-02T04:56:27.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17732025-03-02T04:56:27.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17742025-03-02T04:56:27.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17752025-03-02T04:56:27.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17762025-03-02T04:56:27.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35283 req_id = 7ae0e629-a336-4918-96f8-ee571e1a0eac response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17772025-03-02T04:56:27.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58322
17782025-03-02T04:56:27.143ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17792025-03-02T04:56:27.143ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
17802025-03-02T04:56:27.143ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17812025-03-02T04:56:27.143ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17822025-03-02T04:56:27.143ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17832025-03-02T04:56:27.143ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17842025-03-02T04:56:27.143ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17852025-03-02T04:56:27.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 392 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58322 req_id = 4a6681d8-30e2-47f0-950f-09fbca1886bc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17862025-03-02T04:56:30.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43971
17872025-03-02T04:56:30.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43971 req_id = cb5208a1-1ab3-466b-bf9b-6dbd2b9340f5 response_code = 200 uri = /vpc-routes
17882025-03-02T04:56:30.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39452
17892025-03-02T04:56:30.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39452 req_id = a1f9bfdd-1f90-4785-af2b-ef678e507310 response_code = 200 uri = /vpc-routes
17902025-03-02T04:56:30.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
17912025-03-02T04:56:30.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39452 req_id = 51867d8d-0315-4c20-a027-ac625a10b51d response_code = 204 uri = /eip-gateways
17922025-03-02T04:56:30.925ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
17932025-03-02T04:56:30.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43971 req_id = 76d42204-ec63-4901-b0bc-a372f5f3a28d response_code = 204 uri = /eip-gateways
17942025-03-02T04:56:30.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60726
17952025-03-02T04:56:30.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 592 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60726 req_id = 5e9caa23-4865-460e-a12e-7c91845c7dd8 response_code = 200 uri = /v2p
17962025-03-02T04:56:30.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59540
17972025-03-02T04:56:30.964ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
17982025-03-02T04:56:31.059ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
17992025-03-02T04:56:31.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 169139 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59540 req_id = 4cb71683-bc67-4f10-8d50-4673d81fbe25 response_code = 204 uri = /switch-ports
18002025-03-02T04:56:31.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50010
18012025-03-02T04:56:31.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38549
18022025-03-02T04:56:31.132ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18032025-03-02T04:56:31.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4029 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59540 req_id = 7d09cac3-37dd-4b39-a6a8-69f85137a6ed response_code = 200 uri = /network-bootstore-config
18042025-03-02T04:56:31.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8958 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38549 req_id = 264ccdfa-7c7a-4576-bf51-9152021974fd response_code = 200 uri = /v2p
18052025-03-02T04:56:31.189ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18062025-03-02T04:56:31.194ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18072025-03-02T04:56:31.194ZINFOSledAgent (bootstore): Writing ledger to /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18082025-03-02T04:56:31.195ZINFOSledAgent (bootstore): Writing ledger to /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18092025-03-02T04:56:31.196ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18102025-03-02T04:56:31.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9740 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59540 req_id = dfee61fe-236b-40aa-b19b-1e750198692c response_code = 204 uri = /network-bootstore-config
18112025-03-02T04:56:31.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127168 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50010 req_id = 2274a0ae-7c18-4944-a9f4-3feb61e99657 response_code = 204 uri = /switch-ports
18122025-03-02T04:56:31.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50010 req_id = 58577010-b726-4962-aaf9-5ed7c1f038f6 response_code = 200 uri = /network-bootstore-config
18132025-03-02T04:56:31.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3671 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43971 req_id = c8249ef3-e019-4d73-8347-9f51fef3fbd4 response_code = 204 uri = /vpc-routes
18142025-03-02T04:56:31.319ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 2 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 2 } subnet = RouterId { vni: Vni(100), kind: System }
18152025-03-02T04:56:31.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39452 req_id = 8d298346-3155-41e8-b942-808df78ae7fa response_code = 204 uri = /vpc-routes
18162025-03-02T04:56:32.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63414
18172025-03-02T04:56:32.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63414 req_id = 153a7a2a-4830-4053-94a0-15f806e6fbad response_code = 200 uri = /vpc-routes
18182025-03-02T04:56:32.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
18192025-03-02T04:56:32.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63414 req_id = 2edd4dea-8bac-4056-87d0-717ccccac36f response_code = 204 uri = /eip-gateways
18202025-03-02T04:56:32.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1378 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63414 req_id = bd8399a2-6ebd-48bb-a1a5-ead7152463cf response_code = 204 uri = /vpc-routes
18212025-03-02T04:56:32.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42548
18222025-03-02T04:56:32.191ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18232025-03-02T04:56:32.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18242025-03-02T04:56:32.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42548 req_id = d1b410d9-7804-4cdc-94a5-8d88aef8269a response_code = 204 uri = /switch-ports
18252025-03-02T04:56:32.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39884
18262025-03-02T04:56:32.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39884 req_id = 760cc855-6076-45fb-84d6-7ab174d18821 response_code = 200 uri = /v2p
18272025-03-02T04:56:32.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42548 req_id = 0c8c67bf-5b52-46dc-8d49-5bd49108f71d response_code = 200 uri = /network-bootstore-config
18282025-03-02T04:56:32.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50903
18292025-03-02T04:56:32.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50903 req_id = b0d7af77-383d-4d8f-bd87-ef6521aeb6f5 response_code = 200 uri = /vpc-routes
18302025-03-02T04:56:32.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
18312025-03-02T04:56:32.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50903 req_id = a19846ab-8c82-43e5-a56c-cfbbba9235e8 response_code = 204 uri = /eip-gateways
18322025-03-02T04:56:32.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50903 req_id = 5364f9af-879a-4c7e-b48c-9bd80758228c response_code = 204 uri = /vpc-routes
18332025-03-02T04:56:42.912ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:41054 remote_addr = [fd00:1122:3344:101::d]:34060 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
18342025-03-02T04:56:42.946ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32360 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = 754799b8-05c8-4e03-baf6-2a2a70602fcb response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
18352025-03-02T04:56:43.722ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63176
18362025-03-02T04:56:43.724ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63176 req_id = 05e4e37b-2784-45e2-b2c4-4b9b9938407c response_code = 200 uri = /baseboard
18372025-03-02T04:57:00.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34236
18382025-03-02T04:57:00.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34236 req_id = e3b1d7c6-0db2-49c5-9370-1058c7b9d379 response_code = 200 uri = /vpc-routes
18392025-03-02T04:57:00.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33091
18402025-03-02T04:57:00.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33091 req_id = 32f1bc5d-6a04-4ac3-8540-dc3ecf5726ad response_code = 200 uri = /vpc-routes
18412025-03-02T04:57:00.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
18422025-03-02T04:57:00.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34236 req_id = a23c209c-73bc-4caf-b1bc-1652fa0f998c response_code = 204 uri = /eip-gateways
18432025-03-02T04:57:00.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34236 req_id = c4fbe8f9-c52e-4f80-9947-d8c760b7b267 response_code = 204 uri = /vpc-routes
18442025-03-02T04:57:00.794ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
18452025-03-02T04:57:00.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33091 req_id = c4b1b87a-4200-4e5e-b578-13c706f4fd46 response_code = 204 uri = /eip-gateways
18462025-03-02T04:57:00.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33091 req_id = 3b9293c8-9a46-4f9f-8d1a-56c5f673094e response_code = 204 uri = /vpc-routes
18472025-03-02T04:57:00.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35295
18482025-03-02T04:57:00.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35295 req_id = 7e2710b5-7ea7-40ac-994c-4e40f8251e48 response_code = 200 uri = /v2p
18492025-03-02T04:57:00.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54313
18502025-03-02T04:57:00.937ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18512025-03-02T04:57:00.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18522025-03-02T04:57:01.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54313 req_id = d8e05c08-a87f-47cd-9f03-d9756774527c response_code = 204 uri = /switch-ports
18532025-03-02T04:57:01.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49031
18542025-03-02T04:57:01.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56922
18552025-03-02T04:57:01.024ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18562025-03-02T04:57:01.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3954 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54313 req_id = f693c7f3-7222-46a2-ab53-4c5515b167f1 response_code = 200 uri = /network-bootstore-config
18572025-03-02T04:57:01.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3943 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49031 req_id = b22855ff-50dd-4add-836a-5c4c1379c028 response_code = 200 uri = /v2p
18582025-03-02T04:57:01.061ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18592025-03-02T04:57:01.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56922 req_id = 488e6d6e-4a45-420d-9285-975dd77bf209 response_code = 204 uri = /switch-ports
18602025-03-02T04:57:01.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56922 req_id = 44330629-31ec-42c6-9ab9-fb479cabb935 response_code = 200 uri = /network-bootstore-config
18612025-03-02T04:57:02.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62992
18622025-03-02T04:57:02.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62992 req_id = 865da8b4-4e40-4e92-a247-c7a0ed253885 response_code = 200 uri = /vpc-routes
18632025-03-02T04:57:02.047ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
18642025-03-02T04:57:02.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62992 req_id = 98992b0a-5236-4103-9bad-435ebd6e9cbf response_code = 204 uri = /eip-gateways
18652025-03-02T04:57:02.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42436
18662025-03-02T04:57:02.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42436 req_id = 0104fd84-c0d9-4d2d-b5a3-9dd03c483300 response_code = 200 uri = /v2p
18672025-03-02T04:57:02.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62992 req_id = 9a885d29-8778-42af-a59d-96e06328aef1 response_code = 204 uri = /vpc-routes
18682025-03-02T04:57:02.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60524
18692025-03-02T04:57:02.285ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18702025-03-02T04:57:02.320ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18712025-03-02T04:57:02.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85810 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60524 req_id = 370f524f-3c20-467b-9015-c716d9a34287 response_code = 204 uri = /switch-ports
18722025-03-02T04:57:02.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60524 req_id = c5b1a519-2da2-44ec-98cd-6a7c965f0eae response_code = 200 uri = /network-bootstore-config
18732025-03-02T04:57:12.919ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6708 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = 20f09286-1a6d-4d3f-b14c-5fc62ba28973 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
18742025-03-02T04:57:13.756ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50025
18752025-03-02T04:57:13.756ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50025 req_id = dedbe08e-1b8a-4f24-8f3d-211dda7ca656 response_code = 200 uri = /baseboard
18762025-03-02T04:57:30.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48500
18772025-03-02T04:57:30.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48500 req_id = bad55d06-d04d-4699-b020-2ab642bbd3d6 response_code = 200 uri = /vpc-routes
18782025-03-02T04:57:30.687ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
18792025-03-02T04:57:30.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48500 req_id = 760429e5-b063-46c3-8583-e4488a8e190f response_code = 204 uri = /eip-gateways
18802025-03-02T04:57:30.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48500 req_id = c8ad1653-5be5-400c-9bd8-7813e9df4cbf response_code = 204 uri = /vpc-routes
18812025-03-02T04:57:30.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43670
18822025-03-02T04:57:30.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43670 req_id = d3aa9f97-2452-4287-b082-480d86f51e84 response_code = 200 uri = /vpc-routes
18832025-03-02T04:57:30.728ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
18842025-03-02T04:57:30.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43670 req_id = 21feb5b3-f785-4d64-8795-b02ad805c8ad response_code = 204 uri = /eip-gateways
18852025-03-02T04:57:30.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55425
18862025-03-02T04:57:30.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55425 req_id = 761c6217-9173-4121-bac3-4aafdd0dea3c response_code = 200 uri = /v2p
18872025-03-02T04:57:30.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43670 req_id = 7b2b62cd-80a7-4202-aa92-af09f4bd1cc1 response_code = 204 uri = /vpc-routes
18882025-03-02T04:57:30.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59145
18892025-03-02T04:57:30.781ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18902025-03-02T04:57:30.820ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18912025-03-02T04:57:30.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95172 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59145 req_id = c6798450-75e0-4e3c-aef0-2f9e1b4f4258 response_code = 204 uri = /switch-ports
18922025-03-02T04:57:30.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53346
18932025-03-02T04:57:30.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48901
18942025-03-02T04:57:30.876ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
18952025-03-02T04:57:30.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59145 req_id = 71e11004-acef-4724-a2ac-e7a16e7575d3 response_code = 200 uri = /network-bootstore-config
18962025-03-02T04:57:30.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53346 req_id = c5ebe3e4-a249-4723-82ca-6a1a315b5b6f response_code = 200 uri = /v2p
18972025-03-02T04:57:30.913ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
18982025-03-02T04:57:30.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93146 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48901 req_id = ca9f5a8c-a134-4731-ae9b-cc971f5bf2fa response_code = 204 uri = /switch-ports
18992025-03-02T04:57:30.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48901 req_id = 53b7843f-c54c-4ff5-8e6e-8329bf990609 response_code = 200 uri = /network-bootstore-config
19002025-03-02T04:57:31.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60592
19012025-03-02T04:57:31.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60592 req_id = f71d0040-0ccb-4c80-be17-0db3812cc775 response_code = 200 uri = /vpc-routes
19022025-03-02T04:57:31.831ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
19032025-03-02T04:57:31.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60592 req_id = 0b3ea62f-1bca-46fd-99a6-9ff6156b7c79 response_code = 204 uri = /eip-gateways
19042025-03-02T04:57:31.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60592 req_id = 8c52bc40-42a7-4250-9708-de91ce0e7b80 response_code = 204 uri = /vpc-routes
19052025-03-02T04:57:31.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39757
19062025-03-02T04:57:31.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39757 req_id = 6219fdb2-2981-4d15-b1b8-22e5681ab9ca response_code = 200 uri = /v2p
19072025-03-02T04:57:31.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38633
19082025-03-02T04:57:31.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19092025-03-02T04:57:31.975ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19102025-03-02T04:57:32.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99451 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38633 req_id = 34c89a9a-1a4a-49c3-b66c-15b5059ddde4 response_code = 204 uri = /switch-ports
19112025-03-02T04:57:32.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38633 req_id = 69b05cae-5385-4ae5-82d2-e17fdec805f8 response_code = 200 uri = /network-bootstore-config
19122025-03-02T04:57:42.920ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7838 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = 3c1cb5ce-1341-4072-a5c8-41250f4bce98 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
19132025-03-02T04:57:43.791ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33056
19142025-03-02T04:57:43.791ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33056 req_id = 6e8d79e8-c7a4-4666-bae8-ba73aa233441 response_code = 200 uri = /baseboard
19152025-03-02T04:58:00.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49891
19162025-03-02T04:58:00.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49891 req_id = ea881cb7-8a8d-4cef-bbf9-447f28fc8b62 response_code = 200 uri = /v2p
19172025-03-02T04:58:00.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49735
19182025-03-02T04:58:00.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49735 req_id = b3b00c17-4e47-4054-97fc-6903addb899b response_code = 200 uri = /vpc-routes
19192025-03-02T04:58:00.929ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
19202025-03-02T04:58:00.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49735 req_id = 14299a78-b450-4291-be08-21e18f0575a9 response_code = 204 uri = /eip-gateways
19212025-03-02T04:58:00.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49735 req_id = 83dc7a7f-8ed3-4a25-8c84-febac5661e02 response_code = 204 uri = /vpc-routes
19222025-03-02T04:58:00.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41341
19232025-03-02T04:58:00.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41341 req_id = 7a408dd2-9b37-41ef-8258-e966b19d30b7 response_code = 200 uri = /vpc-routes
19242025-03-02T04:58:00.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
19252025-03-02T04:58:00.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41341 req_id = 228c14f3-f80b-453e-b0d1-ab8da8b37704 response_code = 204 uri = /eip-gateways
19262025-03-02T04:58:01.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41341 req_id = 641ca003-cc48-4ff1-a47c-8dd64d9a2343 response_code = 204 uri = /vpc-routes
19272025-03-02T04:58:01.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57752
19282025-03-02T04:58:01.067ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19292025-03-02T04:58:01.105ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19302025-03-02T04:58:01.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92311 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57752 req_id = b5f9cad8-219a-4c19-aa6c-9081906217ae response_code = 204 uri = /switch-ports
19312025-03-02T04:58:01.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57878
19322025-03-02T04:58:01.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45949
19332025-03-02T04:58:01.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57752 req_id = 9c636723-b9a7-48c2-a9c7-3dfe5a151461 response_code = 200 uri = /network-bootstore-config
19342025-03-02T04:58:01.160ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19352025-03-02T04:58:01.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57878 req_id = ebc4df46-44d3-4daa-b072-3efd123c4652 response_code = 200 uri = /v2p
19362025-03-02T04:58:01.195ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19372025-03-02T04:58:01.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86559 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45949 req_id = 7e57ae2f-617b-46fd-992e-15aa60ce1277 response_code = 204 uri = /switch-ports
19382025-03-02T04:58:01.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45949 req_id = b7f59f87-6182-46fe-8f1b-5544a9fe5483 response_code = 200 uri = /network-bootstore-config
19392025-03-02T04:58:02.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58158
19402025-03-02T04:58:02.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58158 req_id = 20883534-cb46-4c94-9b78-229b40fa4743 response_code = 200 uri = /vpc-routes
19412025-03-02T04:58:02.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43922
19422025-03-02T04:58:02.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43922 req_id = f7caa753-b2cc-4b78-b993-2ccb236af6f0 response_code = 200 uri = /v2p
19432025-03-02T04:58:02.117ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
19442025-03-02T04:58:02.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58158 req_id = 4cc7c32e-3780-4a44-af2b-e6d53261673b response_code = 204 uri = /eip-gateways
19452025-03-02T04:58:02.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58158 req_id = 91cf7ca7-f3b4-464b-a371-83d6c5be25a0 response_code = 204 uri = /vpc-routes
19462025-03-02T04:58:02.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45854
19472025-03-02T04:58:02.347ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19482025-03-02T04:58:02.383ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19492025-03-02T04:58:02.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86283 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45854 req_id = 0d57375c-c93b-4ad4-b05c-c753f11c1ea5 response_code = 204 uri = /switch-ports
19502025-03-02T04:58:02.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45854 req_id = dc5c8f2b-845e-4acf-90c3-265d282a84f8 response_code = 200 uri = /network-bootstore-config
19512025-03-02T04:58:12.919ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7206 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = c0bad102-4fe4-4aa8-ac79-e0fb88f2bbf3 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
19522025-03-02T04:58:13.826ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42152
19532025-03-02T04:58:13.826ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42152 req_id = 7f956883-c3b4-470f-864b-6140f4d5a1aa response_code = 200 uri = /baseboard
19542025-03-02T04:58:30.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63896
19552025-03-02T04:58:30.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63896 req_id = bac71d50-9a68-4e9b-9980-0dc4ae6ffdd1 response_code = 200 uri = /vpc-routes
19562025-03-02T04:58:30.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42121
19572025-03-02T04:58:30.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42121 req_id = da1cb869-6eda-4524-8d71-4bf684a3d9c5 response_code = 200 uri = /vpc-routes
19582025-03-02T04:58:30.737ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
19592025-03-02T04:58:30.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63896 req_id = 19e97e7e-0a77-48e8-8fc9-2ed0a2422056 response_code = 204 uri = /eip-gateways
19602025-03-02T04:58:30.745ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
19612025-03-02T04:58:30.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42121 req_id = 4628cd1d-6962-445d-8a2b-9d86fd78375b response_code = 204 uri = /eip-gateways
19622025-03-02T04:58:30.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63896 req_id = 2c429288-cf39-40d5-a0ac-12a44b60c59f response_code = 204 uri = /vpc-routes
19632025-03-02T04:58:30.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42121 req_id = 74321769-d6a6-417f-a24c-efbb092ffd6e response_code = 204 uri = /vpc-routes
19642025-03-02T04:58:30.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34407
19652025-03-02T04:58:30.810ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19662025-03-02T04:58:30.848ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19672025-03-02T04:58:30.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93001 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34407 req_id = 2d860e81-a389-4e1d-b593-071f7af7827b response_code = 204 uri = /switch-ports
19682025-03-02T04:58:30.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43819
19692025-03-02T04:58:30.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55678
19702025-03-02T04:58:30.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55678 req_id = d24162e9-cb2b-434b-a5a7-70c0a60516ce response_code = 200 uri = /v2p
19712025-03-02T04:58:30.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34407 req_id = 9738161f-0d54-4b80-831e-a39f1f84227c response_code = 200 uri = /network-bootstore-config
19722025-03-02T04:58:30.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43819 req_id = 58e45bb8-0342-49a8-ac01-59367e556632 response_code = 200 uri = /v2p
19732025-03-02T04:58:30.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65278
19742025-03-02T04:58:30.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19752025-03-02T04:58:30.972ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19762025-03-02T04:58:31.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92378 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65278 req_id = 3742c55f-62eb-4c20-8d9d-58cb87721ca3 response_code = 204 uri = /switch-ports
19772025-03-02T04:58:31.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65278 req_id = 4d35ad90-301f-4be3-9406-7dc9532e1a03 response_code = 200 uri = /network-bootstore-config
19782025-03-02T04:58:31.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62312
19792025-03-02T04:58:31.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62312 req_id = 86d3dcfd-05b0-4476-9a55-5ef4a6b7d561 response_code = 200 uri = /vpc-routes
19802025-03-02T04:58:31.894ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
19812025-03-02T04:58:31.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62312 req_id = 82dfe9bd-74c5-4cec-8e90-03ac84d8837c response_code = 204 uri = /eip-gateways
19822025-03-02T04:58:31.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62312 req_id = 2047b1d7-acd1-46a2-a81f-b5f44af9c518 response_code = 204 uri = /vpc-routes
19832025-03-02T04:58:31.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60388
19842025-03-02T04:58:31.936ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19852025-03-02T04:58:31.977ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19862025-03-02T04:58:32.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101529 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60388 req_id = 559e1dc1-7a23-4b05-959c-bb248eb2f9c0 response_code = 204 uri = /switch-ports
19872025-03-02T04:58:32.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47121
19882025-03-02T04:58:32.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47121 req_id = 776a2f24-d906-401b-a6c1-6ea0492f5c4b response_code = 200 uri = /v2p
19892025-03-02T04:58:32.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60388 req_id = cbda3a59-4991-42eb-bf24-02ef6fedf3f7 response_code = 200 uri = /network-bootstore-config
19902025-03-02T04:58:42.920ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7521 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = e6b52d63-ae33-47b7-81de-51fc05205dcf response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
19912025-03-02T04:58:43.860ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36459
19922025-03-02T04:58:43.860ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36459 req_id = 2d99128e-66b7-44b5-8caf-b660fa86fe5c response_code = 200 uri = /baseboard
19932025-03-02T04:58:51.943ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19942025-03-02T04:59:00.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53932
19952025-03-02T04:59:00.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53932 req_id = c53c9179-e312-4f50-9edf-02bb6b5fba3d response_code = 200 uri = /vpc-routes
19962025-03-02T04:59:00.927ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
19972025-03-02T04:59:00.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53932 req_id = 6fd564d1-7b93-4a2f-bc23-51aef0c4cf3d response_code = 204 uri = /eip-gateways
19982025-03-02T04:59:00.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53932 req_id = 39a25e4f-acb0-4641-99a4-df63fba498f8 response_code = 204 uri = /vpc-routes
19992025-03-02T04:59:00.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40650
20002025-03-02T04:59:00.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40650 req_id = 2bf5fa3c-35bf-4882-8840-4b6c72baa312 response_code = 200 uri = /vpc-routes
20012025-03-02T04:59:01.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54146
20022025-03-02T04:59:01.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54146 req_id = d8cf61f6-1c47-42b4-a027-c30d0c03242d response_code = 200 uri = /v2p
20032025-03-02T04:59:01.023ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
20042025-03-02T04:59:01.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40650 req_id = f8dcf86b-99e9-42a4-aeca-08e8a4e9a97c response_code = 204 uri = /eip-gateways
20052025-03-02T04:59:01.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40650 req_id = df35f577-8f7e-4661-b92f-380a676dbb65 response_code = 204 uri = /vpc-routes
20062025-03-02T04:59:01.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47214
20072025-03-02T04:59:01.062ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20082025-03-02T04:59:01.100ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20092025-03-02T04:59:01.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91577 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47214 req_id = feab7ddc-91c7-4259-9bb2-551798aad80d response_code = 204 uri = /switch-ports
20102025-03-02T04:59:01.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58035
20112025-03-02T04:59:01.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43914
20122025-03-02T04:59:01.154ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20132025-03-02T04:59:01.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3621 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47214 req_id = b547b15a-8ec5-46c0-9b7b-c3660cf69c24 response_code = 200 uri = /network-bootstore-config
20142025-03-02T04:59:01.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3856 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58035 req_id = d86c6329-bdde-4d42-ae1f-c11303570773 response_code = 200 uri = /v2p
20152025-03-02T04:59:01.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20162025-03-02T04:59:01.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90622 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43914 req_id = 8a5488c4-bbf7-4cf6-a74f-6548fe211eba response_code = 204 uri = /switch-ports
20172025-03-02T04:59:01.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43914 req_id = c48d3d70-b814-49b8-ac19-6fd8e494b9ee response_code = 200 uri = /network-bootstore-config
20182025-03-02T04:59:01.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59224
20192025-03-02T04:59:01.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59224 req_id = bcef296f-6c4a-418b-acce-ebc8844bac65 response_code = 200 uri = /vpc-routes
20202025-03-02T04:59:01.962ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
20212025-03-02T04:59:01.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59224 req_id = d8a29a4f-4c20-4670-ac2b-94a428d71ac5 response_code = 204 uri = /eip-gateways
20222025-03-02T04:59:02.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35640
20232025-03-02T04:59:02.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35640 req_id = d46b884c-7036-40fd-85ee-fde7e73295ff response_code = 200 uri = /v2p
20242025-03-02T04:59:02.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59224 req_id = dc58b0d7-9686-4d6b-820b-c05fc4060c46 response_code = 204 uri = /vpc-routes
20252025-03-02T04:59:02.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42368
20262025-03-02T04:59:02.271ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20272025-03-02T04:59:02.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20282025-03-02T04:59:02.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91273 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42368 req_id = 80007d7c-2481-4502-a7fd-a727ac9bafaa response_code = 204 uri = /switch-ports
20292025-03-02T04:59:02.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42368 req_id = 67551e5c-3f91-4e8d-b4ba-c4ea4931efab response_code = 200 uri = /network-bootstore-config
20302025-03-02T04:59:12.920ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7075 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = 8b313243-5d81-4bde-8056-6d686d00240d response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
20312025-03-02T04:59:13.895ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36290
20322025-03-02T04:59:13.895ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36290 req_id = 9f4de7a6-09cf-4e27-9e3a-63a205b6bf6b response_code = 200 uri = /baseboard
20332025-03-02T04:59:30.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50912
20342025-03-02T04:59:30.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50912 req_id = 9d583e25-8d12-41ec-a8ee-30cc633081ed response_code = 200 uri = /vpc-routes
20352025-03-02T04:59:30.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54575
20362025-03-02T04:59:30.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54575 req_id = cddcdd1f-6690-408c-a5cb-7c714dc48d23 response_code = 200 uri = /vpc-routes
20372025-03-02T04:59:30.746ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
20382025-03-02T04:59:30.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54575 req_id = 7e8d8b93-2903-4516-8d7c-03d8d58d96ae response_code = 204 uri = /eip-gateways
20392025-03-02T04:59:30.750ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
20402025-03-02T04:59:30.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50912 req_id = 50f19f2e-8837-4823-b9d3-156d42c029fd response_code = 204 uri = /eip-gateways
20412025-03-02T04:59:30.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55077
20422025-03-02T04:59:30.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55077 req_id = 5842c94a-a373-4912-a9ce-e9f93a686261 response_code = 200 uri = /v2p
20432025-03-02T04:59:30.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50912 req_id = 0327241f-f635-49b7-96a1-b58b33302bc6 response_code = 204 uri = /vpc-routes
20442025-03-02T04:59:30.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35161
20452025-03-02T04:59:30.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35161 req_id = 12be2041-8be6-4b9a-b17e-32ba6fa70286 response_code = 200 uri = /v2p
20462025-03-02T04:59:30.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54575 req_id = bd09448c-8940-4ccc-96cb-4dd4895fcd49 response_code = 204 uri = /vpc-routes
20472025-03-02T04:59:30.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46872
20482025-03-02T04:59:30.854ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20492025-03-02T04:59:30.889ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20502025-03-02T04:59:30.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94870 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46872 req_id = 5ed62349-7751-423f-b51d-1365ae36fa3a response_code = 204 uri = /switch-ports
20512025-03-02T04:59:30.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47707
20522025-03-02T04:59:30.949ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20532025-03-02T04:59:30.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46872 req_id = bf68d61f-205b-4839-8cb4-eabcb377d7eb response_code = 200 uri = /network-bootstore-config
20542025-03-02T04:59:30.985ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20552025-03-02T04:59:31.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91501 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47707 req_id = 68fa8687-ed32-48d7-b917-860939c7b882 response_code = 204 uri = /switch-ports
20562025-03-02T04:59:31.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47707 req_id = 937b4922-77df-4fb1-a90f-7d2ed7b47050 response_code = 200 uri = /network-bootstore-config
20572025-03-02T04:59:31.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46316
20582025-03-02T04:59:31.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46316 req_id = b446673e-bf70-4ce8-b9e8-816a77957e23 response_code = 200 uri = /vpc-routes
20592025-03-02T04:59:31.931ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
20602025-03-02T04:59:31.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46316 req_id = 6ad21524-e34a-443d-bc61-1121fe2a638f response_code = 204 uri = /eip-gateways
20612025-03-02T04:59:31.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50467
20622025-03-02T04:59:31.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50467 req_id = 7f26fc66-2b1c-48da-ba9c-5339682ae8aa response_code = 200 uri = /v2p
20632025-03-02T04:59:31.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46316 req_id = 94ef3589-c5ee-454d-9d30-437f2a35bed4 response_code = 204 uri = /vpc-routes
20642025-03-02T04:59:32.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42868
20652025-03-02T04:59:32.022ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20662025-03-02T04:59:32.062ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20672025-03-02T04:59:32.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92658 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42868 req_id = 400e0e15-9f37-4ed0-916a-3396a60e40f0 response_code = 204 uri = /switch-ports
20682025-03-02T04:59:32.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42868 req_id = 829ae156-d153-44d0-9524-4d49164f45d4 response_code = 200 uri = /network-bootstore-config
20692025-03-02T04:59:42.920ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7590 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = cfb46a64-81e6-44b0-95d4-752a03925049 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
20702025-03-02T04:59:43.928ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38794
20712025-03-02T04:59:43.928ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38794 req_id = 676c494d-c977-428b-a1a4-a23e700cb3a5 response_code = 200 uri = /baseboard
20722025-03-02T05:00:00.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52847
20732025-03-02T05:00:00.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52847 req_id = 5bbb593c-8deb-4fcd-8429-fe55a71d0477 response_code = 200 uri = /vpc-routes
20742025-03-02T05:00:00.844ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
20752025-03-02T05:00:00.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52847 req_id = 12052d08-e19f-4d10-b003-3907860ee4db response_code = 204 uri = /eip-gateways
20762025-03-02T05:00:00.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52847 req_id = 6598345e-b134-4feb-9602-d2dc8243c2a7 response_code = 204 uri = /vpc-routes
20772025-03-02T05:00:00.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49724
20782025-03-02T05:00:00.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49724 req_id = 03500102-4f7d-4dbb-8648-a0380f0ac7ac response_code = 200 uri = /v2p
20792025-03-02T05:00:01.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58573
20802025-03-02T05:00:01.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58573 req_id = 82f42bbb-1b00-4bc2-b912-55c221ae5de2 response_code = 200 uri = /vpc-routes
20812025-03-02T05:00:01.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51562
20822025-03-02T05:00:01.056ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20832025-03-02T05:00:01.108ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20842025-03-02T05:00:01.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189356 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51562 req_id = a1d5c4f0-9908-48b9-b921-b3057952af5f response_code = 204 uri = /switch-ports
20852025-03-02T05:00:01.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52520
20862025-03-02T05:00:01.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60599
20872025-03-02T05:00:01.246ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
20882025-03-02T05:00:01.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58573 req_id = 9961fee0-3d55-489a-ac3c-90ef42413696 response_code = 204 uri = /eip-gateways
20892025-03-02T05:00:01.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51562 req_id = a6b8d98d-dda5-425e-aad5-5e11716db428 response_code = 200 uri = /network-bootstore-config
20902025-03-02T05:00:01.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52520 req_id = 1059b6f3-7281-43c1-8124-993cb60d641c response_code = 200 uri = /v2p
20912025-03-02T05:00:01.246ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20922025-03-02T05:00:01.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58573 req_id = a709744e-70a9-402e-9cbc-df7f616227c0 response_code = 204 uri = /vpc-routes
20932025-03-02T05:00:01.302ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20942025-03-02T05:00:01.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159900 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60599 req_id = 4213e65f-a22a-48df-a05d-3eda52bf1e5d response_code = 204 uri = /switch-ports
20952025-03-02T05:00:01.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60599 req_id = 75c676a8-266c-4e0d-b21b-41b62023ffd3 response_code = 200 uri = /network-bootstore-config
20962025-03-02T05:00:02.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48699
20972025-03-02T05:00:02.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48699 req_id = f9c2b820-93d3-4c15-9d4f-270e5dcbe2ef response_code = 200 uri = /v2p
20982025-03-02T05:00:02.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33232
20992025-03-02T05:00:02.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33232 req_id = 04626d06-ec0a-44db-81d0-f897ff9decb2 response_code = 200 uri = /vpc-routes
21002025-03-02T05:00:02.285ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
21012025-03-02T05:00:02.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33232 req_id = e95aed4e-15c0-4cab-9da0-fe2ae1cc6f3b response_code = 204 uri = /eip-gateways
21022025-03-02T05:00:02.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33232 req_id = 58b8b9a8-542a-44ad-855a-3b05712e74c7 response_code = 204 uri = /vpc-routes
21032025-03-02T05:00:02.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39609
21042025-03-02T05:00:02.473ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21052025-03-02T05:00:02.522ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21062025-03-02T05:00:02.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142103 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39609 req_id = ec85b650-48bf-4cb7-8311-9e248e5c3573 response_code = 204 uri = /switch-ports
21072025-03-02T05:00:02.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39609 req_id = 11aeeacd-2a3c-443f-a66c-a0b7d568370b response_code = 200 uri = /network-bootstore-config
21082025-03-02T05:00:12.921ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7780 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = f95abd7d-e286-498a-a011-1473b64a9217 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
21092025-03-02T05:00:13.963ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65309
21102025-03-02T05:00:13.963ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65309 req_id = 2b80b8de-6010-4cf9-a061-9f49e85f7115 response_code = 200 uri = /baseboard
21112025-03-02T05:00:30.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41389
21122025-03-02T05:00:30.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41389 req_id = 3f8b0e60-6527-4d35-acf1-4efaba23d352 response_code = 200 uri = /vpc-routes
21132025-03-02T05:00:30.762ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
21142025-03-02T05:00:30.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41389 req_id = ec7166c9-bd06-4749-b070-7497c65fb593 response_code = 204 uri = /eip-gateways
21152025-03-02T05:00:30.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41389 req_id = e0987083-e7ad-4ba2-992a-c5024ebf77ae response_code = 204 uri = /vpc-routes
21162025-03-02T05:00:30.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41763
21172025-03-02T05:00:30.839ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21182025-03-02T05:00:30.878ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21192025-03-02T05:00:30.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91843 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41763 req_id = 68d70b6a-e014-447b-8c92-b8eb4ddfaef2 response_code = 204 uri = /switch-ports
21202025-03-02T05:00:30.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61407
21212025-03-02T05:00:30.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51223
21222025-03-02T05:00:30.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51223 req_id = d63a95eb-3840-42d8-82d5-a579ffbe141b response_code = 200 uri = /vpc-routes
21232025-03-02T05:00:30.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41763 req_id = e653606e-94dc-49e4-943b-8f35c5d7d263 response_code = 200 uri = /network-bootstore-config
21242025-03-02T05:00:30.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61407 req_id = f0d85440-1a55-47e0-9243-0a6e466c3c95 response_code = 200 uri = /v2p
21252025-03-02T05:00:30.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64052
21262025-03-02T05:00:30.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64052 req_id = e555851e-b000-4efa-93e5-826adfc38335 response_code = 200 uri = /v2p
21272025-03-02T05:00:30.978ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
21282025-03-02T05:00:30.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51223 req_id = d11b676b-f997-4c42-ab81-e1a482d5fdba response_code = 204 uri = /eip-gateways
21292025-03-02T05:00:30.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51223 req_id = 63c58c97-f42b-4eac-b600-6db07231e93a response_code = 204 uri = /vpc-routes
21302025-03-02T05:00:31.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54617
21312025-03-02T05:00:31.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21322025-03-02T05:00:31.045ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21332025-03-02T05:00:31.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86104 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54617 req_id = 8bffe25a-e041-4210-8634-b599b2a57216 response_code = 204 uri = /switch-ports
21342025-03-02T05:00:31.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54617 req_id = 3e1510c4-f68a-49c8-958a-ba52c122b988 response_code = 200 uri = /network-bootstore-config
21352025-03-02T05:00:31.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50157
21362025-03-02T05:00:31.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50157 req_id = 17e79493-5a55-4193-a1b3-b5d28e0d4696 response_code = 200 uri = /vpc-routes
21372025-03-02T05:00:31.867ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
21382025-03-02T05:00:31.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50157 req_id = ae575851-a95e-433e-87be-9b469493cee7 response_code = 204 uri = /eip-gateways
21392025-03-02T05:00:31.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50157 req_id = 2d3fe0a6-567b-44f2-876b-a33297815423 response_code = 204 uri = /vpc-routes
21402025-03-02T05:00:31.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55780
21412025-03-02T05:00:31.925ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21422025-03-02T05:00:31.962ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21432025-03-02T05:00:32.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99724 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55780 req_id = b67f8eff-1cae-4cb5-8506-87e6c27ab458 response_code = 204 uri = /switch-ports
21442025-03-02T05:00:32.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48147
21452025-03-02T05:00:32.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48147 req_id = 3285714d-e018-42a1-83e9-c30f779b138b response_code = 200 uri = /v2p
21462025-03-02T05:00:32.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55780 req_id = 76fde3d9-27e4-47ee-abfc-90849e45387f response_code = 200 uri = /network-bootstore-config
21472025-03-02T05:00:42.921ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7613 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = 075ef35b-191b-4a10-9f71-2561696a4e45 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
21482025-03-02T05:00:43.996ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65256
21492025-03-02T05:00:43.996ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65256 req_id = 8d47a4a6-e3ae-4466-b473-187af43b2af6 response_code = 200 uri = /baseboard
21502025-03-02T05:01:00.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61244
21512025-03-02T05:01:00.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61244 req_id = e54719a3-3686-48cf-8298-48c7e72e0045 response_code = 200 uri = /vpc-routes
21522025-03-02T05:01:00.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
21532025-03-02T05:01:00.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61244 req_id = 182abf31-5fa9-4a05-b913-b8c3e4731c68 response_code = 204 uri = /eip-gateways
21542025-03-02T05:01:00.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61244 req_id = 0076d769-5af2-438f-a161-e506a786178e response_code = 204 uri = /vpc-routes
21552025-03-02T05:01:00.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39587
21562025-03-02T05:01:00.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39587 req_id = 9b06f28f-1c0c-4e38-b931-b6f17beaede3 response_code = 200 uri = /vpc-routes
21572025-03-02T05:01:01.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61456
21582025-03-02T05:01:01.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61456 req_id = 480e7f5d-89cb-41d1-8faa-3b74726c6d1b response_code = 200 uri = /v2p
21592025-03-02T05:01:01.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55238
21602025-03-02T05:01:01.042ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21612025-03-02T05:01:01.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63772
21622025-03-02T05:01:01.046ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21632025-03-02T05:01:01.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5480 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55238 req_id = 036631f5-7596-44c0-8fb6-c7947b78e6df response_code = 200 uri = /artifacts
21642025-03-02T05:01:01.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 407 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63772 req_id = 924049b2-b325-49fd-8673-af73cf366732 response_code = 200 uri = /artifacts
21652025-03-02T05:01:01.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
21662025-03-02T05:01:01.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39587 req_id = e532b3b4-22fe-4507-811b-4f6b91e72df9 response_code = 204 uri = /eip-gateways
21672025-03-02T05:01:01.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39587 req_id = a5f79d96-3c7a-4802-8c84-6b6edf6cc8ce response_code = 204 uri = /vpc-routes
21682025-03-02T05:01:01.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58087
21692025-03-02T05:01:01.121ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21702025-03-02T05:01:01.161ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21712025-03-02T05:01:01.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58087 req_id = 6f0cedd1-5306-40bb-9a20-3a264b9ffc5c response_code = 204 uri = /switch-ports
21722025-03-02T05:01:01.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58087 req_id = fa8a85a9-acb0-434d-b29d-bf549e79baa1 response_code = 200 uri = /network-bootstore-config
21732025-03-02T05:01:01.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49743
21742025-03-02T05:01:01.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49743 req_id = 1f968498-1405-4081-93f3-8d15ba48af9d response_code = 200 uri = /v2p
21752025-03-02T05:01:01.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55707
21762025-03-02T05:01:01.269ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21772025-03-02T05:01:01.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21782025-03-02T05:01:01.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92117 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55707 req_id = 1e8a45aa-7550-40eb-83a7-c8316d0b04be response_code = 204 uri = /switch-ports
21792025-03-02T05:01:01.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35766
21802025-03-02T05:01:01.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52362
21812025-03-02T05:01:01.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55707 req_id = 2bf094df-9f46-4397-b20e-2ca839c14265 response_code = 200 uri = /network-bootstore-config
21822025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21832025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21842025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21852025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21862025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21872025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21882025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21892025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21902025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21912025-03-02T05:01:01.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 576 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52362 req_id = 5a7c3272-d2c1-4739-b5d6-b3622e7cc0e2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21922025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21932025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21942025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21952025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21962025-03-02T05:01:01.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21972025-03-02T05:01:01.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 613 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35766 req_id = e0224576-eefb-44ff-bd20-9ef87d0b6f02 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21982025-03-02T05:01:01.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51259
21992025-03-02T05:01:01.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51259 req_id = ce9c7f1c-9246-4ce3-9c24-246c85f0d316 response_code = 200 uri = /vpc-routes
22002025-03-02T05:01:02.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
22012025-03-02T05:01:02.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51259 req_id = 2ab20198-c689-4c6c-a4bc-9eda14829330 response_code = 204 uri = /eip-gateways
22022025-03-02T05:01:02.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51259 req_id = 97e8d054-07af-40ef-8ca6-5918ab61e671 response_code = 204 uri = /vpc-routes
22032025-03-02T05:01:02.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47318
22042025-03-02T05:01:02.099ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22052025-03-02T05:01:02.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47318 req_id = dc6f7aa9-c86b-45d4-85ff-51c2506c83e2 response_code = 200 uri = /artifacts
22062025-03-02T05:01:02.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43941
22072025-03-02T05:01:02.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43941 req_id = b56cf832-497c-4e82-91f5-3115652b447b response_code = 200 uri = /v2p
22082025-03-02T05:01:02.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42708
22092025-03-02T05:01:02.280ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22102025-03-02T05:01:02.319ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22112025-03-02T05:01:02.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42708 req_id = e56c450e-bde5-4572-a849-9958eae6b40c response_code = 204 uri = /switch-ports
22122025-03-02T05:01:02.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63992
22132025-03-02T05:01:02.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42708 req_id = 011a00bf-ab09-45dd-92b2-67838fc9a745 response_code = 200 uri = /network-bootstore-config
22142025-03-02T05:01:02.373ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22152025-03-02T05:01:02.373ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
22162025-03-02T05:01:02.373ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22172025-03-02T05:01:02.373ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22182025-03-02T05:01:02.373ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22192025-03-02T05:01:02.373ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22202025-03-02T05:01:02.373ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22212025-03-02T05:01:02.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63992 req_id = 61bae06d-e931-4423-8531-a31ccbc50bc6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22222025-03-02T05:01:12.920ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6963 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = a73bef4d-9b76-4546-a781-d3827defd9b4 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
22232025-03-02T05:01:14.028ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35182
22242025-03-02T05:01:14.028ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35182 req_id = 399593b2-1cd9-4bf7-95fb-43b76dd78a71 response_code = 200 uri = /baseboard
22252025-03-02T05:01:30.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45513
22262025-03-02T05:01:30.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45513 req_id = 9773380e-91e8-41a9-8b4e-f96c7ad521d4 response_code = 200 uri = /vpc-routes
22272025-03-02T05:01:30.700ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
22282025-03-02T05:01:30.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45513 req_id = e036cbc2-0ffb-40df-8023-9128dc274b41 response_code = 204 uri = /eip-gateways
22292025-03-02T05:01:30.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41790
22302025-03-02T05:01:30.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41790 req_id = 002b4d42-11e4-497d-b126-89ea46aa2379 response_code = 200 uri = /v2p
22312025-03-02T05:01:30.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45513 req_id = 1f11ee5f-c49b-4347-b02d-88d1143fb131 response_code = 204 uri = /vpc-routes
22322025-03-02T05:01:30.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42867
22332025-03-02T05:01:30.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42867 req_id = 12812a2d-186c-4c2d-8e66-b870015868e9 response_code = 200 uri = /vpc-routes
22342025-03-02T05:01:30.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63361
22352025-03-02T05:01:30.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22362025-03-02T05:01:30.853ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22372025-03-02T05:01:30.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63361 req_id = 6202df84-0fcd-4770-8bca-517ec961e5e0 response_code = 204 uri = /switch-ports
22382025-03-02T05:01:30.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39370
22392025-03-02T05:01:30.911ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
22402025-03-02T05:01:30.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42867 req_id = 904d08fe-c684-4862-b00f-4eba0283516c response_code = 204 uri = /eip-gateways
22412025-03-02T05:01:30.911ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22422025-03-02T05:01:30.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63361 req_id = 66017b66-5728-4b71-a8e6-c2792d03f2c5 response_code = 200 uri = /network-bootstore-config
22432025-03-02T05:01:30.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42867 req_id = 684a9898-0908-456b-abc6-e1038209d42b response_code = 204 uri = /vpc-routes
22442025-03-02T05:01:30.946ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22452025-03-02T05:01:30.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84966 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39370 req_id = 69af9d6e-1d77-4151-8beb-fb4d64c21912 response_code = 204 uri = /switch-ports
22462025-03-02T05:01:30.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39370 req_id = 8246e6bd-0b5c-4929-9569-bf92548af6cb response_code = 200 uri = /network-bootstore-config
22472025-03-02T05:01:31.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49645
22482025-03-02T05:01:31.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49645 req_id = 82ba8756-cb98-40ea-97b2-d0ef4a8d1eb1 response_code = 200 uri = /v2p
22492025-03-02T05:01:31.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49467
22502025-03-02T05:01:31.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49467 req_id = 5b7b4f7e-f795-4297-94f8-56387ed6bdbc response_code = 200 uri = /vpc-routes
22512025-03-02T05:01:31.921ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
22522025-03-02T05:01:31.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49467 req_id = d5e96d74-f6b3-4642-b86d-c19efc3414b9 response_code = 204 uri = /eip-gateways
22532025-03-02T05:01:31.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49467 req_id = c763f304-e4fb-4e47-945e-8d3109162740 response_code = 204 uri = /vpc-routes
22542025-03-02T05:01:32.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44995
22552025-03-02T05:01:32.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44995 req_id = 0ee5378e-0934-4e51-a7cb-0b9facc1f94d response_code = 200 uri = /v2p
22562025-03-02T05:01:32.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57952
22572025-03-02T05:01:32.071ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22582025-03-02T05:01:32.110ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22592025-03-02T05:01:32.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93093 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57952 req_id = e4ee773b-02d0-44a2-8aca-c443eeb9fed2 response_code = 204 uri = /switch-ports
22602025-03-02T05:01:32.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57952 req_id = e6770502-0646-4e59-beea-3fb92fbc9182 response_code = 200 uri = /network-bootstore-config
22612025-03-02T05:01:42.921ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7025 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = 27fc56a3-ac3b-4217-ab5b-920e81ec1408 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
22622025-03-02T05:01:44.061ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63546
22632025-03-02T05:01:44.061ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63546 req_id = daee2547-cee0-4666-a4d0-9611fb8b40f8 response_code = 200 uri = /baseboard
22642025-03-02T05:02:00.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39507
22652025-03-02T05:02:00.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39507 req_id = 15162ca8-92af-4476-8754-dbecfd011c25 response_code = 200 uri = /vpc-routes
22662025-03-02T05:02:00.884ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
22672025-03-02T05:02:00.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39507 req_id = dd4cb75f-a021-4080-a9a9-d8901e36442d response_code = 204 uri = /eip-gateways
22682025-03-02T05:02:00.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55581
22692025-03-02T05:02:00.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55581 req_id = 09da8326-d9d8-47c6-a73e-6489a88611ec response_code = 200 uri = /vpc-routes
22702025-03-02T05:02:00.992ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
22712025-03-02T05:02:00.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55581 req_id = c360d1c2-9df9-4cfd-a1b9-15c084279b25 response_code = 204 uri = /eip-gateways
22722025-03-02T05:02:01.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55581 req_id = b2e11007-e2f6-42cd-8844-ed7bddb208bc response_code = 204 uri = /vpc-routes
22732025-03-02T05:02:01.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60010
22742025-03-02T05:02:01.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60010 req_id = c7a8c417-0301-4373-8b33-62e3b5a7c182 response_code = 200 uri = /v2p
22752025-03-02T05:02:01.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32977
22762025-03-02T05:02:01.083ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22772025-03-02T05:02:01.122ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22782025-03-02T05:02:01.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94752 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32977 req_id = dffec2c4-c87f-48bf-ac5c-d1e72ae3b063 response_code = 204 uri = /switch-ports
22792025-03-02T05:02:01.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52714
22802025-03-02T05:02:01.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32977 req_id = 4cdcb280-0a5f-48e4-a7ee-b4c6770bb6e0 response_code = 200 uri = /network-bootstore-config
22812025-03-02T05:02:01.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52714 req_id = 4da9fe04-57c6-480a-8c7a-e07d51e6864f response_code = 200 uri = /v2p
22822025-03-02T05:02:01.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 434 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39507 req_id = 4ba0d306-384f-4581-820e-f4657ce41b96 response_code = 204 uri = /vpc-routes
22832025-03-02T05:02:01.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40154
22842025-03-02T05:02:01.227ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22852025-03-02T05:02:01.261ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22862025-03-02T05:02:01.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82693 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40154 req_id = 6da2e636-9376-4fec-84a2-c0f61834eb10 response_code = 204 uri = /switch-ports
22872025-03-02T05:02:01.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40154 req_id = 2677a6fa-3a02-4f5e-abbf-1df0fe2e484b response_code = 200 uri = /network-bootstore-config
22882025-03-02T05:02:02.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52456
22892025-03-02T05:02:02.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52456 req_id = 4ae2e21e-a9e7-403a-9272-47d1bfb5827a response_code = 200 uri = /vpc-routes
22902025-03-02T05:02:02.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39410
22912025-03-02T05:02:02.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39410 req_id = 034d0057-c48a-4ea4-a475-547c5408d29f response_code = 200 uri = /v2p
22922025-03-02T05:02:02.156ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
22932025-03-02T05:02:02.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52456 req_id = 0137c898-a76f-4a3a-bd9e-a01d62c321e7 response_code = 204 uri = /eip-gateways
22942025-03-02T05:02:02.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52456 req_id = 6284362f-0df8-4c5d-87dd-0b3773483a37 response_code = 204 uri = /vpc-routes
22952025-03-02T05:02:02.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35636
22962025-03-02T05:02:02.231ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22972025-03-02T05:02:02.266ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22982025-03-02T05:02:02.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84908 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35636 req_id = 9eef5835-0260-4666-8af6-f7ae32e96c42 response_code = 204 uri = /switch-ports
22992025-03-02T05:02:02.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35636 req_id = 73549d95-34bd-48a7-84af-9a5fc2886759 response_code = 200 uri = /network-bootstore-config
23002025-03-02T05:02:12.922ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7428 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = b22a1ff9-89c3-4196-a39a-ef175f0b2d76 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
23012025-03-02T05:02:14.096ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64089
23022025-03-02T05:02:14.096ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64089 req_id = ee4aeabd-30f4-465c-b6a8-12080352fef7 response_code = 200 uri = /baseboard
23032025-03-02T05:02:30.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34129
23042025-03-02T05:02:30.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34129 req_id = 371ca6cd-32c1-4bee-86d1-c6bb8f3e88e1 response_code = 200 uri = /vpc-routes
23052025-03-02T05:02:30.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
23062025-03-02T05:02:30.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34129 req_id = 85adc41e-4c3d-4977-b7fc-2fdae198c22e response_code = 204 uri = /eip-gateways
23072025-03-02T05:02:30.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34129 req_id = d678af2f-8310-4370-8e77-087ad7e244b5 response_code = 204 uri = /vpc-routes
23082025-03-02T05:02:30.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54677
23092025-03-02T05:02:30.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54677 req_id = c7e52d11-e0fd-440d-9c30-6b8cefba2466 response_code = 200 uri = /vpc-routes
23102025-03-02T05:02:30.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53852
23112025-03-02T05:02:30.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53852 req_id = cb6d4eac-6dac-4972-ab10-735c72e95106 response_code = 200 uri = /v2p
23122025-03-02T05:02:30.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37330
23132025-03-02T05:02:30.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37330 req_id = 7bc953d4-d278-46ba-bc9b-d45daca04e16 response_code = 200 uri = /v2p
23142025-03-02T05:02:30.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64089
23152025-03-02T05:02:30.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23162025-03-02T05:02:30.859ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23172025-03-02T05:02:30.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91356 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64089 req_id = 730ae3be-e4fb-4ab6-b5d7-42b57e868550 response_code = 204 uri = /switch-ports
23182025-03-02T05:02:30.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60125
23192025-03-02T05:02:30.914ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
23202025-03-02T05:02:30.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64089 req_id = f89ea0ab-03c6-46fe-b227-482f108c3b40 response_code = 200 uri = /network-bootstore-config
23212025-03-02T05:02:30.914ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23222025-03-02T05:02:30.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54677 req_id = a7555850-14b2-4303-b868-575b2d201400 response_code = 204 uri = /eip-gateways
23232025-03-02T05:02:30.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54677 req_id = 91ce382e-f49c-4e6c-8ae6-2dfb31698fad response_code = 204 uri = /vpc-routes
23242025-03-02T05:02:30.954ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23252025-03-02T05:02:31.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60125 req_id = 1d821c00-653e-4da6-a4c7-c5beb4e7c1e8 response_code = 204 uri = /switch-ports
23262025-03-02T05:02:31.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60125 req_id = 859d45d6-4679-473a-94f3-9eabecab8f6f response_code = 200 uri = /network-bootstore-config
23272025-03-02T05:02:31.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33609
23282025-03-02T05:02:31.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33609 req_id = cbe6131c-7bb2-4047-bc30-03980eb46940 response_code = 200 uri = /vpc-routes
23292025-03-02T05:02:31.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41337
23302025-03-02T05:02:31.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41337 req_id = fde598a5-118a-4e7d-a8bf-1a1ea0db6cf1 response_code = 200 uri = /v2p
23312025-03-02T05:02:31.910ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
23322025-03-02T05:02:31.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33609 req_id = 52771c06-8401-42b5-983d-0e0a4405a80d response_code = 204 uri = /eip-gateways
23332025-03-02T05:02:31.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33609 req_id = 471618eb-7ebe-4a72-8f52-d951b8d1d042 response_code = 204 uri = /vpc-routes
23342025-03-02T05:02:31.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38925
23352025-03-02T05:02:31.933ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23362025-03-02T05:02:31.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23372025-03-02T05:02:32.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95206 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38925 req_id = 778c88ff-74f5-4132-b3b9-60da13874c81 response_code = 204 uri = /switch-ports
23382025-03-02T05:02:32.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38925 req_id = 29f53477-4945-4f08-bdac-572cbe4e45ac response_code = 200 uri = /network-bootstore-config
23392025-03-02T05:02:42.922ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7868 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = da699aed-fea0-43fe-a375-96573315e7c2 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
23402025-03-02T05:02:44.130ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63111
23412025-03-02T05:02:44.130ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63111 req_id = 3f9cbb58-b647-439f-b0cb-57dc9f0ebe77 response_code = 200 uri = /baseboard
23422025-03-02T05:03:00.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43573
23432025-03-02T05:03:00.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43573 req_id = 3ffa6442-4453-4d69-8e47-9aeee098346c response_code = 200 uri = /vpc-routes
23442025-03-02T05:03:00.834ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
23452025-03-02T05:03:00.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43573 req_id = ae6cac8b-457a-4d3c-ba87-a97fda97829c response_code = 204 uri = /eip-gateways
23462025-03-02T05:03:00.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43573 req_id = 0f7945af-b07d-4c13-b52e-b51cf58ff720 response_code = 204 uri = /vpc-routes
23472025-03-02T05:03:00.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37109
23482025-03-02T05:03:00.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37109 req_id = b0aee373-b048-4911-bc1d-df08b8655fd7 response_code = 200 uri = /v2p
23492025-03-02T05:03:00.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53892
23502025-03-02T05:03:00.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53892 req_id = 641702ee-8aba-4269-b6fa-617e296010e2 response_code = 200 uri = /vpc-routes
23512025-03-02T05:03:01.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
23522025-03-02T05:03:01.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53892 req_id = 7182a038-40b7-4147-8acb-b97937d4e9e1 response_code = 204 uri = /eip-gateways
23532025-03-02T05:03:01.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53892 req_id = 6005ad65-5972-420d-bd51-e75e66de8fb0 response_code = 204 uri = /vpc-routes
23542025-03-02T05:03:01.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35276
23552025-03-02T05:03:01.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35276 req_id = 3600ba17-ef9c-4c8b-bdf4-0764870a70f3 response_code = 200 uri = /v2p
23562025-03-02T05:03:01.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63365
23572025-03-02T05:03:01.139ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23582025-03-02T05:03:01.177ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23592025-03-02T05:03:01.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93151 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63365 req_id = 70e33cdd-6876-4f77-a27d-44ae5a0879be response_code = 204 uri = /switch-ports
23602025-03-02T05:03:01.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60237
23612025-03-02T05:03:01.233ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23622025-03-02T05:03:01.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63365 req_id = 69448f8f-5ae7-4118-badb-7e32a0d551c0 response_code = 200 uri = /network-bootstore-config
23632025-03-02T05:03:01.267ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23642025-03-02T05:03:01.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86007 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60237 req_id = f74204d5-e6eb-40b8-bd01-978da0df8170 response_code = 204 uri = /switch-ports
23652025-03-02T05:03:01.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60237 req_id = 6367e360-774e-4904-81cb-6b246e5b0126 response_code = 200 uri = /network-bootstore-config
23662025-03-02T05:03:01.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37407
23672025-03-02T05:03:01.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37407 req_id = 67703f3c-2e34-43bd-b6cc-2f09705589a4 response_code = 200 uri = /vpc-routes
23682025-03-02T05:03:01.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
23692025-03-02T05:03:01.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37407 req_id = 5c74abbb-3fcc-4339-9ade-47d4af58fa15 response_code = 204 uri = /eip-gateways
23702025-03-02T05:03:01.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37407 req_id = 9bdec867-20d9-47a9-904a-ef785ecc7e32 response_code = 204 uri = /vpc-routes
23712025-03-02T05:03:02.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56536
23722025-03-02T05:03:02.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56536 req_id = 752c4fec-83c1-4595-b94b-914d9fbc5722 response_code = 200 uri = /v2p
23732025-03-02T05:03:02.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49775
23742025-03-02T05:03:02.103ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23752025-03-02T05:03:02.140ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23762025-03-02T05:03:02.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90760 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49775 req_id = ccba84cc-ad1a-4462-a51d-7830b30953bd response_code = 204 uri = /switch-ports
23772025-03-02T05:03:02.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49775 req_id = f3e9def4-1d18-458d-b666-246590291cca response_code = 200 uri = /network-bootstore-config
23782025-03-02T05:03:12.923ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7160 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = 7a66d31f-e24a-4b7d-915a-db28fbf2f583 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
23792025-03-02T05:03:14.163ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54916
23802025-03-02T05:03:14.163ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54916 req_id = ec1edb94-40bf-4bdb-ad5c-46af376d96c1 response_code = 200 uri = /baseboard
23812025-03-02T05:03:30.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50140
23822025-03-02T05:03:30.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50140 req_id = 506b180e-cde0-4d7d-8542-a08520674f46 response_code = 200 uri = /vpc-routes
23832025-03-02T05:03:30.650ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
23842025-03-02T05:03:30.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50140 req_id = fc54b6ae-7a3b-418a-9e98-d3afb9b5ea0d response_code = 204 uri = /eip-gateways
23852025-03-02T05:03:30.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50140 req_id = b7be6325-8eae-4c3f-98b5-8b5ca07d752c response_code = 204 uri = /vpc-routes
23862025-03-02T05:03:30.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57478
23872025-03-02T05:03:30.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38676
23882025-03-02T05:03:30.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57478 req_id = 77dbbf32-87a2-42aa-8431-af494b485ee2 response_code = 200 uri = /vpc-routes
23892025-03-02T05:03:30.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38676 req_id = b659949f-71c4-4f27-b9d9-e23204fcaaf2 response_code = 200 uri = /v2p
23902025-03-02T05:03:30.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48729
23912025-03-02T05:03:30.727ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23922025-03-02T05:03:30.767ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23932025-03-02T05:03:30.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48729 req_id = 9b99ee33-8883-417d-bb43-363e1c2df0f1 response_code = 204 uri = /switch-ports
23942025-03-02T05:03:30.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50058
23952025-03-02T05:03:30.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34826
23962025-03-02T05:03:30.824ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23972025-03-02T05:03:30.824ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
23982025-03-02T05:03:30.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57478 req_id = 42073272-9da1-4eb8-acd0-b19a45bcea42 response_code = 204 uri = /eip-gateways
23992025-03-02T05:03:30.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48729 req_id = 0219b4e6-555f-4575-b91b-2aab41549c9a response_code = 200 uri = /network-bootstore-config
24002025-03-02T05:03:30.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3964 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34826 req_id = 0e14480e-b765-4f2a-ba9b-b939c1b45e61 response_code = 200 uri = /v2p
24012025-03-02T05:03:30.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57478 req_id = 48d93786-b24b-4642-9267-1b635287b5c6 response_code = 204 uri = /vpc-routes
24022025-03-02T05:03:30.860ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24032025-03-02T05:03:30.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90715 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50058 req_id = 11db67a6-cd68-4774-820c-c15e5b768c8c response_code = 204 uri = /switch-ports
24042025-03-02T05:03:30.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50058 req_id = d1a9a24b-76b7-4236-8a01-fd2deb0fed8c response_code = 200 uri = /network-bootstore-config
24052025-03-02T05:03:31.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35365
24062025-03-02T05:03:31.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35365 req_id = 0d2aa075-b4d9-42a4-af49-ac0cf8a8e231 response_code = 200 uri = /vpc-routes
24072025-03-02T05:03:31.964ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
24082025-03-02T05:03:31.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35365 req_id = ff52057a-45f8-4873-8a3a-d03d04a70388 response_code = 204 uri = /eip-gateways
24092025-03-02T05:03:31.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35365 req_id = e79b2085-1390-457e-8a4a-d7a6b3610f05 response_code = 204 uri = /vpc-routes
24102025-03-02T05:03:31.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54752
24112025-03-02T05:03:31.988ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24122025-03-02T05:03:32.031ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24132025-03-02T05:03:32.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102722 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54752 req_id = e41dbd24-2d9b-4aaa-9ff3-19735ec265eb response_code = 204 uri = /switch-ports
24142025-03-02T05:03:32.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42484
24152025-03-02T05:03:32.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54752 req_id = abaf04eb-d1ca-4031-872b-0253f4ebb536 response_code = 200 uri = /network-bootstore-config
24162025-03-02T05:03:32.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42484 req_id = 1862c462-0d8f-4bfe-afe0-2fde50ff81ef response_code = 200 uri = /v2p
24172025-03-02T05:03:37.602ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24182025-03-02T05:03:37.603ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24192025-03-02T05:03:37.632ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 4146, tv_nsec: 861721116 } time_to_next_cleanup = 599.99999847s
24202025-03-02T05:03:42.921ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6890 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = 5c801a7a-9388-409e-ae29-036ead22a6c0 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
24212025-03-02T05:03:44.197ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54359
24222025-03-02T05:03:44.197ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54359 req_id = 4f499c13-75f3-4ab1-a242-493a54c5e209 response_code = 200 uri = /baseboard
24232025-03-02T05:03:51.946ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24242025-03-02T05:04:00.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49450
24252025-03-02T05:04:00.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49450 req_id = ed7826ee-2ab8-4f3e-bcce-feda3b11f40a response_code = 200 uri = /vpc-routes
24262025-03-02T05:04:00.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
24272025-03-02T05:04:00.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49450 req_id = 6ba7b86a-86b8-4c2a-a42a-c0970f7f8a20 response_code = 204 uri = /eip-gateways
24282025-03-02T05:04:00.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49450 req_id = 85e44a74-d4de-4bc6-bf51-920d020c7860 response_code = 204 uri = /vpc-routes
24292025-03-02T05:04:00.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48422
24302025-03-02T05:04:00.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48422 req_id = 50c93c04-f616-4c24-b7d6-c0bd7463ce3b response_code = 200 uri = /vpc-routes
24312025-03-02T05:04:00.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
24322025-03-02T05:04:00.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48422 req_id = 6acd2a00-061e-4ed8-975a-24bfc8465546 response_code = 204 uri = /eip-gateways
24332025-03-02T05:04:00.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 411 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48422 req_id = a798e8c8-3944-4750-ab0a-8179090c578d response_code = 204 uri = /vpc-routes
24342025-03-02T05:04:00.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50010
24352025-03-02T05:04:00.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50010 req_id = f122c2f2-a4fa-44e3-ba08-583cca1db01a response_code = 200 uri = /v2p
24362025-03-02T05:04:00.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35304
24372025-03-02T05:04:00.987ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24382025-03-02T05:04:01.036ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24392025-03-02T05:04:01.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102579 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35304 req_id = 9dbde026-09ba-489a-909f-922a88bcb604 response_code = 204 uri = /switch-ports
24402025-03-02T05:04:01.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37544
24412025-03-02T05:04:01.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37544 req_id = c3579592-1ad3-4569-9e13-33f15fbbc5ea response_code = 200 uri = /v2p
24422025-03-02T05:04:01.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35304 req_id = adcae81d-5f5e-4282-a10d-782104a3fe1c response_code = 200 uri = /network-bootstore-config
24432025-03-02T05:04:01.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58399
24442025-03-02T05:04:01.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24452025-03-02T05:04:01.185ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24462025-03-02T05:04:01.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90747 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58399 req_id = ae7b0bb7-59e3-4a63-89d2-d4da3b9277cf response_code = 204 uri = /switch-ports
24472025-03-02T05:04:01.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58399 req_id = cbe6cf7e-5fc3-4c5f-8a32-75e81bc542bc response_code = 200 uri = /network-bootstore-config
24482025-03-02T05:04:01.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33684
24492025-03-02T05:04:01.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33684 req_id = f321ddde-7949-462b-bb51-4772b99a1807 response_code = 200 uri = /vpc-routes
24502025-03-02T05:04:01.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58116
24512025-03-02T05:04:01.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58116 req_id = 4da2248b-dab6-447c-86d7-23e790fc55ce response_code = 200 uri = /v2p
24522025-03-02T05:04:02.044ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
24532025-03-02T05:04:02.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33684 req_id = 831a5502-4189-4cb6-a6b8-d9dab8363493 response_code = 204 uri = /eip-gateways
24542025-03-02T05:04:02.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33684 req_id = 3a98235f-2609-4141-804d-cde3d04f702f response_code = 204 uri = /vpc-routes
24552025-03-02T05:04:02.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34428
24562025-03-02T05:04:02.209ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24572025-03-02T05:04:02.246ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24582025-03-02T05:04:02.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34428 req_id = 58f9782f-96ae-4f75-a0c6-a0c7e09fd67c response_code = 204 uri = /switch-ports
24592025-03-02T05:04:02.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34428 req_id = de755213-2a23-4807-8482-9850b4624551 response_code = 200 uri = /network-bootstore-config
24602025-03-02T05:04:12.922ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7647 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = 6e5c203c-a76d-4f21-bc66-2be0a05fa9a5 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
24612025-03-02T05:04:14.231ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42828
24622025-03-02T05:04:14.231ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42828 req_id = 2dc1e5c5-76b7-49f2-8cb4-337171c9d2a8 response_code = 200 uri = /baseboard
24632025-03-02T05:04:30.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47033
24642025-03-02T05:04:30.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47033 req_id = bdd9c22c-e848-4e0a-a1b1-4fdef913f619 response_code = 200 uri = /v2p
24652025-03-02T05:04:30.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41036
24662025-03-02T05:04:30.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41036 req_id = 613f0d50-8b8d-457c-903d-62ddca02635b response_code = 200 uri = /vpc-routes
24672025-03-02T05:04:30.695ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
24682025-03-02T05:04:30.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41036 req_id = 23f5faca-358c-4949-9545-ad3a116fa8d7 response_code = 204 uri = /eip-gateways
24692025-03-02T05:04:30.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41036 req_id = 3ac2a1b6-1898-4daa-9e1a-50bcd43725fb response_code = 204 uri = /vpc-routes
24702025-03-02T05:04:30.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51463
24712025-03-02T05:04:30.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51463 req_id = 20a27685-6bb7-419d-ab73-20551c018ab5 response_code = 200 uri = /vpc-routes
24722025-03-02T05:04:30.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56885
24732025-03-02T05:04:30.756ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24742025-03-02T05:04:30.795ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24752025-03-02T05:04:30.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102486 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56885 req_id = 1d152dd7-5f6b-490d-9e93-a8f1970f42fd response_code = 204 uri = /switch-ports
24762025-03-02T05:04:30.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
24772025-03-02T05:04:30.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51463 req_id = fbe320ea-e299-4ba0-ac48-067bef7a24cc response_code = 204 uri = /eip-gateways
24782025-03-02T05:04:30.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56885 req_id = 33c08336-1e6e-44b6-b2cb-48c06e2475eb response_code = 200 uri = /network-bootstore-config
24792025-03-02T05:04:30.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51463 req_id = fc90c982-3d06-40fa-b23a-f6f4b64cf869 response_code = 204 uri = /vpc-routes
24802025-03-02T05:04:30.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34030
24812025-03-02T05:04:30.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34030 req_id = 364ebaef-1679-4566-ad92-64b3521aa23a response_code = 200 uri = /v2p
24822025-03-02T05:04:31.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35456
24832025-03-02T05:04:31.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24842025-03-02T05:04:31.049ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24852025-03-02T05:04:31.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90055 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35456 req_id = f855d0d6-1785-45c7-a1e8-80cc15a986ac response_code = 204 uri = /switch-ports
24862025-03-02T05:04:31.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35456 req_id = d204c730-5a0c-4037-a43a-bf6a297080d1 response_code = 200 uri = /network-bootstore-config
24872025-03-02T05:04:31.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44192
24882025-03-02T05:04:31.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44192 req_id = aab8ed6b-65fd-40bf-817b-f3d3739cd103 response_code = 200 uri = /vpc-routes
24892025-03-02T05:04:31.927ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
24902025-03-02T05:04:31.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44192 req_id = ca847c57-410b-4818-9bcb-c39d27d35e4d response_code = 204 uri = /eip-gateways
24912025-03-02T05:04:31.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44192 req_id = 55067880-58fe-4a34-aae5-759e6af542e0 response_code = 204 uri = /vpc-routes
24922025-03-02T05:04:31.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60588
24932025-03-02T05:04:31.952ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24942025-03-02T05:04:31.989ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24952025-03-02T05:04:32.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94872 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60588 req_id = 6d899524-d583-40c7-ae65-7a75812ed7cc response_code = 204 uri = /switch-ports
24962025-03-02T05:04:32.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43809
24972025-03-02T05:04:32.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43809 req_id = 428cd859-55c9-4ce4-97dc-90324cbf7afe response_code = 200 uri = /v2p
24982025-03-02T05:04:32.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60588 req_id = b77e2920-df71-4d47-89e4-0fb16247ccad response_code = 200 uri = /network-bootstore-config
24992025-03-02T05:04:42.922ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7554 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = ab8736ea-306c-491c-8e1a-5c91d8cb1c5e response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
25002025-03-02T05:04:44.267ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38002
25012025-03-02T05:04:44.267ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38002 req_id = 8897b837-79c0-4935-91d8-edea006b0a9a response_code = 200 uri = /baseboard
25022025-03-02T05:05:00.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38096
25032025-03-02T05:05:00.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38096 req_id = 09929aa5-95a5-4107-a7c9-33d4cf66d84a response_code = 200 uri = /v2p
25042025-03-02T05:05:00.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63529
25052025-03-02T05:05:00.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63529 req_id = 117a951f-bd42-4728-9b8c-42982b4a076c response_code = 200 uri = /vpc-routes
25062025-03-02T05:05:00.834ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
25072025-03-02T05:05:00.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63529 req_id = cdd30d9c-2feb-41bf-ba6c-6b497d14e379 response_code = 204 uri = /eip-gateways
25082025-03-02T05:05:00.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63529 req_id = da0c791a-1918-4766-9234-5f42fe05b90e response_code = 204 uri = /vpc-routes
25092025-03-02T05:05:00.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41751
25102025-03-02T05:05:00.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41751 req_id = 6a482515-5092-423a-a830-50f85a42125a response_code = 200 uri = /v2p
25112025-03-02T05:05:00.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49833
25122025-03-02T05:05:00.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49833 req_id = 53831800-816c-445e-a487-2701ed46faec response_code = 200 uri = /vpc-routes
25132025-03-02T05:05:00.886ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
25142025-03-02T05:05:00.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49833 req_id = 918b24b4-0a3d-4ff7-9de9-f27c45a74723 response_code = 204 uri = /eip-gateways
25152025-03-02T05:05:00.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49833 req_id = 7f22d815-42e2-4e9b-86aa-c001e72e1467 response_code = 204 uri = /vpc-routes
25162025-03-02T05:05:00.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58760
25172025-03-02T05:05:00.948ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25182025-03-02T05:05:00.986ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25192025-03-02T05:05:01.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92356 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58760 req_id = e35af16e-c322-41a0-a67f-975100353c93 response_code = 204 uri = /switch-ports
25202025-03-02T05:05:01.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58760 req_id = b19c502e-fa5d-45e6-abd5-ed0285e3cd0d response_code = 200 uri = /network-bootstore-config
25212025-03-02T05:05:01.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33980
25222025-03-02T05:05:01.362ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25232025-03-02T05:05:01.399ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25242025-03-02T05:05:01.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90165 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33980 req_id = 9906a8ba-c83f-47c9-828c-f01ba02a33a7 response_code = 204 uri = /switch-ports
25252025-03-02T05:05:01.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33980 req_id = a5e27dc1-bf7a-4640-94c5-b5668f5a873b response_code = 200 uri = /network-bootstore-config
25262025-03-02T05:05:01.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61991
25272025-03-02T05:05:01.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61991 req_id = 5d14f0e3-d7eb-4f55-bd21-b3562ef38910 response_code = 200 uri = /vpc-routes
25282025-03-02T05:05:01.997ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
25292025-03-02T05:05:01.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61991 req_id = f5c37924-ffd7-4ef5-82ab-c8b3c96a337f response_code = 204 uri = /eip-gateways
25302025-03-02T05:05:02.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61991 req_id = c8652bfd-ef27-4aad-b916-8afe893d1bfd response_code = 204 uri = /vpc-routes
25312025-03-02T05:05:02.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61801
25322025-03-02T05:05:02.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61801 req_id = 79c078f4-0e32-4be0-bb8b-881bc1f5ac04 response_code = 200 uri = /v2p
25332025-03-02T05:05:02.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65532
25342025-03-02T05:05:02.177ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25352025-03-02T05:05:02.213ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25362025-03-02T05:05:02.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65532 req_id = b15213a4-2172-45ad-8f99-c5c6c4a23519 response_code = 204 uri = /switch-ports
25372025-03-02T05:05:02.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65532 req_id = 690bb41e-5601-4c85-8ddd-c91fc948848d response_code = 200 uri = /network-bootstore-config
25382025-03-02T05:05:12.923ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8282 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = e3827b3d-3bc5-448b-b3e8-f24e7dc08eed response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
25392025-03-02T05:05:14.301ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38922
25402025-03-02T05:05:14.301ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38922 req_id = 196608e9-b88a-4286-9c61-ecde883873ad response_code = 200 uri = /baseboard
25412025-03-02T05:05:30.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54585
25422025-03-02T05:05:30.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54585 req_id = c7e892dc-a681-4a0f-89ff-2174846c7da0 response_code = 200 uri = /vpc-routes
25432025-03-02T05:05:30.639ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
25442025-03-02T05:05:30.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54585 req_id = cacb0871-6640-44bf-92c8-89894de95112 response_code = 204 uri = /eip-gateways
25452025-03-02T05:05:30.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54585 req_id = d1a8afe1-7819-4a75-af80-698427f610e0 response_code = 204 uri = /vpc-routes
25462025-03-02T05:05:30.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44958
25472025-03-02T05:05:30.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44958 req_id = f92d0be9-9568-44e8-b1b7-2c0ec946b712 response_code = 200 uri = /vpc-routes
25482025-03-02T05:05:30.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35336
25492025-03-02T05:05:30.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35336 req_id = 2e480c50-1faf-49fe-8850-a7bc7a9d5a3b response_code = 200 uri = /v2p
25502025-03-02T05:05:30.720ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
25512025-03-02T05:05:30.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44958 req_id = 28539950-1ded-45a1-8f0a-0c523e829430 response_code = 204 uri = /eip-gateways
25522025-03-02T05:05:30.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44223
25532025-03-02T05:05:30.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44223 req_id = 0051cdf7-843b-4c27-ae03-cbc8b23a6567 response_code = 200 uri = /v2p
25542025-03-02T05:05:30.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44958 req_id = 38a04041-0ab7-4202-9867-e486ee11c6ca response_code = 204 uri = /vpc-routes
25552025-03-02T05:05:30.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34969
25562025-03-02T05:05:30.733ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25572025-03-02T05:05:30.772ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25582025-03-02T05:05:30.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97392 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34969 req_id = 8aa4976a-e2fe-4fe4-a494-e22fd05594df response_code = 204 uri = /switch-ports
25592025-03-02T05:05:30.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54847
25602025-03-02T05:05:30.830ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25612025-03-02T05:05:30.864ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25622025-03-02T05:05:30.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88336 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54847 req_id = 02080ca5-a509-4c62-b7e9-ceb03eb277f3 response_code = 204 uri = /switch-ports
25632025-03-02T05:05:30.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54847 req_id = 82df76f0-5c42-4c68-92c9-c8ab385c0d95 response_code = 200 uri = /network-bootstore-config
25642025-03-02T05:05:30.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34969 req_id = cfc9f7c9-cedd-429e-9f7c-1a3f9ff5b6fb response_code = 200 uri = /network-bootstore-config
25652025-03-02T05:05:31.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38946
25662025-03-02T05:05:31.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38946 req_id = b0a19cf0-5ec2-46a5-9e07-d5a9ccffe369 response_code = 200 uri = /vpc-routes
25672025-03-02T05:05:31.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60398
25682025-03-02T05:05:31.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60398 req_id = baaa9406-8715-48a1-b143-e35a36d1281e response_code = 200 uri = /v2p
25692025-03-02T05:05:31.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
25702025-03-02T05:05:31.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38946 req_id = 81efbc40-cba4-44fe-88be-aa675fee9e4a response_code = 204 uri = /eip-gateways
25712025-03-02T05:05:31.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38946 req_id = a6b0b8c8-8afe-456b-9ee8-a9580aa64023 response_code = 204 uri = /vpc-routes
25722025-03-02T05:05:31.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46737
25732025-03-02T05:05:31.949ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25742025-03-02T05:05:31.984ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25752025-03-02T05:05:32.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91875 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46737 req_id = fac8f4b5-3ed7-4d54-875a-bd7f6f53ca30 response_code = 204 uri = /switch-ports
25762025-03-02T05:05:32.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46737 req_id = 9f808cb0-e07e-4673-8b2b-8f7d598674de response_code = 200 uri = /network-bootstore-config
25772025-03-02T05:05:42.922ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7090 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = 31d9b0a3-505d-4bcf-a99e-c71193267c9b response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
25782025-03-02T05:05:44.336ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50033
25792025-03-02T05:05:44.336ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50033 req_id = b0001e27-67f3-475d-9f67-b1b48efc000b response_code = 200 uri = /baseboard
25802025-03-02T05:06:00.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38119
25812025-03-02T05:06:00.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38119 req_id = 3f124f2a-03f2-4656-820f-cb691be41143 response_code = 200 uri = /vpc-routes
25822025-03-02T05:06:00.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50476
25832025-03-02T05:06:00.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50476 req_id = 69d03f20-51c7-40ea-b922-f3fe49fede0b response_code = 200 uri = /vpc-routes
25842025-03-02T05:06:00.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
25852025-03-02T05:06:00.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38119 req_id = b224e490-6b6a-4dee-b6c4-0edca77d228a response_code = 204 uri = /eip-gateways
25862025-03-02T05:06:00.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38119 req_id = cff9f701-acc5-4c80-b867-e1d3fd67b01f response_code = 204 uri = /vpc-routes
25872025-03-02T05:06:00.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54086
25882025-03-02T05:06:00.868ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25892025-03-02T05:06:00.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 400 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54086 req_id = 77a59b6c-6562-4dfb-a82e-3966eed4f11b response_code = 200 uri = /artifacts
25902025-03-02T05:06:00.871ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
25912025-03-02T05:06:00.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50476 req_id = 0d40b732-5960-4345-9bc0-2c5a147b0f98 response_code = 204 uri = /eip-gateways
25922025-03-02T05:06:00.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50476 req_id = 9738dfd2-27c8-47f4-b9f3-5cbf90ba2b36 response_code = 204 uri = /vpc-routes
25932025-03-02T05:06:00.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41624
25942025-03-02T05:06:00.981ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25952025-03-02T05:06:01.022ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25962025-03-02T05:06:01.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105049 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41624 req_id = be3cf565-865c-4dbc-8917-b0f230f4913c response_code = 204 uri = /switch-ports
25972025-03-02T05:06:01.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44172
25982025-03-02T05:06:01.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51145
25992025-03-02T05:06:01.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63435
26002025-03-02T05:06:01.086ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26012025-03-02T05:06:01.086ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26022025-03-02T05:06:01.086ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26032025-03-02T05:06:01.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41624 req_id = 0eb812f1-78d8-47eb-9f89-20a85846d37c response_code = 200 uri = /network-bootstore-config
26042025-03-02T05:06:01.086ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-zones.json file = common/src/ledger.rs:177
26052025-03-02T05:06:01.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44172 req_id = fc20c94a-1675-4758-b60c-d6057b3fad85 response_code = 200 uri = /v2p
26062025-03-02T05:06:01.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 474 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63435 req_id = b5761cfd-c5ba-4e65-9a7a-2fd68ffb9542 response_code = 200 uri = /artifacts
26072025-03-02T05:06:01.087ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-zones.json file = common/src/ledger.rs:177
26082025-03-02T05:06:01.106ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26092025-03-02T05:06:01.106ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107
26102025-03-02T05:06:01.136ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26112025-03-02T05:06:01.136ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6
26122025-03-02T05:06:01.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41135
26132025-03-02T05:06:01.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41135 req_id = f801cf08-0e55-4fb7-b418-4ec38e98fd46 response_code = 200 uri = /v2p
26142025-03-02T05:06:01.164ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26152025-03-02T05:06:01.164ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe
26162025-03-02T05:06:01.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62222
26172025-03-02T05:06:01.179ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26182025-03-02T05:06:01.179ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26192025-03-02T05:06:01.179ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-zones.json file = common/src/ledger.rs:177
26202025-03-02T05:06:01.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61463
26212025-03-02T05:06:01.186ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-zones.json file = common/src/ledger.rs:177
26222025-03-02T05:06:01.186ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26232025-03-02T05:06:01.195ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26242025-03-02T05:06:01.196ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c
26252025-03-02T05:06:01.213ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26262025-03-02T05:06:01.213ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107
26272025-03-02T05:06:01.237ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26282025-03-02T05:06:01.242ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26292025-03-02T05:06:01.242ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6
26302025-03-02T05:06:01.260ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26312025-03-02T05:06:01.260ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db
26322025-03-02T05:06:01.278ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26332025-03-02T05:06:01.278ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe
26342025-03-02T05:06:01.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65429
26352025-03-02T05:06:01.287ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26362025-03-02T05:06:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26372025-03-02T05:06:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26382025-03-02T05:06:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26392025-03-02T05:06:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26402025-03-02T05:06:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26412025-03-02T05:06:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26422025-03-02T05:06:01.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4867 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65429 req_id = 89f56c7e-86f5-4d91-ba8f-de05cbe85a17 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26432025-03-02T05:06:01.293ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26442025-03-02T05:06:01.293ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_02f51c32-d098-4db1-aebc-508861ba7b69
26452025-03-02T05:06:01.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124612 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61463 req_id = 5668270b-1d60-466c-b78e-d09a9896cb7e response_code = 204 uri = /switch-ports
26462025-03-02T05:06:01.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 685 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61463 req_id = 36f32f9c-b645-4d74-a62e-faa06b9b2d53 response_code = 200 uri = /network-bootstore-config
26472025-03-02T05:06:01.319ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26482025-03-02T05:06:01.319ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6172af12-6fa7-4d40-b551-2b1c147126ca
26492025-03-02T05:06:01.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63332
26502025-03-02T05:06:01.331ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26512025-03-02T05:06:01.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
26522025-03-02T05:06:01.332ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26532025-03-02T05:06:01.332ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26542025-03-02T05:06:01.332ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26552025-03-02T05:06:01.332ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26562025-03-02T05:06:01.332ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26572025-03-02T05:06:01.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 433 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63332 req_id = 9b1a141e-8b99-4f87-b1bd-71fc16ef34b1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26582025-03-02T05:06:01.332ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26592025-03-02T05:06:01.332ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c
26602025-03-02T05:06:01.349ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26612025-03-02T05:06:01.349ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_59d556b1-49a0-4ea6-b384-37f0944c2057
26622025-03-02T05:06:01.364ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26632025-03-02T05:06:01.364ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db
26642025-03-02T05:06:01.385ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26652025-03-02T05:06:01.385ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_02f51c32-d098-4db1-aebc-508861ba7b69
26662025-03-02T05:06:01.399ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26672025-03-02T05:06:01.399ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505
26682025-03-02T05:06:01.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 326853 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51145 req_id = 07aa0f38-694e-4a53-a60e-643bb7b42a41 response_code = 200 uri = /inventory
26692025-03-02T05:06:01.414ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26702025-03-02T05:06:01.414ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6172af12-6fa7-4d40-b551-2b1c147126ca
26712025-03-02T05:06:01.438ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26722025-03-02T05:06:01.438ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_59d556b1-49a0-4ea6-b384-37f0944c2057
26732025-03-02T05:06:01.461ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26742025-03-02T05:06:01.461ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505
26752025-03-02T05:06:01.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 296727 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62222 req_id = 16449bd0-f0de-4317-8fa5-5fb2194f8112 response_code = 200 uri = /inventory
26762025-03-02T05:06:02.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60267
26772025-03-02T05:06:02.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60267 req_id = 79855e00-1604-4fbf-9da2-6036c3cbcf34 response_code = 200 uri = /vpc-routes
26782025-03-02T05:06:02.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64126
26792025-03-02T05:06:02.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26802025-03-02T05:06:02.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64126 req_id = b9ccd141-5878-41c5-8833-53c74ce1805d response_code = 200 uri = /artifacts
26812025-03-02T05:06:02.217ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
26822025-03-02T05:06:02.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60267 req_id = b3dcb39c-0dd0-43f6-a8ec-3400382acee4 response_code = 204 uri = /eip-gateways
26832025-03-02T05:06:02.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60267 req_id = 4175a0fb-f319-47bb-868e-980f21ea5b3a response_code = 204 uri = /vpc-routes
26842025-03-02T05:06:02.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58748
26852025-03-02T05:06:02.269ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26862025-03-02T05:06:02.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26872025-03-02T05:06:02.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103437 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58748 req_id = a17bbe1a-f81d-4322-999a-e3c0f37cc862 response_code = 204 uri = /switch-ports
26882025-03-02T05:06:02.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44155
26892025-03-02T05:06:02.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44155 req_id = af46ecb5-2ba8-467e-beb9-9ae374de8bee response_code = 200 uri = /v2p
26902025-03-02T05:06:02.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58748 req_id = 9ecc3b6f-1feb-46d8-bea8-36973a7f802e response_code = 200 uri = /network-bootstore-config
26912025-03-02T05:06:02.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37544
26922025-03-02T05:06:02.402ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26932025-03-02T05:06:02.402ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26942025-03-02T05:06:02.402ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/config/omicron-zones.json file = common/src/ledger.rs:177
26952025-03-02T05:06:02.403ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/137ad444-dc66-45be-a069-b93fb154c65f/config/omicron-zones.json file = common/src/ledger.rs:177
26962025-03-02T05:06:02.415ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26972025-03-02T05:06:02.415ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107
26982025-03-02T05:06:02.438ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f73fac08-e143-4ee5-a579-2b9dce4ff3f6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26992025-03-02T05:06:02.438ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f73fac08-e143-4ee5-a579-2b9dce4ff3f6
27002025-03-02T05:06:02.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43365
27012025-03-02T05:06:02.442ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3e4064c5-fe59-43d0-88e0-3ed3e0a5eba7, kind: Service { id: c54e30d8-f5a2-495b-b2d8-a78319addcd7 }, name: Name("external-dns-c54e30d8-f5a2-495b-b2d8-a78319addcd7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 192])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef033b7d-0ede-4639-ab7f-6d87d9d01240, kind: Service { id: 4a50e69a-1735-4503-96cb-55c6cc854815 }, name: Name("external-dns-4a50e69a-1735-4503-96cb-55c6cc854815"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 0])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d1ce337-a06d-4661-8223-cff03228021a, kind: Service { id: aebed526-5e03-4a58-86b5-1baf17c88392 }, name: Name("nexus-aebed526-5e03-4a58-86b5-1baf17c88392"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 2])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7854a1af-bcd2-41ab-9d60-4bc505686339, kind: Service { id: 091811f5-b683-4991-98f0-82afb4d1f635 }, name: Name("nexus-091811f5-b683-4991-98f0-82afb4d1f635"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b52288c2-a03b-488b-890b-db71040a1e60, kind: Service { id: feddb706-b221-4d1f-920c-1d1979b5460b }, name: Name("nexus-feddb706-b221-4d1f-920c-1d1979b5460b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 53])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27022025-03-02T05:06:02.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27032025-03-02T05:06:02.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27042025-03-02T05:06:02.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27052025-03-02T05:06:02.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27062025-03-02T05:06:02.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27072025-03-02T05:06:02.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27082025-03-02T05:06:02.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 646 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43365 req_id = 470aee19-12e1-48d9-b99a-ec7686f1fe1c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27092025-03-02T05:06:02.463ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b8159dea-4574-4646-9e75-83a2e5fdd3fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27102025-03-02T05:06:02.463ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b8159dea-4574-4646-9e75-83a2e5fdd3fe
27112025-03-02T05:06:02.485ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27122025-03-02T05:06:02.485ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c
27132025-03-02T05:06:02.507ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6c14f7f3-ae98-4e2b-8048-0bd7ddd632db (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27142025-03-02T05:06:02.507ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6c14f7f3-ae98-4e2b-8048-0bd7ddd632db
27152025-03-02T05:06:02.528ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 02f51c32-d098-4db1-aebc-508861ba7b69 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27162025-03-02T05:06:02.528ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_02f51c32-d098-4db1-aebc-508861ba7b69
27172025-03-02T05:06:02.549ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6172af12-6fa7-4d40-b551-2b1c147126ca (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27182025-03-02T05:06:02.549ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6172af12-6fa7-4d40-b551-2b1c147126ca
27192025-03-02T05:06:02.571ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 59d556b1-49a0-4ea6-b384-37f0944c2057 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27202025-03-02T05:06:02.571ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_59d556b1-49a0-4ea6-b384-37f0944c2057
27212025-03-02T05:06:02.592ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3be3d661-9b63-4e47-93ce-3eb0d2503505 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27222025-03-02T05:06:02.592ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3be3d661-9b63-4e47-93ce-3eb0d2503505
27232025-03-02T05:06:02.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 202997 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37544 req_id = 6504523a-2621-41f0-9776-ad796b7c4adf response_code = 200 uri = /inventory
27242025-03-02T05:06:12.924ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8583 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = b7948069-1d8b-4372-9c93-4a16a4492ffc response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
27252025-03-02T05:06:14.370ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43825
27262025-03-02T05:06:14.370ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43825 req_id = a186da0b-935d-4427-9730-08f7b94370a1 response_code = 200 uri = /baseboard
27272025-03-02T05:06:30.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37254
27282025-03-02T05:06:30.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37254 req_id = 1606f58b-5df8-4ce9-aa69-917385f8fded response_code = 200 uri = /vpc-routes
27292025-03-02T05:06:30.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48943
27302025-03-02T05:06:30.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48943 req_id = d129089a-67af-4e62-a782-3f6b1d99c0c6 response_code = 200 uri = /vpc-routes
27312025-03-02T05:06:30.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39383
27322025-03-02T05:06:30.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39383 req_id = 7911afaa-096d-4d7d-a244-61c81b1696d6 response_code = 200 uri = /v2p
27332025-03-02T05:06:30.717ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
27342025-03-02T05:06:30.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37254 req_id = 13fb0950-9da2-42cd-be0a-9228a1b3612c response_code = 204 uri = /eip-gateways
27352025-03-02T05:06:30.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37254 req_id = d43dee7c-2c88-4a1a-893a-d6c926ae8a8f response_code = 204 uri = /vpc-routes
27362025-03-02T05:06:30.738ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
27372025-03-02T05:06:30.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48943 req_id = 423812b3-ed06-49c2-8ab8-c4963f1bac99 response_code = 204 uri = /eip-gateways
27382025-03-02T05:06:30.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48943 req_id = 02b2959d-e2e6-4a0c-98c3-aba409d31737 response_code = 204 uri = /vpc-routes
27392025-03-02T05:06:30.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55004
27402025-03-02T05:06:30.760ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27412025-03-02T05:06:30.797ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27422025-03-02T05:06:30.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92048 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55004 req_id = 35f161e0-a3b4-445c-a75b-26570e9fd463 response_code = 204 uri = /switch-ports
27432025-03-02T05:06:30.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51719
27442025-03-02T05:06:30.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49497
27452025-03-02T05:06:30.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49497 req_id = 95acfa1f-e60d-482b-a53c-f03667a5b5f0 response_code = 200 uri = /v2p
27462025-03-02T05:06:30.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55004 req_id = 69b55ce4-c8f0-4076-90a2-cd2d4bd69e48 response_code = 200 uri = /network-bootstore-config
27472025-03-02T05:06:30.852ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27482025-03-02T05:06:30.891ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27492025-03-02T05:06:30.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51719 req_id = 93bea0d2-b47b-4362-b896-2605b3b80ed4 response_code = 204 uri = /switch-ports
27502025-03-02T05:06:30.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51719 req_id = 52530bf1-99e0-4e44-b450-c8c403bcd413 response_code = 200 uri = /network-bootstore-config
27512025-03-02T05:06:31.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38859
27522025-03-02T05:06:31.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38859 req_id = 22ea3a57-5c2e-42a6-9b7f-6d631537c069 response_code = 200 uri = /vpc-routes
27532025-03-02T05:06:31.853ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
27542025-03-02T05:06:31.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38859 req_id = 4e6d2622-a53c-47c5-a753-f42248b20c26 response_code = 204 uri = /eip-gateways
27552025-03-02T05:06:31.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38859 req_id = 8e1f4351-9cec-4294-8308-46a57cf5e5a1 response_code = 204 uri = /vpc-routes
27562025-03-02T05:06:31.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63049
27572025-03-02T05:06:31.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63049 req_id = 6df6ece7-c50d-4792-8201-7411bc144077 response_code = 200 uri = /v2p
27582025-03-02T05:06:31.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52318
27592025-03-02T05:06:31.959ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27602025-03-02T05:06:31.996ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27612025-03-02T05:06:32.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52318 req_id = c355fd12-5a2c-4fc1-a3f1-a5093e355b6e response_code = 204 uri = /switch-ports
27622025-03-02T05:06:32.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52318 req_id = aedbb423-e826-4a7a-8dfa-82c6c9b56fe8 response_code = 200 uri = /network-bootstore-config
27632025-03-02T05:06:42.924ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8675 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = c1250748-7e4f-43be-9a56-1289d50cd240 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
27642025-03-02T05:06:44.403ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53185
27652025-03-02T05:06:44.403ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53185 req_id = ae9d0c99-fb3e-42bf-a04a-a9682316df07 response_code = 200 uri = /baseboard
27662025-03-02T05:07:00.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42649
27672025-03-02T05:07:00.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42649 req_id = a803951d-7d4c-4368-a5be-f4357f35f1ce response_code = 200 uri = /vpc-routes
27682025-03-02T05:07:00.719ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
27692025-03-02T05:07:00.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42649 req_id = 88b4abcf-e7d5-4de3-9a7a-0ebdef2e9821 response_code = 204 uri = /eip-gateways
27702025-03-02T05:07:00.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42649 req_id = 2b5123df-1f18-43cf-9fa0-b601545bd42a response_code = 204 uri = /vpc-routes
27712025-03-02T05:07:00.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47524
27722025-03-02T05:07:00.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47524 req_id = c1ecc61b-085d-4125-a7fa-f126ce92109b response_code = 200 uri = /vpc-routes
27732025-03-02T05:07:00.829ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
27742025-03-02T05:07:00.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47524 req_id = b52ef064-4e9f-417d-8497-e9ef21471a84 response_code = 204 uri = /eip-gateways
27752025-03-02T05:07:00.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47524 req_id = 9915d310-3e2c-4e18-9a8a-277f95da09b4 response_code = 204 uri = /vpc-routes
27762025-03-02T05:07:00.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54054
27772025-03-02T05:07:00.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54054 req_id = 4d1b7565-f7ef-4972-8e35-6f74527c61b2 response_code = 200 uri = /v2p
27782025-03-02T05:07:01.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41977
27792025-03-02T05:07:01.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41977 req_id = 7613e0a9-7901-4825-9fc4-9a864e5f1b5a response_code = 200 uri = /v2p
27802025-03-02T05:07:01.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55457
27812025-03-02T05:07:01.080ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27822025-03-02T05:07:01.120ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27832025-03-02T05:07:01.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100205 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55457 req_id = 8b2fd04d-a785-4b83-b6ea-449b837984f5 response_code = 204 uri = /switch-ports
27842025-03-02T05:07:01.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39446
27852025-03-02T05:07:01.180ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27862025-03-02T05:07:01.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3529 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55457 req_id = 6e7fadae-4380-4ce6-b1c2-04e85c61a1be response_code = 200 uri = /network-bootstore-config
27872025-03-02T05:07:01.221ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27882025-03-02T05:07:01.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97386 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39446 req_id = 15bd06d0-1b0a-4998-b8c3-998b89faaefe response_code = 204 uri = /switch-ports
27892025-03-02T05:07:01.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39446 req_id = 906007a2-9822-41fc-8908-36c8819ebf4a response_code = 200 uri = /network-bootstore-config
27902025-03-02T05:07:02.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35621
27912025-03-02T05:07:02.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35621 req_id = 477787a3-a276-4ec0-982e-e493112a7eb7 response_code = 200 uri = /vpc-routes
27922025-03-02T05:07:02.107ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
27932025-03-02T05:07:02.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35621 req_id = 468c2d99-dd8c-4e4c-936d-d016132ac9b8 response_code = 204 uri = /eip-gateways
27942025-03-02T05:07:02.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48470
27952025-03-02T05:07:02.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48470 req_id = 5b839eb9-367b-4a6b-bd3e-03d295c3297c response_code = 200 uri = /v2p
27962025-03-02T05:07:02.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35621 req_id = ab5f1c9e-451e-4a0c-8158-70f40a2021c3 response_code = 204 uri = /vpc-routes
27972025-03-02T05:07:02.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60685
27982025-03-02T05:07:02.206ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27992025-03-02T05:07:02.244ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
28002025-03-02T05:07:02.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96108 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60685 req_id = e30ddb27-0652-4d0d-9a0b-7949ab4340e2 response_code = 204 uri = /switch-ports
28012025-03-02T05:07:02.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60685 req_id = da698ef0-ac85-46dc-a347-f300f0788625 response_code = 200 uri = /network-bootstore-config
28022025-03-02T05:07:02.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60600
28032025-03-02T05:07:02.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60600 req_id = 43843094-a2b8-4093-8717-13e0e6d2dc8e response_code = 200 uri = /v2p
28042025-03-02T05:07:02.987ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(3801597) }
28052025-03-02T05:07:02.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60600 req_id = 72ae74f3-b643-412b-be4a-b7aa00af36c7 response_code = 204 uri = /v2p
28062025-03-02T05:07:03.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61109
28072025-03-02T05:07:03.170ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 12b3c844-53db-4d99-862c-4601683b4a7f, kind: Instance { id: 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3801597), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12b3c844-53db-4d99-862c-4601683b4a7f, kind: Instance { id: 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3801597), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12b3c844-53db-4d99-862c-4601683b4a7f, kind: Instance { id: 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3801597), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(3801597))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12b3c844-53db-4d99-862c-4601683b4a7f, kind: Instance { id: 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3801597), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: e591a62e-ead4-4574-b740-76e2102fe77f, slot: 0, read_only: false, vcr_json: .., name: "disk-f82b4d2bf42" }], boot_settings: Some(InstanceBootSettings { order: [e591a62e-ead4-4574-b740-76e2102fe77f] }), cloud_init_bytes: Some(..) } instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 metadata = InstanceMetadata { silo_id: b86f11db-859b-43e9-a644-30eba6b1cbfb, project_id: 00e9f759-e239-40f8-b625-b826e3747c82 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-02T05:07:03.161946311Z }
28082025-03-02T05:07:03.170ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 migration_id = None propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28092025-03-02T05:07:03.171ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 migration_id = None propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 12b3c844-53db-4d99-862c-4601683b4a7f, kind: Instance { id: 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3801597), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12b3c844-53db-4d99-862c-4601683b4a7f, kind: Instance { id: 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3801597), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12b3c844-53db-4d99-862c-4601683b4a7f, kind: Instance { id: 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3801597), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(3801597))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12b3c844-53db-4d99-862c-4601683b4a7f, kind: Instance { id: 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3801597), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: e591a62e-ead4-4574-b740-76e2102fe77f, slot: 0, read_only: false, vcr_json: .., name: "disk-f82b4d2bf42" }], boot_settings: Some(InstanceBootSettings { order: [e591a62e-ead4-4574-b740-76e2102fe77f] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-02T05:07:03.161946311Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28102025-03-02T05:07:03.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11468 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61109 req_id = a7c9aa21-0c32-4cd5-b9c6-0e672de54bab response_code = 200 uri = /vmms/a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28112025-03-02T05:07:03.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45193
28122025-03-02T05:07:03.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 863 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45193 req_id = 94295716-0620-4df3-b9b6-8cae9ce22363 response_code = 200 uri = /vmms/a2b2f55d-598a-48cc-97a5-f7abbf31b2e9/state
28132025-03-02T05:07:03.292ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 3801597 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28142025-03-02T05:07:03.292ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28152025-03-02T05:07:03.330ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 file = illumos-utils/src/zone.rs:325 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28162025-03-02T05:07:03.350ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 file = illumos-utils/src/zone.rs:363 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28172025-03-02T05:07:03.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61363
28182025-03-02T05:07:03.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61363 req_id = f77ab86c-0705-46a4-9ebd-af2b885136da response_code = 200 uri = /vpc-routes
28192025-03-02T05:07:03.386ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {12b3c844-53db-4d99-862c-4601683b4a7f: {10.151.2.175: {547eaff2-9230-4334-8b41-9a52fe54db68}, 10.151.2.176: {547eaff2-9230-4334-8b41-9a52fe54db68}}} }
28202025-03-02T05:07:05.090ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28212025-03-02T05:07:05.090ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone file = illumos-utils/src/running_zone.rs:489 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28222025-03-02T05:07:05.273ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 34.858233ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28232025-03-02T05:07:05.317ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 135.925742ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28242025-03-02T05:07:05.469ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 217.23377ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28252025-03-02T05:07:05.703ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 457.224215ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28262025-03-02T05:07:06.175ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 824.017441ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28272025-03-02T05:07:07.013ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 533.097956ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28282025-03-02T05:07:07.557ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 566.821601ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28292025-03-02T05:07:08.135ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 862.741237ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28302025-03-02T05:07:09.010ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 1.433111808s file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 zone = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28312025-03-02T05:07:10.474ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 file = sled-agent/src/instance.rs:2133 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28322025-03-02T05:07:10.485ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 25.918182ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28332025-03-02T05:07:10.522ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 53.367547ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28342025-03-02T05:07:10.586ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9") failed: Property not found. retry in 163.06543ms file = illumos-utils/src/svc.rs:42 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28352025-03-02T05:07:10.761ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28362025-03-02T05:07:10.799ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28372025-03-02T05:07:10.879ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28382025-03-02T05:07:10.879ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
28392025-03-02T05:07:10.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7493313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61363 req_id = 1fdcc891-3952-481f-813d-aaaf5b7ac989 response_code = 204 uri = /eip-gateways
28402025-03-02T05:07:10.880ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-03-02T05:07:10.880501999Z } file = sled-agent/src/instance.rs:842 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28412025-03-02T05:07:10.880ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-02T05:07:10.880501999Z } propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28422025-03-02T05:07:10.880ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-02T05:07:10.880501999Z }, migration_in: None, migration_out: None }
28432025-03-02T05:07:10.892ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-03-02T05:07:10.892971441Z } file = sled-agent/src/instance.rs:842 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28442025-03-02T05:07:10.893ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-02T05:07:10.892971441Z } propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28452025-03-02T05:07:10.893ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-02T05:07:10.892971441Z }, migration_in: None, migration_out: None }
28462025-03-02T05:07:10.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61363 req_id = 3cd8267b-fc33-4752-b781-41bce14005f5 response_code = 204 uri = /vpc-routes
28472025-03-02T05:07:12.923ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7692 local_addr = [fd00:1122:3344:101::1]:41054 method = GET remote_addr = [fd00:1122:3344:101::d]:34060 req_id = af73f256-ca66-4926-8135-34ca29e43241 response_code = 200 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 uri = /fee17c45-a85b-405f-9e58-2ca0ab03dea9
28482025-03-02T05:07:14.437ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39843
28492025-03-02T05:07:14.437ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39843 req_id = 3635efee-7742-4766-9f81-bf4f18f22b71 response_code = 200 uri = /baseboard
28502025-03-02T05:07:20.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48766
28512025-03-02T05:07:20.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 531 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48766 req_id = 7bc2a365-fa29-4488-9d05-5d7bdf77fbc0 response_code = 200 uri = /vmms/a2b2f55d-598a-48cc-97a5-f7abbf31b2e9/state
28522025-03-02T05:07:20.689ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-03-02T05:07:20.689135092Z } file = sled-agent/src/instance.rs:842 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28532025-03-02T05:07:20.689ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-02T05:07:20.689135092Z } propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28542025-03-02T05:07:20.689ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-02T05:07:20.689135092Z }, migration_in: None, migration_out: None }
28552025-03-02T05:07:20.710ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-03-02T05:07:20.710561372Z } file = sled-agent/src/instance.rs:842 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28562025-03-02T05:07:20.710ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-03-02T05:07:20.710561372Z } propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28572025-03-02T05:07:20.710ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28582025-03-02T05:07:20.710ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28592025-03-02T05:07:20.710ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28602025-03-02T05:07:20.711ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/137ad444-dc66-45be-a069-b93fb154c65f/debug/bundle/zone", "/pool/int/31981b9f-a8b9-4039-bebc-cee38cd23b26/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/3b0bf9ca-7a2f-4f29-b9e1-2a614ff2e107/crypt/debug", "/pool/ext/f73fac08-e143-4ee5-a579-2b9dce4ff3f6/crypt/debug", "/pool/ext/b8159dea-4574-4646-9e75-83a2e5fdd3fe/crypt/debug", "/pool/ext/ca1fdcb1-c758-47e9-9c13-a7cd8b83df1c/crypt/debug", "/pool/ext/6c14f7f3-ae98-4e2b-8048-0bd7ddd632db/crypt/debug", "/pool/ext/02f51c32-d098-4db1-aebc-508861ba7b69/crypt/debug", "/pool/ext/6172af12-6fa7-4d40-b551-2b1c147126ca/crypt/debug", "/pool/ext/59d556b1-49a0-4ea6-b384-37f0944c2057/crypt/debug", "/pool/ext/3be3d661-9b63-4e47-93ce-3eb0d2503505/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28612025-03-02T05:07:21.340ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9", bundle_id: 4470b1a6-f745-427c-9690-f456cef96c26 }, time_created: 2025-03-02T05:07:20.712614008Z, version: 0, cause: TerminatedInstance }
28622025-03-02T05:07:21.340ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 file = sled-agent/src/instance.rs:1376 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28632025-03-02T05:07:23.070ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28642025-03-02T05:07:23.088ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(3801597), kind: System }
28652025-03-02T05:07:23.088ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(3801597), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28662025-03-02T05:07:23.088ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-02T05:07:23.088862171Z }, migration_in: None, migration_out: None }
28672025-03-02T05:07:23.112ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-02T05:07:23.088862171Z }, migration_in: None, migration_out: None }
28682025-03-02T05:07:23.116ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = 07be9cb1-0bc9-478a-92d9-023d5a4f3a97 propolis_id = a2b2f55d-598a-48cc-97a5-f7abbf31b2e9
28692025-03-02T05:07:23.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41460
28702025-03-02T05:07:23.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41460 req_id = 25ec5997-de9f-4291-86c1-65d48c488e36 response_code = 200 uri = /vpc-routes
28712025-03-02T05:07:23.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {12b3c844-53db-4d99-862c-4601683b4a7f: {10.151.2.175: {547eaff2-9230-4334-8b41-9a52fe54db68}, 10.151.2.176: {547eaff2-9230-4334-8b41-9a52fe54db68}}} }
28722025-03-02T05:07:23.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41460 req_id = 14d0e0fc-c7c8-4cca-ba5a-99e00930e122 response_code = 204 uri = /eip-gateways
28732025-03-02T05:07:23.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45753
28742025-03-02T05:07:23.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45753 req_id = 4e2e9e57-869b-4802-94dc-55c1ea68e596 response_code = 200 uri = /v2p
28752025-03-02T05:07:23.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41460 req_id = 90c3fbe1-68c8-465f-ae17-f955e9a00ec4 response_code = 204 uri = /vpc-routes
28762025-03-02T05:07:23.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37163
28772025-03-02T05:07:23.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37163 req_id = 8a1fca62-8697-4947-a98e-953e55091868 response_code = 200 uri = /v2p
28782025-03-02T05:07:23.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36105
28792025-03-02T05:07:23.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36105 req_id = f53e2e3c-b54f-4174-bf48-bb57a42f598d response_code = 200 uri = /vpc-routes
28802025-03-02T05:07:23.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
28812025-03-02T05:07:23.875ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9
28822025-03-02T05:07:23.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36105 req_id = f48cad32-b251-4a93-8b5c-6f114543c33a response_code = 204 uri = /eip-gateways
28832025-03-02T05:07:23.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36105 req_id = 16e5ad52-737f-41d3-9212-6a1a1f0ae6cd response_code = 204 uri = /vpc-routes
28842025-03-02T05:07:24.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39773
28852025-03-02T05:07:24.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39773 req_id = f70f48fd-9c85-4195-bcd0-503ce924ddcc response_code = 200 uri = /vpc-routes
28862025-03-02T05:07:24.581ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = fee17c45-a85b-405f-9e58-2ca0ab03dea9 values = ExternalIpGatewayMap { mappings: {} }
28872025-03-02T05:07:24.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39773 req_id = f39ce74c-cc38-4be0-8675-d51f151434d4 response_code = 204 uri = /eip-gateways
28882025-03-02T05:07:24.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39773 req_id = 8e9355ba-7919-4a7e-87f7-d65b05832b84 response_code = 204 uri = /vpc-routes