Max level shown:
1 [ Jan 28 08:28:17 Enabled. ]
2 [ Jan 28 08:28:17 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 28 08:28:17 Method "start" exited with status 0. ]
4 [ Jan 28 08:28:17 Rereading configuration. ]
5 [ Jan 28 08:28:17 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-28T08:28:17.203ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-28T08:28:17.203ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-28T08:28:17.256ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-28T08:28:17.256ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-28T08:28:17.371ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-28T08:28:17.380ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-28T08:28:17.388ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-28T08:28:17.990ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-28T08:28:18.131ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-28T08:28:18.131ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-28T08:28:18.131ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-28T08:28:18.131ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-28T08:28:18.131ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-01-28T08:28:18.131ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-28T08:28:18.134ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-28T08:28:18.134ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-28T08:28:18.134ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-28T08:28:18.134ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-28T08:28:18.134ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-28T08:28:18.134ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-28T08:28:18.134ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-28T08:28:18.134ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-28T08:28:18.134ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-28T08:28:18.147ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-28T08:28:18.147ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool)
322025-01-28T08:28:18.246ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal }
332025-01-28T08:28:18.608ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-28T08:28:18.608ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-28T08:28:18.608ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-28T08:28:18.608ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-28T08:28:18.608ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-28T08:28:18.608ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-28T08:28:18.608ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-28T08:28:18.617ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-28T08:28:18.617ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool)
422025-01-28T08:28:18.705ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal }
432025-01-28T08:28:19.072ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-28T08:28:19.072ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-28T08:28:19.072ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-28T08:28:19.072ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-28T08:28:19.072ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-28T08:28:19.072ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-28T08:28:19.072ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
522025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532025-01-28T08:28:19.072ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
542025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552025-01-28T08:28:19.072ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-28T08:28:19.072ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-28T08:28:19.072ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-28T08:28:19.072ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-28T08:28:19.072ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-28T08:28:19.072ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-28T08:28:19.072ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-28T08:28:19.072ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-28T08:28:19.072ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-28T08:28:19.072ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-28T08:28:19.072ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-28T08:28:19.072ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-28T08:28:19.072ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-28T08:28:19.072ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-28T08:28:19.072ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-28T08:28:19.072ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-28T08:28:19.072ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-28T08:28:19.072ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-28T08:28:19.072ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-28T08:28:19.072ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-28T08:28:19.072ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-28T08:28:19.072ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-28T08:28:19.072ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-28T08:28:19.072ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-28T08:28:19.072ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-28T08:28:19.072ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-28T08:28:19.072ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-28T08:28:19.072ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-28T08:28:19.072ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-28T08:28:19.072ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1002025-01-28T08:28:19.072ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1012025-01-28T08:28:19.072ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022025-01-28T08:28:19.072ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-28T08:28:19.072ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-28T08:28:19.072ZINFOSledAgent (bootstore): No ledger in /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-28T08:28:19.072ZINFOSledAgent (bootstore): No ledger in /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-28T08:28:19.072ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-28T08:28:19.072ZINFOSledAgent (bootstore): No ledger in /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-28T08:28:19.072ZINFOSledAgent (bootstore): No ledger in /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-28T08:28:19.072ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-28T08:28:19.072ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-28T08:28:19.072ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-28T08:28:19.084ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132025-01-28T08:28:19.084ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1411, tv_nsec: 727224994 } time_to_next_cleanup = 599.999946789s
1142025-01-28T08:28:19.084ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1152025-01-28T08:28:19.084ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-28T08:28:19.087ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-28T08:28:19.087ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-28T08:28:19.087ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-28T08:28:19.089ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-28T08:28:19.089ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1195
1212025-01-28T08:28:19.089ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-28T08:28:19.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-28T08:28:19.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-28T08:28:19.090ZINFOSledAgent (RSS): No ledger in /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-28T08:28:19.090ZINFOSledAgent (RSS): No ledger in /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-28T08:28:19.090ZINFOSledAgent (RSS): No ledger in /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-28T08:28:19.090ZINFOSledAgent (RSS): No ledger in /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-28T08:28:19.090ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1244
1292025-01-28T08:28:19.090ZINFOSledAgent (RSS): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-28T08:28:19.090ZINFOSledAgent (RSS): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-28T08:28:19.090ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1276
1322025-01-28T08:28:19.090ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-28T08:28:19.090ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-28T08:28:19.090ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1307
1352025-01-28T08:28:19.090ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-28T08:28:19.090ZINFOSledAgent (bootstore): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-28T08:28:19.090ZINFOSledAgent (bootstore): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-28T08:28:19.091ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-28T08:28:19.091ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 09b4ce33-23b9-42cf-84fa-bef739079982 (sled), rack_id: 686fddce-963a-445f-bb4e-5946a3c29a76, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-28T08:28:19.091ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1412025-01-28T08:28:19.091ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1422025-01-28T08:28:19.096ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-28T08:28:19.102ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-28T08:28:19.102ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-28T08:28:19.106ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-28T08:28:19.106ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-28T08:28:19.106ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:54338
1482025-01-28T08:28:19.106ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 09b4ce33-23b9-42cf-84fa-bef739079982 (sled), rack_id: 686fddce-963a-445f-bb4e-5946a3c29a76, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-28T08:28:19.106ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-28T08:28:19.106ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-28T08:28:19.106ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-28T08:28:19.107ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-28T08:28:19.107ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-28T08:28:19.107ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-01-28T08:28:19.107ZINFOSledAgent (StorageManager): No ledger in /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-28T08:28:19.107ZINFOSledAgent (StorageManager): No ledger in /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-28T08:28:19.107ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-28T08:28:19.107ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-28T08:28:19.107ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-28T08:28:19.107ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-28T08:28:19.107ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-28T08:28:19.124ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-28T08:28:19.145ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-28T08:28:19.162ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-28T08:28:19.189ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
1662025-01-28T08:28:19.189ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-28T08:28:19.189ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
1682025-01-28T08:28:19.189ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-28T08:28:19.193ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 80.018817ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5c0112e6-10d6-45f3-bce8-69b0237779de", "content-length": "124", "date": "Tue, 28 Jan 2025 08:28:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5c0112e6-10d6-45f3-bce8-69b0237779de" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-28T08:28:19.204ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_58c81fd8-118a-4cf1-8c66-964d853e036f/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-28T08:28:19.228ZINFOSledAgent: successfully created encrypted zvol: name="oxi_58c81fd8-118a-4cf1-8c66-964d853e036f/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-28T08:28:19.229ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_58c81fd8-118a-4cf1-8c66-964d853e036f/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-28T08:28:19.234ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
1742025-01-28T08:28:19.234ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-28T08:28:19.234ZINFOSledAgent (BackingFs): Ensuring dataset oxi_58c81fd8-118a-4cf1-8c66-964d853e036f/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-28T08:28:19.274ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-28T08:28:19.275ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 116.003563ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "09047a90-130d-4754-8ab7-4250212e9604", "content-length": "124", "date": "Tue, 28 Jan 2025 08:28:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "09047a90-130d-4754-8ab7-4250212e9604" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-28T08:28:19.304ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-28T08:28:19.391ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-28T08:28:19.392ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 111.089068ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f111ccdd-d9c5-49ae-ada5-0fe9e6967283", "content-length": "124", "date": "Tue, 28 Jan 2025 08:28:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f111ccdd-d9c5-49ae-ada5-0fe9e6967283" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-28T08:28:19.504ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822025-01-28T08:28:19.505ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 152.014506ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c5384fee-9ffb-4288-9150-68fd9483514c", "content-length": "124", "date": "Tue, 28 Jan 2025 08:28:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c5384fee-9ffb-4288-9150-68fd9483514c" } file = clients/ddm-admin-client/src/lib.rs:177
1832025-01-28T08:28:19.523ZINFOSledAgent (BackingFs): Mounting oxi_58c81fd8-118a-4cf1-8c66-964d853e036f/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842025-01-28T08:28:19.536ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852025-01-28T08:28:19.536ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862025-01-28T08:28:19.536ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872025-01-28T08:28:19.536ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882025-01-28T08:28:19.657ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-28T08:28:19.658ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 266.468118ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "990fd3b1-d57d-4af1-9cf9-ed20e3a6c5af", "content-length": "124", "date": "Tue, 28 Jan 2025 08:28:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "990fd3b1-d57d-4af1-9cf9-ed20e3a6c5af" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-28T08:28:19.925ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-28T08:28:19.926ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 228.363081ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5e2839d5-653f-4789-a389-a9ebd762d6e5", "content-length": "124", "date": "Tue, 28 Jan 2025 08:28:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5e2839d5-653f-4789-a389-a9ebd762d6e5" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-28T08:28:20.156ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-28T08:28:20.157ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 239.750945ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "23c6f652-a043-451c-a7d5-088edc9adf99", "content-length": "124", "date": "Tue, 28 Jan 2025 08:28:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "23c6f652-a043-451c-a7d5-088edc9adf99" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-28T08:28:20.269ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
1952025-01-28T08:28:20.275ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:51492 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
1962025-01-28T08:28:20.275ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
1972025-01-28T08:28:20.275ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:51492 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 09b4ce33-23b9-42cf-84fa-bef739079982 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
1982025-01-28T08:28:20.276ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 225.646107ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
1992025-01-28T08:28:20.277ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2002025-01-28T08:28:20.277ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2012025-01-28T08:28:20.277ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2022025-01-28T08:28:20.277ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-28T08:28:20.397ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042025-01-28T08:28:20.503ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 564.389396ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2052025-01-28T08:28:21.069ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.173040083s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2062025-01-28T08:28:22.244ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.736952032s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2072025-01-28T08:28:22.946ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2082025-01-28T08:28:22.946ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2092025-01-28T08:28:22.946ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2102025-01-28T08:28:22.946ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2112025-01-28T08:28:22.946ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2122025-01-28T08:28:22.946ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2132025-01-28T08:28:22.948ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2142025-01-28T08:28:22.949ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2152025-01-28T08:28:22.949ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='75f94570-eef7-46e8-ae11-ebc34097b206'/> <propval type="astring" name="rack_id" value='686fddce-963a-445f-bb4e-5946a3c29a76'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe29:e4a8'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='686fddce-963a-445f-bb4e-5946a3c29a76'/> <propval type="astring" name="sled_id" value='09b4ce33-23b9-42cf-84fa-bef739079982'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='09b4ce33-23b9-42cf-84fa-bef739079982'/> <propval type="astring" name="rack_uuid" value='686fddce-963a-445f-bb4e-5946a3c29a76'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='09b4ce33-23b9-42cf-84fa-bef739079982'/> <propval type="astring" name="rack_uuid" value='686fddce-963a-445f-bb4e-5946a3c29a76'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-28T08:28:22.950ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-28T08:28:23.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 53.734272ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-28T08:28:23.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 74.769816ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-28T08:28:23.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 193.399422ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-01-28T08:28:23.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 356.254002ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-28T08:28:23.983ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.827184666s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2222025-01-28T08:28:24.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 888.366685ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-01-28T08:28:25.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.26607989s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-01-28T08:28:26.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.217576391s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-01-28T08:28:28.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.129777589s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2262025-01-28T08:28:28.812ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.621079622s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2272025-01-28T08:28:29.707ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/09b4ce33-23b9-42cf-84fa-bef739079982) file = sled-agent/src/nexus.rs:527 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2282025-01-28T08:28:29.737ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2292025-01-28T08:28:29.737ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2302025-01-28T08:28:29.738ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2312025-01-28T08:28:29.738ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322025-01-28T08:28:29.738ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2332025-01-28T08:28:29.738ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-01-28T08:28:29.738ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352025-01-28T08:28:29.739ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362025-01-28T08:28:29.739ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372025-01-28T08:28:29.739ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:54338
2382025-01-28T08:28:29.739ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2392025-01-28T08:28:29.966ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2402025-01-28T08:28:29.966ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2412025-01-28T08:28:29.971ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422025-01-28T08:28:29.971ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2432025-01-28T08:28:29.971ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442025-01-28T08:28:30.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40887
2452025-01-28T08:28:30.248ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-01-28T08:28:30.248ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2472025-01-28T08:28:30.248ZINFOSledAgent (ServiceManager): No ledger in /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-01-28T08:28:30.248ZINFOSledAgent (ServiceManager): No ledger in /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-zones.json file = common/src/ledger.rs:188
2492025-01-28T08:28:30.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40887 req_id = 175d64ad-622b-48f2-a1f1-731f58a17a3c response_code = 200 uri = /inventory
2502025-01-28T08:28:30.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47147
2512025-01-28T08:28:30.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47147 req_id = 642fe24e-c8bd-4116-8e61-e8f826c61b20 response_code = 200 uri = /sled-role
2522025-01-28T08:28:30.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14248252677392972289 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2532025-01-28T08:28:30.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8167848374547743825 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2542025-01-28T08:28:30.317ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0b00a0bd-c881-4d07-9ba5-abbab53c648c (physical_disk), pool_id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 256abbe0-5664-48f5-b722-794036c8d9b5 (physical_disk), pool_id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3e754290-715e-4146-85c0-f906492d409b (physical_disk), pool_id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 8d3dc84f-23d8-40d1-9edd-3712ebb83013 (physical_disk), pool_id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 923166bd-53f2-41a9-ba44-13bd4299d926 (physical_disk), pool_id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: ce171868-253a-43ef-a42b-3d046a88b7d2 (physical_disk), pool_id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: dccfb30c-ced6-4128-b0ef-400d42e15201 (physical_disk), pool_id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: e9cafca0-f199-4f44-b681-548a2c3162fb (physical_disk), pool_id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: ea74e5f5-af18-4220-b4fc-007a3bd762c5 (physical_disk), pool_id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2552025-01-28T08:28:30.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60477
2562025-01-28T08:28:30.317ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2572025-01-28T08:28:30.318ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0b00a0bd-c881-4d07-9ba5-abbab53c648c (physical_disk), pool_id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 256abbe0-5664-48f5-b722-794036c8d9b5 (physical_disk), pool_id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3e754290-715e-4146-85c0-f906492d409b (physical_disk), pool_id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 8d3dc84f-23d8-40d1-9edd-3712ebb83013 (physical_disk), pool_id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 923166bd-53f2-41a9-ba44-13bd4299d926 (physical_disk), pool_id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: ce171868-253a-43ef-a42b-3d046a88b7d2 (physical_disk), pool_id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: dccfb30c-ced6-4128-b0ef-400d42e15201 (physical_disk), pool_id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: e9cafca0-f199-4f44-b681-548a2c3162fb (physical_disk), pool_id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: ea74e5f5-af18-4220-b4fc-007a3bd762c5 (physical_disk), pool_id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2582025-01-28T08:28:30.318ZINFOSledAgent (StorageManager): No ledger in /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2592025-01-28T08:28:30.318ZINFOSledAgent (StorageManager): No ledger in /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602025-01-28T08:28:30.318ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2612025-01-28T08:28:30.318ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2622025-01-28T08:28:30.318ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2632025-01-28T08:28:30.318ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2642025-01-28T08:28:30.318ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2652025-01-28T08:28:30.476ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2662025-01-28T08:28:30.476ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1eaf2938-a2ac-484f-832d-16d88783efae (zpool)
2672025-01-28T08:28:30.687ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2682025-01-28T08:28:30.740ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/09b4ce33-23b9-42cf-84fa-bef739079982) file = sled-agent/src/probe_manager.rs:231 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
2692025-01-28T08:28:30.782ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }
2702025-01-28T08:28:30.789ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2712025-01-28T08:28:30.789ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2722025-01-28T08:28:30.789ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2732025-01-28T08:28:30.789ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2742025-01-28T08:28:30.789ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752025-01-28T08:28:30.789ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762025-01-28T08:28:30.789ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2772025-01-28T08:28:30.824ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2782025-01-28T08:28:30.832ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crypt/zone file = sled-storage/src/dataset.rs:302
2792025-01-28T08:28:30.967ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1eaf2938-a2ac-484f-832d-16d88783efae file = sled-storage/src/dataset.rs:388
2802025-01-28T08:28:30.974ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2812025-01-28T08:28:30.974ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2822025-01-28T08:28:30.974ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2832025-01-28T08:28:30.974ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842025-01-28T08:28:30.974ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2852025-01-28T08:28:30.985ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2862025-01-28T08:28:30.985ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool)
2872025-01-28T08:28:31.079ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }
2882025-01-28T08:28:31.087ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2892025-01-28T08:28:31.087ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2902025-01-28T08:28:31.087ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2912025-01-28T08:28:31.088ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2922025-01-28T08:28:31.088ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932025-01-28T08:28:31.088ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942025-01-28T08:28:31.088ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2952025-01-28T08:28:31.121ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2962025-01-28T08:28:31.129ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/zone file = sled-storage/src/dataset.rs:302
2972025-01-28T08:28:31.264ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 file = sled-storage/src/dataset.rs:388
2982025-01-28T08:28:31.272ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2992025-01-28T08:28:31.272ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3002025-01-28T08:28:31.272ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3012025-01-28T08:28:31.272ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3022025-01-28T08:28:31.272ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032025-01-28T08:28:31.282ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3042025-01-28T08:28:31.282ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool)
3052025-01-28T08:28:31.374ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }
3062025-01-28T08:28:31.382ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3072025-01-28T08:28:31.382ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3082025-01-28T08:28:31.382ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3092025-01-28T08:28:31.382ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3102025-01-28T08:28:31.382ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112025-01-28T08:28:31.382ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122025-01-28T08:28:31.382ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3132025-01-28T08:28:31.417ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142025-01-28T08:28:31.426ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/zone file = sled-storage/src/dataset.rs:302
3152025-01-28T08:28:31.563ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6 file = sled-storage/src/dataset.rs:388
3162025-01-28T08:28:31.571ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3172025-01-28T08:28:31.571ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3182025-01-28T08:28:31.571ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3192025-01-28T08:28:31.571ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3202025-01-28T08:28:31.571ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3212025-01-28T08:28:31.581ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3222025-01-28T08:28:31.581ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool)
3232025-01-28T08:28:31.679ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }
3242025-01-28T08:28:31.687ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3252025-01-28T08:28:31.687ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3262025-01-28T08:28:31.687ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3272025-01-28T08:28:31.687ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3282025-01-28T08:28:31.687ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292025-01-28T08:28:31.687ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302025-01-28T08:28:31.687ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3312025-01-28T08:28:31.721ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322025-01-28T08:28:31.729ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/zone file = sled-storage/src/dataset.rs:302
3332025-01-28T08:28:31.742ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/09b4ce33-23b9-42cf-84fa-bef739079982) file = sled-agent/src/probe_manager.rs:231 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
3342025-01-28T08:28:31.863ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_352e06d5-ecf0-4843-af74-5fa99efbd226 file = sled-storage/src/dataset.rs:388
3352025-01-28T08:28:31.871ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3362025-01-28T08:28:31.871ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3372025-01-28T08:28:31.871ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3382025-01-28T08:28:31.871ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3392025-01-28T08:28:31.871ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402025-01-28T08:28:31.880ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3412025-01-28T08:28:31.880ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool)
3422025-01-28T08:28:31.977ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }
3432025-01-28T08:28:31.985ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3442025-01-28T08:28:31.985ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3452025-01-28T08:28:31.985ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3462025-01-28T08:28:31.985ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3472025-01-28T08:28:31.985ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482025-01-28T08:28:31.985ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492025-01-28T08:28:31.985ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3502025-01-28T08:28:32.022ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512025-01-28T08:28:32.030ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e/crypt/zone file = sled-storage/src/dataset.rs:302
3522025-01-28T08:28:32.165ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e file = sled-storage/src/dataset.rs:388
3532025-01-28T08:28:32.173ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3542025-01-28T08:28:32.173ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3552025-01-28T08:28:32.173ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3562025-01-28T08:28:32.173ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3572025-01-28T08:28:32.173ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3582025-01-28T08:28:32.184ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3592025-01-28T08:28:32.184ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a5440209-1de6-4cf7-8077-0c0703036684 (zpool)
3602025-01-28T08:28:32.280ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }
3612025-01-28T08:28:32.288ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3622025-01-28T08:28:32.288ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3632025-01-28T08:28:32.288ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3642025-01-28T08:28:32.288ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3652025-01-28T08:28:32.288ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662025-01-28T08:28:32.288ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672025-01-28T08:28:32.288ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3682025-01-28T08:28:32.323ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692025-01-28T08:28:32.331ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone file = sled-storage/src/dataset.rs:302
3702025-01-28T08:28:32.469ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a5440209-1de6-4cf7-8077-0c0703036684 file = sled-storage/src/dataset.rs:388
3712025-01-28T08:28:32.478ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3722025-01-28T08:28:32.478ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3732025-01-28T08:28:32.478ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3742025-01-28T08:28:32.478ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3752025-01-28T08:28:32.478ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762025-01-28T08:28:32.487ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3772025-01-28T08:28:32.487ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool)
3782025-01-28T08:28:32.580ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }
3792025-01-28T08:28:32.588ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3802025-01-28T08:28:32.588ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3812025-01-28T08:28:32.588ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3822025-01-28T08:28:32.588ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3832025-01-28T08:28:32.588ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842025-01-28T08:28:32.588ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852025-01-28T08:28:32.588ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3862025-01-28T08:28:32.625ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872025-01-28T08:28:32.633ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50/crypt/zone file = sled-storage/src/dataset.rs:302
3882025-01-28T08:28:32.744ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/09b4ce33-23b9-42cf-84fa-bef739079982) file = sled-agent/src/probe_manager.rs:231 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
3892025-01-28T08:28:32.773ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50 file = sled-storage/src/dataset.rs:388
3902025-01-28T08:28:32.781ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3912025-01-28T08:28:32.781ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3922025-01-28T08:28:32.781ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3932025-01-28T08:28:32.781ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3942025-01-28T08:28:32.781ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3952025-01-28T08:28:32.790ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3962025-01-28T08:28:32.790ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool)
3972025-01-28T08:28:32.884ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }
3982025-01-28T08:28:32.893ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3992025-01-28T08:28:32.893ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4002025-01-28T08:28:32.893ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4012025-01-28T08:28:32.893ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4022025-01-28T08:28:32.893ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032025-01-28T08:28:32.893ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042025-01-28T08:28:32.893ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4052025-01-28T08:28:32.928ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4062025-01-28T08:28:32.937ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone file = sled-storage/src/dataset.rs:302
4072025-01-28T08:28:33.074ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4 file = sled-storage/src/dataset.rs:388
4082025-01-28T08:28:33.083ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4092025-01-28T08:28:33.083ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4102025-01-28T08:28:33.083ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4112025-01-28T08:28:33.083ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4122025-01-28T08:28:33.083ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4132025-01-28T08:28:33.093ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4142025-01-28T08:28:33.093ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool)
4152025-01-28T08:28:33.216ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }
4162025-01-28T08:28:33.224ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4172025-01-28T08:28:33.224ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4182025-01-28T08:28:33.224ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4192025-01-28T08:28:33.224ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4202025-01-28T08:28:33.224ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212025-01-28T08:28:33.224ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222025-01-28T08:28:33.224ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4232025-01-28T08:28:33.265ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4242025-01-28T08:28:33.274ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone file = sled-storage/src/dataset.rs:302
4252025-01-28T08:28:33.417ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53 file = sled-storage/src/dataset.rs:388
4262025-01-28T08:28:33.426ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4272025-01-28T08:28:33.426ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4282025-01-28T08:28:33.426ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4292025-01-28T08:28:33.426ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 58c81fd8-118a-4cf1-8c66-964d853e036f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 08f533e4-d3c4-4dd8-bb4b-4913baff1188 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4302025-01-28T08:28:33.426ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4312025-01-28T08:28:33.426ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4322025-01-28T08:28:33.426ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332025-01-28T08:28:33.426ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
4342025-01-28T08:28:33.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4352025-01-28T08:28:33.426ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
4362025-01-28T08:28:33.426ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
4372025-01-28T08:28:33.426ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
4382025-01-28T08:28:33.426ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
4392025-01-28T08:28:33.426ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
4402025-01-28T08:28:33.426ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4412025-01-28T08:28:33.427ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
4422025-01-28T08:28:33.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3109234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60477 req_id = 5579c231-440d-493b-b27e-549d11cc46ff response_code = 200 uri = /omicron-physical-disks
4432025-01-28T08:28:33.458ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {016f2f5b-4bd9-4187-bb37-3c9bffbb1f41 (dataset): DatasetConfig { id: 016f2f5b-4bd9-4187-bb37-3c9bffbb1f41 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 01a7e2c3-c490-4120-819d-45df1fd1ca07 (dataset): DatasetConfig { id: 01a7e2c3-c490-4120-819d-45df1fd1ca07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02e877ae-23f7-4838-8a8b-b967373e171a (dataset): DatasetConfig { id: 02e877ae-23f7-4838-8a8b-b967373e171a (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09a20da4-1ef7-438d-b46e-651ad833667e (dataset): DatasetConfig { id: 09a20da4-1ef7-438d-b46e-651ad833667e (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f606701-e674-4c93-ac70-2c3a2abf36af (dataset): DatasetConfig { id: 0f606701-e674-4c93-ac70-2c3a2abf36af (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 110161eb-a3af-4d01-ba2f-a2cf363225eb (dataset): DatasetConfig { id: 110161eb-a3af-4d01-ba2f-a2cf363225eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1206823a-566f-452b-b1cf-99e42fdd10ea (dataset): DatasetConfig { id: 1206823a-566f-452b-b1cf-99e42fdd10ea (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14201f04-d262-4264-8e7c-a6603c2f2db4 (dataset): DatasetConfig { id: 14201f04-d262-4264-8e7c-a6603c2f2db4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 178168eb-2d42-46c8-a2a5-44aa279495d4 (dataset): DatasetConfig { id: 178168eb-2d42-46c8-a2a5-44aa279495d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f6b5d10-56fd-48f1-b094-b86d8c0a4c4a (dataset): DatasetConfig { id: 1f6b5d10-56fd-48f1-b094-b86d8c0a4c4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c3bb16c-7186-4f1f-98dd-ee24c58cc775 (dataset): DatasetConfig { id: 2c3bb16c-7186-4f1f-98dd-ee24c58cc775 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c87a655-aa41-49ac-9f8a-43bae0124ddd (dataset): DatasetConfig { id: 2c87a655-aa41-49ac-9f8a-43bae0124ddd (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d90e48f-49f4-4cba-b594-924445be289b (dataset): DatasetConfig { id: 2d90e48f-49f4-4cba-b594-924445be289b (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36d887e5-00ab-4e20-955d-8973cac2e740 (dataset): DatasetConfig { id: 36d887e5-00ab-4e20-955d-8973cac2e740 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37c535e5-0b8b-42de-8efc-e9603fcf60c2 (dataset): DatasetConfig { id: 37c535e5-0b8b-42de-8efc-e9603fcf60c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4faf7213-ead9-4c37-96bf-25933e3d875d (dataset): DatasetConfig { id: 4faf7213-ead9-4c37-96bf-25933e3d875d (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51889a4d-f7de-42a4-add9-61009ba31705 (dataset): DatasetConfig { id: 51889a4d-f7de-42a4-add9-61009ba31705 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56c46b33-e33c-448c-9712-814a84ff8873 (dataset): DatasetConfig { id: 56c46b33-e33c-448c-9712-814a84ff8873 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57f4e93f-8e31-4625-b6d4-a03147defb92 (dataset): DatasetConfig { id: 57f4e93f-8e31-4625-b6d4-a03147defb92 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61662447-091c-475a-bc29-2304cbd9861f (dataset): DatasetConfig { id: 61662447-091c-475a-bc29-2304cbd9861f (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 677f3355-e746-46ef-9eb7-5be194e72378 (dataset): DatasetConfig { id: 677f3355-e746-46ef-9eb7-5be194e72378 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6cd94cdb-8c5c-4776-8d50-738bc0a1a16b (dataset): DatasetConfig { id: 6cd94cdb-8c5c-4776-8d50-738bc0a1a16b (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6fbe906e-bead-48d9-abf4-6f19ffa9704e (dataset): DatasetConfig { id: 6fbe906e-bead-48d9-abf4-6f19ffa9704e (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6fc69eee-e9ae-4f9d-b067-6afc775c82bd (dataset): DatasetConfig { id: 6fc69eee-e9ae-4f9d-b067-6afc775c82bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 778e2010-fb7b-4615-9530-c7322a8d3441 (dataset): DatasetConfig { id: 778e2010-fb7b-4615-9530-c7322a8d3441 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b6a1f58-0158-494b-8a46-d9944cf20d6f (dataset): DatasetConfig { id: 7b6a1f58-0158-494b-8a46-d9944cf20d6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82d633f9-df0b-4ebd-836d-c0cb0e13765d (dataset): DatasetConfig { id: 82d633f9-df0b-4ebd-836d-c0cb0e13765d (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e192cc2-1693-49ad-8687-0ab508dd0e19 (dataset): DatasetConfig { id: 8e192cc2-1693-49ad-8687-0ab508dd0e19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9060ff0e-304d-474b-a5a2-cb5af44c2304 (dataset): DatasetConfig { id: 9060ff0e-304d-474b-a5a2-cb5af44c2304 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94cc5456-c89d-4fa2-a7b4-c4754af13cad (dataset): DatasetConfig { id: 94cc5456-c89d-4fa2-a7b4-c4754af13cad (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95691e27-9071-46b5-a2d0-4cf65435b123 (dataset): DatasetConfig { id: 95691e27-9071-46b5-a2d0-4cf65435b123 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99fe2f02-bae3-46e9-8fe2-98b5e4f77160 (dataset): DatasetConfig { id: 99fe2f02-bae3-46e9-8fe2-98b5e4f77160 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9bb5bb54-8e93-4c77-b106-084006a4b24d (dataset): DatasetConfig { id: 9bb5bb54-8e93-4c77-b106-084006a4b24d (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9cfc0821-36f3-4b59-ba1e-8ba3c914c107 (dataset): DatasetConfig { id: 9cfc0821-36f3-4b59-ba1e-8ba3c914c107 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0141c1d-8476-4811-b126-d10d17a32045 (dataset): DatasetConfig { id: a0141c1d-8476-4811-b126-d10d17a32045 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2e1781c-cea0-4ffd-a45b-bf1a18f75ed8 (dataset): DatasetConfig { id: a2e1781c-cea0-4ffd-a45b-bf1a18f75ed8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a31f9fbf-038b-46b1-8204-ba047390e10f (dataset): DatasetConfig { id: a31f9fbf-038b-46b1-8204-ba047390e10f (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a746272f-9783-4aec-bf80-38fbb8708392 (dataset): DatasetConfig { id: a746272f-9783-4aec-bf80-38fbb8708392 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ade917e4-316f-44ef-ab5f-980bc2717baa (dataset): DatasetConfig { id: ade917e4-316f-44ef-ab5f-980bc2717baa (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af1ecc1f-502c-4477-8904-e8a06e7d0e1d (dataset): DatasetConfig { id: af1ecc1f-502c-4477-8904-e8a06e7d0e1d (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5c7b46e-0021-464f-9646-b8b588a39eda (dataset): DatasetConfig { id: b5c7b46e-0021-464f-9646-b8b588a39eda (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b661ce32-2a6e-4c20-8a51-bdc9df3b3f62 (dataset): DatasetConfig { id: b661ce32-2a6e-4c20-8a51-bdc9df3b3f62 (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bb1fad51-c7bc-464e-8993-63bbabaa70ac (dataset): DatasetConfig { id: bb1fad51-c7bc-464e-8993-63bbabaa70ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc4a905c-e0fe-4beb-a382-259a5c33307a (dataset): DatasetConfig { id: bc4a905c-e0fe-4beb-a382-259a5c33307a (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c00b9692-5800-4fba-9939-18904547ea70 (dataset): DatasetConfig { id: c00b9692-5800-4fba-9939-18904547ea70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c08f9ad7-220e-4a20-9161-0e7bd306f432 (dataset): DatasetConfig { id: c08f9ad7-220e-4a20-9161-0e7bd306f432 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77e07d8-e3ec-4d80-a2b9-658325ada87f (dataset): DatasetConfig { id: c77e07d8-e3ec-4d80-a2b9-658325ada87f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cb7bed30-5d95-4feb-8757-86024dab3c2a (dataset): DatasetConfig { id: cb7bed30-5d95-4feb-8757-86024dab3c2a (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc385a04-779d-4545-a587-a6826ce0a7eb (dataset): DatasetConfig { id: cc385a04-779d-4545-a587-a6826ce0a7eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4740201-2457-42c9-bb5b-c5742e321ea5 (dataset): DatasetConfig { id: d4740201-2457-42c9-bb5b-c5742e321ea5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d60f1c9a-5f8e-4203-8594-23fa01840706 (dataset): DatasetConfig { id: d60f1c9a-5f8e-4203-8594-23fa01840706 (dataset), name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6c0efb6-42f2-4261-bbec-9c0d2933c6fa (dataset): DatasetConfig { id: d6c0efb6-42f2-4261-bbec-9c0d2933c6fa (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d845fcc5-7319-44d6-8d02-4fb6ed97dab5 (dataset): DatasetConfig { id: d845fcc5-7319-44d6-8d02-4fb6ed97dab5 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dacb2588-cd98-43f2-a6c1-5e1bb3bd6fdb (dataset): DatasetConfig { id: dacb2588-cd98-43f2-a6c1-5e1bb3bd6fdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e13632a8-1888-440c-8327-8326c0a0f207 (dataset): DatasetConfig { id: e13632a8-1888-440c-8327-8326c0a0f207 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e33ba639-f3b4-4eac-8cd0-2991ee97f5e5 (dataset): DatasetConfig { id: e33ba639-f3b4-4eac-8cd0-2991ee97f5e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e46f2c73-d77b-4bfc-987f-0575f35a3b21 (dataset): DatasetConfig { id: e46f2c73-d77b-4bfc-987f-0575f35a3b21 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e62492cb-286e-451d-ae30-906fac64caba (dataset): DatasetConfig { id: e62492cb-286e-451d-ae30-906fac64caba (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e78ddb7a-72e8-4a85-acb7-4b8f87f49177 (dataset): DatasetConfig { id: e78ddb7a-72e8-4a85-acb7-4b8f87f49177 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea266e0e-5cd2-42d5-9b01-fb0140126865 (dataset): DatasetConfig { id: ea266e0e-5cd2-42d5-9b01-fb0140126865 (dataset), name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f276166c-a2da-44bf-9735-b44241aaeece (dataset): DatasetConfig { id: f276166c-a2da-44bf-9735-b44241aaeece (dataset), name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f334b77d-6e25-43f9-8565-e8dca8a88582 (dataset): DatasetConfig { id: f334b77d-6e25-43f9-8565-e8dca8a88582 (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5ac1a40-4c64-4a93-acc3-fd5a762a6980 (dataset): DatasetConfig { id: f5ac1a40-4c64-4a93-acc3-fd5a762a6980 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f772f878-21cb-4bf1-acf9-604424fac07f (dataset): DatasetConfig { id: f772f878-21cb-4bf1-acf9-604424fac07f (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fd1bf419-c63a-48ff-8375-49abf318948a (dataset): DatasetConfig { id: fd1bf419-c63a-48ff-8375-49abf318948a (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd5ea641-8b71-4802-b3d6-f0d26382cd26 (dataset): DatasetConfig { id: fd5ea641-8b71-4802-b3d6-f0d26382cd26 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4442025-01-28T08:28:33.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53811
4452025-01-28T08:28:33.459ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
4462025-01-28T08:28:33.459ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {016f2f5b-4bd9-4187-bb37-3c9bffbb1f41 (dataset): DatasetConfig { id: 016f2f5b-4bd9-4187-bb37-3c9bffbb1f41 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 01a7e2c3-c490-4120-819d-45df1fd1ca07 (dataset): DatasetConfig { id: 01a7e2c3-c490-4120-819d-45df1fd1ca07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02e877ae-23f7-4838-8a8b-b967373e171a (dataset): DatasetConfig { id: 02e877ae-23f7-4838-8a8b-b967373e171a (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09a20da4-1ef7-438d-b46e-651ad833667e (dataset): DatasetConfig { id: 09a20da4-1ef7-438d-b46e-651ad833667e (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f606701-e674-4c93-ac70-2c3a2abf36af (dataset): DatasetConfig { id: 0f606701-e674-4c93-ac70-2c3a2abf36af (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 110161eb-a3af-4d01-ba2f-a2cf363225eb (dataset): DatasetConfig { id: 110161eb-a3af-4d01-ba2f-a2cf363225eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1206823a-566f-452b-b1cf-99e42fdd10ea (dataset): DatasetConfig { id: 1206823a-566f-452b-b1cf-99e42fdd10ea (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14201f04-d262-4264-8e7c-a6603c2f2db4 (dataset): DatasetConfig { id: 14201f04-d262-4264-8e7c-a6603c2f2db4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 178168eb-2d42-46c8-a2a5-44aa279495d4 (dataset): DatasetConfig { id: 178168eb-2d42-46c8-a2a5-44aa279495d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f6b5d10-56fd-48f1-b094-b86d8c0a4c4a (dataset): DatasetConfig { id: 1f6b5d10-56fd-48f1-b094-b86d8c0a4c4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c3bb16c-7186-4f1f-98dd-ee24c58cc775 (dataset): DatasetConfig { id: 2c3bb16c-7186-4f1f-98dd-ee24c58cc775 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c87a655-aa41-49ac-9f8a-43bae0124ddd (dataset): DatasetConfig { id: 2c87a655-aa41-49ac-9f8a-43bae0124ddd (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d90e48f-49f4-4cba-b594-924445be289b (dataset): DatasetConfig { id: 2d90e48f-49f4-4cba-b594-924445be289b (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36d887e5-00ab-4e20-955d-8973cac2e740 (dataset): DatasetConfig { id: 36d887e5-00ab-4e20-955d-8973cac2e740 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37c535e5-0b8b-42de-8efc-e9603fcf60c2 (dataset): DatasetConfig { id: 37c535e5-0b8b-42de-8efc-e9603fcf60c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4faf7213-ead9-4c37-96bf-25933e3d875d (dataset): DatasetConfig { id: 4faf7213-ead9-4c37-96bf-25933e3d875d (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51889a4d-f7de-42a4-add9-61009ba31705 (dataset): DatasetConfig { id: 51889a4d-f7de-42a4-add9-61009ba31705 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56c46b33-e33c-448c-9712-814a84ff8873 (dataset): DatasetConfig { id: 56c46b33-e33c-448c-9712-814a84ff8873 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57f4e93f-8e31-4625-b6d4-a03147defb92 (dataset): DatasetConfig { id: 57f4e93f-8e31-4625-b6d4-a03147defb92 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61662447-091c-475a-bc29-2304cbd9861f (dataset): DatasetConfig { id: 61662447-091c-475a-bc29-2304cbd9861f (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 677f3355-e746-46ef-9eb7-5be194e72378 (dataset): DatasetConfig { id: 677f3355-e746-46ef-9eb7-5be194e72378 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6cd94cdb-8c5c-4776-8d50-738bc0a1a16b (dataset): DatasetConfig { id: 6cd94cdb-8c5c-4776-8d50-738bc0a1a16b (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6fbe906e-bead-48d9-abf4-6f19ffa9704e (dataset): DatasetConfig { id: 6fbe906e-bead-48d9-abf4-6f19ffa9704e (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6fc69eee-e9ae-4f9d-b067-6afc775c82bd (dataset): DatasetConfig { id: 6fc69eee-e9ae-4f9d-b067-6afc775c82bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 778e2010-fb7b-4615-9530-c7322a8d3441 (dataset): DatasetConfig { id: 778e2010-fb7b-4615-9530-c7322a8d3441 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b6a1f58-0158-494b-8a46-d9944cf20d6f (dataset): DatasetConfig { id: 7b6a1f58-0158-494b-8a46-d9944cf20d6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82d633f9-df0b-4ebd-836d-c0cb0e13765d (dataset): DatasetConfig { id: 82d633f9-df0b-4ebd-836d-c0cb0e13765d (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e192cc2-1693-49ad-8687-0ab508dd0e19 (dataset): DatasetConfig { id: 8e192cc2-1693-49ad-8687-0ab508dd0e19 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9060ff0e-304d-474b-a5a2-cb5af44c2304 (dataset): DatasetConfig { id: 9060ff0e-304d-474b-a5a2-cb5af44c2304 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94cc5456-c89d-4fa2-a7b4-c4754af13cad (dataset): DatasetConfig { id: 94cc5456-c89d-4fa2-a7b4-c4754af13cad (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95691e27-9071-46b5-a2d0-4cf65435b123 (dataset): DatasetConfig { id: 95691e27-9071-46b5-a2d0-4cf65435b123 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99fe2f02-bae3-46e9-8fe2-98b5e4f77160 (dataset): DatasetConfig { id: 99fe2f02-bae3-46e9-8fe2-98b5e4f77160 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9bb5bb54-8e93-4c77-b106-084006a4b24d (dataset): DatasetConfig { id: 9bb5bb54-8e93-4c77-b106-084006a4b24d (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9cfc0821-36f3-4b59-ba1e-8ba3c914c107 (dataset): DatasetConfig { id: 9cfc0821-36f3-4b59-ba1e-8ba3c914c107 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0141c1d-8476-4811-b126-d10d17a32045 (dataset): DatasetConfig { id: a0141c1d-8476-4811-b126-d10d17a32045 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2e1781c-cea0-4ffd-a45b-bf1a18f75ed8 (dataset): DatasetConfig { id: a2e1781c-cea0-4ffd-a45b-bf1a18f75ed8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a31f9fbf-038b-46b1-8204-ba047390e10f (dataset): DatasetConfig { id: a31f9fbf-038b-46b1-8204-ba047390e10f (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a746272f-9783-4aec-bf80-38fbb8708392 (dataset): DatasetConfig { id: a746272f-9783-4aec-bf80-38fbb8708392 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ade917e4-316f-44ef-ab5f-980bc2717baa (dataset): DatasetConfig { id: ade917e4-316f-44ef-ab5f-980bc2717baa (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af1ecc1f-502c-4477-8904-e8a06e7d0e1d (dataset): DatasetConfig { id: af1ecc1f-502c-4477-8904-e8a06e7d0e1d (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5c7b46e-0021-464f-9646-b8b588a39eda (dataset): DatasetConfig { id: b5c7b46e-0021-464f-9646-b8b588a39eda (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b661ce32-2a6e-4c20-8a51-bdc9df3b3f62 (dataset): DatasetConfig { id: b661ce32-2a6e-4c20-8a51-bdc9df3b3f62 (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bb1fad51-c7bc-464e-8993-63bbabaa70ac (dataset): DatasetConfig { id: bb1fad51-c7bc-464e-8993-63bbabaa70ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc4a905c-e0fe-4beb-a382-259a5c33307a (dataset): DatasetConfig { id: bc4a905c-e0fe-4beb-a382-259a5c33307a (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c00b9692-5800-4fba-9939-18904547ea70 (dataset): DatasetConfig { id: c00b9692-5800-4fba-9939-18904547ea70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c08f9ad7-220e-4a20-9161-0e7bd306f432 (dataset): DatasetConfig { id: c08f9ad7-220e-4a20-9161-0e7bd306f432 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77e07d8-e3ec-4d80-a2b9-658325ada87f (dataset): DatasetConfig { id: c77e07d8-e3ec-4d80-a2b9-658325ada87f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cb7bed30-5d95-4feb-8757-86024dab3c2a (dataset): DatasetConfig { id: cb7bed30-5d95-4feb-8757-86024dab3c2a (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc385a04-779d-4545-a587-a6826ce0a7eb (dataset): DatasetConfig { id: cc385a04-779d-4545-a587-a6826ce0a7eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4740201-2457-42c9-bb5b-c5742e321ea5 (dataset): DatasetConfig { id: d4740201-2457-42c9-bb5b-c5742e321ea5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d60f1c9a-5f8e-4203-8594-23fa01840706 (dataset): DatasetConfig { id: d60f1c9a-5f8e-4203-8594-23fa01840706 (dataset), name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6c0efb6-42f2-4261-bbec-9c0d2933c6fa (dataset): DatasetConfig { id: d6c0efb6-42f2-4261-bbec-9c0d2933c6fa (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d845fcc5-7319-44d6-8d02-4fb6ed97dab5 (dataset): DatasetConfig { id: d845fcc5-7319-44d6-8d02-4fb6ed97dab5 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dacb2588-cd98-43f2-a6c1-5e1bb3bd6fdb (dataset): DatasetConfig { id: dacb2588-cd98-43f2-a6c1-5e1bb3bd6fdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e13632a8-1888-440c-8327-8326c0a0f207 (dataset): DatasetConfig { id: e13632a8-1888-440c-8327-8326c0a0f207 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e33ba639-f3b4-4eac-8cd0-2991ee97f5e5 (dataset): DatasetConfig { id: e33ba639-f3b4-4eac-8cd0-2991ee97f5e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e46f2c73-d77b-4bfc-987f-0575f35a3b21 (dataset): DatasetConfig { id: e46f2c73-d77b-4bfc-987f-0575f35a3b21 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e62492cb-286e-451d-ae30-906fac64caba (dataset): DatasetConfig { id: e62492cb-286e-451d-ae30-906fac64caba (dataset), name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e78ddb7a-72e8-4a85-acb7-4b8f87f49177 (dataset): DatasetConfig { id: e78ddb7a-72e8-4a85-acb7-4b8f87f49177 (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea266e0e-5cd2-42d5-9b01-fb0140126865 (dataset): DatasetConfig { id: ea266e0e-5cd2-42d5-9b01-fb0140126865 (dataset), name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f276166c-a2da-44bf-9735-b44241aaeece (dataset): DatasetConfig { id: f276166c-a2da-44bf-9735-b44241aaeece (dataset), name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f334b77d-6e25-43f9-8565-e8dca8a88582 (dataset): DatasetConfig { id: f334b77d-6e25-43f9-8565-e8dca8a88582 (dataset), name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5ac1a40-4c64-4a93-acc3-fd5a762a6980 (dataset): DatasetConfig { id: f5ac1a40-4c64-4a93-acc3-fd5a762a6980 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f772f878-21cb-4bf1-acf9-604424fac07f (dataset): DatasetConfig { id: f772f878-21cb-4bf1-acf9-604424fac07f (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fd1bf419-c63a-48ff-8375-49abf318948a (dataset): DatasetConfig { id: fd1bf419-c63a-48ff-8375-49abf318948a (dataset), name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd5ea641-8b71-4802-b3d6-f0d26382cd26 (dataset): DatasetConfig { id: fd5ea641-8b71-4802-b3d6-f0d26382cd26 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4472025-01-28T08:28:33.459ZINFOSledAgent (StorageManager): No ledger in /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482025-01-28T08:28:33.459ZINFOSledAgent (StorageManager): No ledger in /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4492025-01-28T08:28:33.459ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4502025-01-28T08:28:33.475ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4512025-01-28T08:28:33.475ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4522025-01-28T08:28:33.475ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crucible" } file = sled-storage/src/manager.rs:1431
4532025-01-28T08:28:33.524ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542025-01-28T08:28:33.524ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4552025-01-28T08:28:33.524ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone/oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758"), full_name: "oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone/oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758" } file = sled-storage/src/manager.rs:1431
4562025-01-28T08:28:33.581ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572025-01-28T08:28:33.581ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4582025-01-28T08:28:33.581ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone" } file = sled-storage/src/manager.rs:1431
4592025-01-28T08:28:33.608ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4602025-01-28T08:28:33.608ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4612025-01-28T08:28:33.608ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4622025-01-28T08:28:33.655ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632025-01-28T08:28:33.656ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4642025-01-28T08:28:33.656ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7" } file = sled-storage/src/manager.rs:1431
4652025-01-28T08:28:33.712ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662025-01-28T08:28:33.712ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4672025-01-28T08:28:33.712ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4682025-01-28T08:28:33.746ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/09b4ce33-23b9-42cf-84fa-bef739079982) file = sled-agent/src/probe_manager.rs:231 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
4692025-01-28T08:28:33.757ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702025-01-28T08:28:33.757ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4712025-01-28T08:28:33.757ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4722025-01-28T08:28:33.804ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732025-01-28T08:28:33.804ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4742025-01-28T08:28:33.804ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/zone/oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8"), full_name: "oxp_352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/zone/oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8" } file = sled-storage/src/manager.rs:1431
4752025-01-28T08:28:33.863ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4762025-01-28T08:28:33.863ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4772025-01-28T08:28:33.863ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4782025-01-28T08:28:33.913ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4792025-01-28T08:28:33.913ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4802025-01-28T08:28:33.913ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone/oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), full_name: "oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone/oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8" } file = sled-storage/src/manager.rs:1431
4812025-01-28T08:28:33.970ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822025-01-28T08:28:33.970ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4832025-01-28T08:28:33.970ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crucible" } file = sled-storage/src/manager.rs:1431
4842025-01-28T08:28:34.017ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852025-01-28T08:28:34.017ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4862025-01-28T08:28:34.017ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6/crucible" } file = sled-storage/src/manager.rs:1431
4872025-01-28T08:28:34.062ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882025-01-28T08:28:34.062ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4892025-01-28T08:28:34.062ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone/oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8"), full_name: "oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone/oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8" } file = sled-storage/src/manager.rs:1431
4902025-01-28T08:28:34.120ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912025-01-28T08:28:34.120ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4922025-01-28T08:28:34.120ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4932025-01-28T08:28:34.168ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942025-01-28T08:28:34.168ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4952025-01-28T08:28:34.168ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/72e3aa90-129e-420c-961e-0b8eb9c32b50/crypt/debug"), full_name: "oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50/crypt/debug" } file = sled-storage/src/manager.rs:1431
4962025-01-28T08:28:34.196ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972025-01-28T08:28:34.196ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4982025-01-28T08:28:34.196ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_352e06d5-ecf0-4843-af74-5fa99efbd226/crucible" } file = sled-storage/src/manager.rs:1431
4992025-01-28T08:28:34.245ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002025-01-28T08:28:34.245ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5012025-01-28T08:28:34.245ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1eaf2938-a2ac-484f-832d-16d88783efae/crypt/zone/oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180"), full_name: "oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crypt/zone/oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180" } file = sled-storage/src/manager.rs:1431
5022025-01-28T08:28:34.305ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032025-01-28T08:28:34.305ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5042025-01-28T08:28:34.305ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone/oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone/oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a" } file = sled-storage/src/manager.rs:1431
5052025-01-28T08:28:34.367ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5062025-01-28T08:28:34.367ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5072025-01-28T08:28:34.367ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone/oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone/oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688" } file = sled-storage/src/manager.rs:1431
5082025-01-28T08:28:34.425ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5092025-01-28T08:28:34.425ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5102025-01-28T08:28:34.425ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone" } file = sled-storage/src/manager.rs:1431
5112025-01-28T08:28:34.455ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5122025-01-28T08:28:34.455ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5132025-01-28T08:28:34.455ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/debug"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/debug" } file = sled-storage/src/manager.rs:1431
5142025-01-28T08:28:34.483ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152025-01-28T08:28:34.483ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5162025-01-28T08:28:34.483ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/debug"), full_name: "oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/debug" } file = sled-storage/src/manager.rs:1431
5172025-01-28T08:28:34.514ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182025-01-28T08:28:34.514ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5192025-01-28T08:28:34.514ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5202025-01-28T08:28:34.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212025-01-28T08:28:34.563ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5222025-01-28T08:28:34.563ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/72e3aa90-129e-420c-961e-0b8eb9c32b50/crypt/zone"), full_name: "oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50/crypt/zone" } file = sled-storage/src/manager.rs:1431
5232025-01-28T08:28:34.592ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242025-01-28T08:28:34.592ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5252025-01-28T08:28:34.592ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5440209-1de6-4cf7-8077-0c0703036684/crypt/debug"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/debug" } file = sled-storage/src/manager.rs:1431
5262025-01-28T08:28:34.621ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272025-01-28T08:28:34.621ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5282025-01-28T08:28:34.621ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/zone/oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71"), full_name: "oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/zone/oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71" } file = sled-storage/src/manager.rs:1431
5292025-01-28T08:28:34.680ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302025-01-28T08:28:34.680ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5312025-01-28T08:28:34.680ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/zone/oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4"), full_name: "oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/zone/oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4" } file = sled-storage/src/manager.rs:1431
5322025-01-28T08:28:34.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332025-01-28T08:28:34.741ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5342025-01-28T08:28:34.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone/oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34"), full_name: "oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone/oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34" } file = sled-storage/src/manager.rs:1431
5352025-01-28T08:28:34.752ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/09b4ce33-23b9-42cf-84fa-bef739079982) file = sled-agent/src/probe_manager.rs:231 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
5362025-01-28T08:28:34.800ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5372025-01-28T08:28:34.800ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5382025-01-28T08:28:34.800ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1eaf2938-a2ac-484f-832d-16d88783efae/crypt/zone"), full_name: "oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crypt/zone" } file = sled-storage/src/manager.rs:1431
5392025-01-28T08:28:34.828ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5402025-01-28T08:28:34.828ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5412025-01-28T08:28:34.828ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/zone"), full_name: "oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/zone" } file = sled-storage/src/manager.rs:1431
5422025-01-28T08:28:34.857ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5432025-01-28T08:28:34.857ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5442025-01-28T08:28:34.857ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/zone/oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6"), full_name: "oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/zone/oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6" } file = sled-storage/src/manager.rs:1431
5452025-01-28T08:28:34.914ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5462025-01-28T08:28:34.914ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5472025-01-28T08:28:34.914ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible" } file = sled-storage/src/manager.rs:1431
5482025-01-28T08:28:34.961ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5492025-01-28T08:28:34.961ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5502025-01-28T08:28:34.961ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone/oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone/oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888" } file = sled-storage/src/manager.rs:1431
5512025-01-28T08:28:35.019ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522025-01-28T08:28:35.019ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5532025-01-28T08:28:35.019ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/zone"), full_name: "oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/zone" } file = sled-storage/src/manager.rs:1431
5542025-01-28T08:28:35.049ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552025-01-28T08:28:35.049ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5562025-01-28T08:28:35.049ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/zone/oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d"), full_name: "oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/zone/oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d" } file = sled-storage/src/manager.rs:1431
5572025-01-28T08:28:35.111ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582025-01-28T08:28:35.111ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5592025-01-28T08:28:35.111ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/65f70e9d-f097-45c2-b78f-8e8c52c0855e/crypt/zone/oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321"), full_name: "oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e/crypt/zone/oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321" } file = sled-storage/src/manager.rs:1431
5602025-01-28T08:28:35.170ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612025-01-28T08:28:35.170ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5622025-01-28T08:28:35.170ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5632025-01-28T08:28:35.219ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642025-01-28T08:28:35.219ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5652025-01-28T08:28:35.219ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/zone/oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2"), full_name: "oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/zone/oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2" } file = sled-storage/src/manager.rs:1431
5662025-01-28T08:28:35.280ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672025-01-28T08:28:35.280ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5682025-01-28T08:28:35.280ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crucible" } file = sled-storage/src/manager.rs:1431
5692025-01-28T08:28:35.327ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702025-01-28T08:28:35.327ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712025-01-28T08:28:35.327ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97" } file = sled-storage/src/manager.rs:1431
5722025-01-28T08:28:35.385ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732025-01-28T08:28:35.385ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742025-01-28T08:28:35.385ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5752025-01-28T08:28:35.432ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762025-01-28T08:28:35.433ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5772025-01-28T08:28:35.433ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/debug"), full_name: "oxp_352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/debug" } file = sled-storage/src/manager.rs:1431
5782025-01-28T08:28:35.461ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792025-01-28T08:28:35.461ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802025-01-28T08:28:35.461ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5812025-01-28T08:28:35.509ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822025-01-28T08:28:35.509ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5832025-01-28T08:28:35.509ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/zone"), full_name: "oxp_352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/zone" } file = sled-storage/src/manager.rs:1431
5842025-01-28T08:28:35.538ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852025-01-28T08:28:35.538ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862025-01-28T08:28:35.538ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/72e3aa90-129e-420c-961e-0b8eb9c32b50/crypt/zone/oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab"), full_name: "oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50/crypt/zone/oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab" } file = sled-storage/src/manager.rs:1431
5872025-01-28T08:28:35.597ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882025-01-28T08:28:35.597ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892025-01-28T08:28:35.597ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone/oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone/oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921" } file = sled-storage/src/manager.rs:1431
5902025-01-28T08:28:35.659ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912025-01-28T08:28:35.659ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5922025-01-28T08:28:35.659ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/debug"), full_name: "oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/debug" } file = sled-storage/src/manager.rs:1431
5932025-01-28T08:28:35.687ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942025-01-28T08:28:35.687ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5952025-01-28T08:28:35.687ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375" } file = sled-storage/src/manager.rs:1431
5962025-01-28T08:28:35.748ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972025-01-28T08:28:35.748ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5982025-01-28T08:28:35.748ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/zone/oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f"), full_name: "oxp_352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/zone/oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f" } file = sled-storage/src/manager.rs:1431
5992025-01-28T08:28:35.753ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/09b4ce33-23b9-42cf-84fa-bef739079982) file = sled-agent/src/probe_manager.rs:231 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
6002025-01-28T08:28:35.809ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012025-01-28T08:28:35.809ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6022025-01-28T08:28:35.809ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4/crucible" } file = sled-storage/src/manager.rs:1431
6032025-01-28T08:28:35.857ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042025-01-28T08:28:35.857ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6052025-01-28T08:28:35.857ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/65f70e9d-f097-45c2-b78f-8e8c52c0855e/crypt/zone"), full_name: "oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e/crypt/zone" } file = sled-storage/src/manager.rs:1431
6062025-01-28T08:28:35.887ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072025-01-28T08:28:35.887ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082025-01-28T08:28:35.887ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6092025-01-28T08:28:35.935ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102025-01-28T08:28:35.935ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112025-01-28T08:28:35.935ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone/oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), full_name: "oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/zone/oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7" } file = sled-storage/src/manager.rs:1431
6122025-01-28T08:28:35.994ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132025-01-28T08:28:35.994ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142025-01-28T08:28:35.994ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e/crucible" } file = sled-storage/src/manager.rs:1431
6152025-01-28T08:28:36.042ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-01-28T08:28:36.042ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172025-01-28T08:28:36.042ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d" } file = sled-storage/src/manager.rs:1431
6182025-01-28T08:28:36.104ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-01-28T08:28:36.104ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202025-01-28T08:28:36.104ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50/crucible" } file = sled-storage/src/manager.rs:1431
6212025-01-28T08:28:36.152ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-01-28T08:28:36.152ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232025-01-28T08:28:36.152ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb" } file = sled-storage/src/manager.rs:1431
6242025-01-28T08:28:36.214ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-01-28T08:28:36.214ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262025-01-28T08:28:36.214ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6272025-01-28T08:28:36.264ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282025-01-28T08:28:36.264ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6292025-01-28T08:28:36.264ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b" } file = sled-storage/src/manager.rs:1431
6302025-01-28T08:28:36.324ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312025-01-28T08:28:36.324ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6322025-01-28T08:28:36.324ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/65f70e9d-f097-45c2-b78f-8e8c52c0855e/crypt/debug"), full_name: "oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e/crypt/debug" } file = sled-storage/src/manager.rs:1431
6332025-01-28T08:28:36.353ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342025-01-28T08:28:36.353ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6352025-01-28T08:28:36.353ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/65f70e9d-f097-45c2-b78f-8e8c52c0855e/crypt/zone/oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1"), full_name: "oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e/crypt/zone/oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1" } file = sled-storage/src/manager.rs:1431
6362025-01-28T08:28:36.415ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372025-01-28T08:28:36.415ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6382025-01-28T08:28:36.415ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/zone/oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364"), full_name: "oxp_352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/zone/oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364" } file = sled-storage/src/manager.rs:1431
6392025-01-28T08:28:36.474ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402025-01-28T08:28:36.474ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6412025-01-28T08:28:36.474ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1eaf2938-a2ac-484f-832d-16d88783efae/crypt/debug"), full_name: "oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crypt/debug" } file = sled-storage/src/manager.rs:1431
6422025-01-28T08:28:36.503ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432025-01-28T08:28:36.503ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6442025-01-28T08:28:36.503ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/debug"), full_name: "oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/debug" } file = sled-storage/src/manager.rs:1431
6452025-01-28T08:28:36.533ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462025-01-28T08:28:36.533ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472025-01-28T08:28:36.533ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), full_name: "oxp_a5440209-1de6-4cf7-8077-0c0703036684/crypt/zone/oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671" } file = sled-storage/src/manager.rs:1431
6482025-01-28T08:28:36.592ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6492025-01-28T08:28:36.592ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6502025-01-28T08:28:36.592ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone"), full_name: "oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/zone" } file = sled-storage/src/manager.rs:1431
6512025-01-28T08:28:36.621ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522025-01-28T08:28:36.622ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6532025-01-28T08:28:36.622ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
6542025-01-28T08:28:36.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3163658 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53811 req_id = e0098339-069e-43ac-8307-67c7ff05e813 response_code = 200 uri = /datasets
6552025-01-28T08:28:36.655ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: f7e28eff-24bd-426b-9b36-aa0bb7d4f888 (service), filesystem_pool: Some(ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 22a252bc-1738-4b5b-be77-8e58b57cb375 (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 9cd4cdae-af73-4fcd-b8b0-09650ce08ef2 (service), filesystem_pool: Some(ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6562025-01-28T08:28:36.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65337
6572025-01-28T08:28:36.655ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582025-01-28T08:28:36.655ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592025-01-28T08:28:36.665ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-01-28T08:28:36.665ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-01-28T08:28:36.675ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-01-28T08:28:36.675ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-01-28T08:28:36.684ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6642025-01-28T08:28:36.684ZINFOSledAgent (ServiceManager): No ledger in /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-01-28T08:28:36.684ZINFOSledAgent (ServiceManager): No ledger in /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-zones.json file = common/src/ledger.rs:188
6662025-01-28T08:28:36.684ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-28T08:28:36.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-28T08:28:36.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-01-28T08:28:36.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-01-28T08:28:36.755ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/09b4ce33-23b9-42cf-84fa-bef739079982) file = sled-agent/src/probe_manager.rs:231 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
6712025-01-28T08:28:36.785ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888 file = illumos-utils/src/zone.rs:325
6722025-01-28T08:28:36.789ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375 file = illumos-utils/src/zone.rs:325
6732025-01-28T08:28:36.793ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2 file = illumos-utils/src/zone.rs:325
6742025-01-28T08:28:36.806ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888 file = illumos-utils/src/zone.rs:363
6752025-01-28T08:28:36.810ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375 file = illumos-utils/src/zone.rs:363
6762025-01-28T08:28:36.815ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2 file = illumos-utils/src/zone.rs:363
6772025-01-28T08:28:37.758ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/09b4ce33-23b9-42cf-84fa-bef739079982) file = sled-agent/src/probe_manager.rs:231 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
6782025-01-28T08:28:38.422ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6792025-01-28T08:28:38.422ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6802025-01-28T08:28:38.905ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812025-01-28T08:28:38.905ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2
6822025-01-28T08:28:38.909ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6832025-01-28T08:28:39.269ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6842025-01-28T08:28:39.269ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6852025-01-28T08:28:39.280ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6862025-01-28T08:28:39.280ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6872025-01-28T08:28:39.395ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6882025-01-28T08:28:39.396ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
6892025-01-28T08:28:39.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2") failed: Property not found. retry in 58.905075ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2
6902025-01-28T08:28:39.414ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6912025-01-28T08:28:39.414ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
6922025-01-28T08:28:39.472ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
6932025-01-28T08:28:39.472ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
6942025-01-28T08:28:39.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2") failed: Property not found. retry in 110.49203ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2
6952025-01-28T08:28:39.519ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
6962025-01-28T08:28:39.519ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
6972025-01-28T08:28:39.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375") failed: Property not found. retry in 43.883299ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
6982025-01-28T08:28:39.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888") failed: Property not found. retry in 33.945968ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
6992025-01-28T08:28:39.574ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
7002025-01-28T08:28:39.574ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
7012025-01-28T08:28:39.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888") failed: Property not found. retry in 78.281041ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
7022025-01-28T08:28:39.594ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
7032025-01-28T08:28:39.594ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
7042025-01-28T08:28:39.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375") failed: Property not found. retry in 103.35701ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
7052025-01-28T08:28:39.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2") failed: Property not found. retry in 112.562283ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2
7062025-01-28T08:28:39.746ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4808366956527890755 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
7072025-01-28T08:28:39.746ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2435747296695097021 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
7082025-01-28T08:28:39.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888") failed: Property not found. retry in 269.729438ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
7092025-01-28T08:28:39.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375") failed: Property not found. retry in 199.1844ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
7102025-01-28T08:28:39.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2") failed: Property not found. retry in 214.812274ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2
7112025-01-28T08:28:40.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888") failed: Property not found. retry in 348.787567ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
7122025-01-28T08:28:40.035ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
7132025-01-28T08:28:40.035ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
7142025-01-28T08:28:40.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375") failed: Property not found. retry in 275.164843ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
7152025-01-28T08:28:40.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2") failed: Property not found. retry in 1.074865728s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2
7162025-01-28T08:28:40.138ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7172025-01-28T08:28:40.138ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7182025-01-28T08:28:40.172ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7192025-01-28T08:28:40.204ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7202025-01-28T08:28:40.205ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7212025-01-28T08:28:40.205ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7222025-01-28T08:28:40.205ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7232025-01-28T08:28:40.242ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7242025-01-28T08:28:40.283ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14248252677392972289 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
7252025-01-28T08:28:40.283ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8167848374547743825 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
7262025-01-28T08:28:40.296ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7272025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7282025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7292025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7302025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7312025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7322025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7332025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7342025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7352025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7362025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7372025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7382025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7392025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7402025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7412025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7422025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7432025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7442025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7452025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7462025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7472025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7482025-01-28T08:28:40.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7492025-01-28T08:28:40.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375") failed: Property not found. retry in 890.565753ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
7502025-01-28T08:28:40.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888") failed: Property not found. retry in 545.310677ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
7512025-01-28T08:28:40.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888") failed: Property not found. retry in 1.46942585s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
7522025-01-28T08:28:41.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2") failed: Property not found. retry in 1.191157894s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2
7532025-01-28T08:28:41.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375") failed: Property not found. retry in 854.236829ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
7542025-01-28T08:28:42.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375") failed: Property not found. retry in 669.573994ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
7552025-01-28T08:28:42.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2") failed: Property not found. retry in 1.448478969s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2
7562025-01-28T08:28:42.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888") failed: Property not found. retry in 967.477435ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
7572025-01-28T08:28:42.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375") failed: Property not found. retry in 843.534691ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
7582025-01-28T08:28:43.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888") failed: Property not found. retry in 901.911646ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
7592025-01-28T08:28:43.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375") failed: Property not found. retry in 1.029098086s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
7602025-01-28T08:28:43.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2") failed: Property not found. retry in 850.860466ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2
7612025-01-28T08:28:44.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888") failed: Property not found. retry in 1.207273976s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
7622025-01-28T08:28:45.536ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_f7e28eff-24bd-426b-9b36-aa0bb7d4f888
7632025-01-28T08:28:45.536ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_22a252bc-1738-4b5b-be77-8e58b57cb375
7642025-01-28T08:28:45.536ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_9cd4cdae-af73-4fcd-b8b0-09650ce08ef2
7652025-01-28T08:28:45.536ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7662025-01-28T08:28:45.536ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672025-01-28T08:28:45.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8881741 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:65337 req_id = 720152ff-6e81-4640-b13f-fa7e0e211e49 response_code = 204 uri = /omicron-zones
7682025-01-28T08:28:45.539ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7692025-01-28T08:28:45.587ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702025-01-28T08:28:45.636ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7712025-01-28T08:28:45.684ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7722025-01-28T08:28:45.684ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7732025-01-28T08:28:45.714ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7742025-01-28T08:28:45.715ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7752025-01-28T08:28:45.715ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7762025-01-28T08:28:45.744ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: f7e28eff-24bd-426b-9b36-aa0bb7d4f888 (service), filesystem_pool: Some(ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 22a252bc-1738-4b5b-be77-8e58b57cb375 (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 9cd4cdae-af73-4fcd-b8b0-09650ce08ef2 (service), filesystem_pool: Some(ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 3c8d927b-0302-4093-96e0-dfe267392b34 (service), filesystem_pool: Some(ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bbb4f67f-9124-4a21-80c3-69a93bc4e35a, kind: Service { id: 3c8d927b-0302-4093-96e0-dfe267392b34 }, name: Name("ntp-3c8d927b-0302-4093-96e0-dfe267392b34"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 119])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7772025-01-28T08:28:45.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49451
7782025-01-28T08:28:45.744ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7792025-01-28T08:28:45.744ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7802025-01-28T08:28:45.755ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812025-01-28T08:28:45.755ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822025-01-28T08:28:45.766ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-01-28T08:28:45.766ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-01-28T08:28:45.775ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7852025-01-28T08:28:45.775ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-zones.json file = common/src/ledger.rs:177
7862025-01-28T08:28:45.776ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-zones.json file = common/src/ledger.rs:177
7872025-01-28T08:28:45.776ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7882025-01-28T08:28:45.787ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7892025-01-28T08:28:45.820ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7902025-01-28T08:28:45.821ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7912025-01-28T08:28:45.821ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7922025-01-28T08:28:45.851ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 129, 119]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7932025-01-28T08:28:45.851ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7942025-01-28T08:28:45.851ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7952025-01-28T08:28:45.851ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7962025-01-28T08:28:45.852ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7972025-01-28T08:28:45.853ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7982025-01-28T08:28:45.878ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34 file = illumos-utils/src/zone.rs:325
7992025-01-28T08:28:45.896ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34 file = illumos-utils/src/zone.rs:363
8002025-01-28T08:28:46.497ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8012025-01-28T08:28:46.498ZINFOSledAgent (ServiceManager): Booting oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34
8022025-01-28T08:28:46.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34") failed: Property not found. retry in 28.725ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34
8032025-01-28T08:28:46.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34") failed: Property not found. retry in 63.253606ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34
8042025-01-28T08:28:46.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34") failed: Property not found. retry in 234.699533ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34
8052025-01-28T08:28:47.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34") failed: Property not found. retry in 298.115143ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34
8062025-01-28T08:28:47.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34") failed: Property not found. retry in 977.670883ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34
8072025-01-28T08:28:48.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34") failed: Property not found. retry in 1.134221929s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34
8082025-01-28T08:28:49.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34") failed: Property not found. retry in 1.430529063s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34
8092025-01-28T08:28:49.748ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4808366956527890755 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
8102025-01-28T08:28:49.748ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2435747296695097021 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
8112025-01-28T08:28:50.284ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14248252677392972289 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
8122025-01-28T08:28:50.284ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8167848374547743825 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
8132025-01-28T08:28:50.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34") failed: Property not found. retry in 1.421287977s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34
8142025-01-28T08:28:52.322ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34
8152025-01-28T08:28:52.322ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8162025-01-28T08:28:52.322ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8172025-01-28T08:28:52.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6578546 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49451 req_id = 7c0ae691-c00a-47fd-b726-bbad51384795 response_code = 204 uri = /omicron-zones
8182025-01-28T08:28:52.325ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8192025-01-28T08:28:52.355ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8202025-01-28T08:28:52.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33579
8212025-01-28T08:28:52.363ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8222025-01-28T08:28:52.363ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 7664 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33579 req_id = a124ae27-8883-411f-b426-a8927f9ee66d response_code = 500 uri = /timesync
8232025-01-28T08:28:52.366ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8242025-01-28T08:28:52.481ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8252025-01-28T08:28:52.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38637
8262025-01-28T08:28:54.703ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14183515139416113491 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
8272025-01-28T08:28:54.720ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8293707285402287038 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
8282025-01-28T08:28:55.539ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902239215461701002 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
8292025-01-28T08:28:56.489ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_3c8d927b-0302-4093-96e0-dfe267392b34': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8302025-01-28T08:28:56.489ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38637 req_id = 2a0c5ea5-df00-462d-a039-6543659e83df response_code = 500 uri = /timesync
8312025-01-28T08:28:56.492ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8322025-01-28T08:28:56.599ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8332025-01-28T08:28:56.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61712
8342025-01-28T08:28:56.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61712 req_id = 76e4c403-8988-4274-bed1-6a1f3c0d89f9 response_code = 200 uri = /timesync
8352025-01-28T08:28:56.609ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8362025-01-28T08:28:56.609ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8372025-01-28T08:28:56.719ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8382025-01-28T08:28:56.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60048
8392025-01-28T08:28:56.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8628 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60048 req_id = c5832301-d450-49bc-854c-a5778c922bce response_code = 200 uri = /timesync
8402025-01-28T08:28:56.731ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8412025-01-28T08:28:56.731ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8422025-01-28T08:28:56.890ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8432025-01-28T08:28:56.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47451
8442025-01-28T08:28:56.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7523 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47451 req_id = 3a5da367-7fdd-4691-87fd-14a6afe10237 response_code = 200 uri = /timesync
8452025-01-28T08:28:56.900ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8462025-01-28T08:28:56.900ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8472025-01-28T08:28:57.106ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8482025-01-28T08:28:57.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42764
8492025-01-28T08:28:57.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7936 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42764 req_id = 2f888c92-232a-44b9-9926-95528b0fbf8f response_code = 200 uri = /timesync
8502025-01-28T08:28:57.118ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8512025-01-28T08:28:57.118ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8522025-01-28T08:28:57.412ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8532025-01-28T08:28:57.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42046
8542025-01-28T08:28:57.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9005 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42046 req_id = f02b8bed-b6dc-4ff5-ba07-46cbb1c9bf90 response_code = 200 uri = /timesync
8552025-01-28T08:28:57.423ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8562025-01-28T08:28:57.423ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8572025-01-28T08:28:57.833ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8582025-01-28T08:28:57.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60428
8592025-01-28T08:28:57.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7877 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60428 req_id = 6616aed0-12c5-40fa-ba41-3f71c1c59d63 response_code = 200 uri = /timesync
8602025-01-28T08:28:57.843ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8612025-01-28T08:28:57.843ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8622025-01-28T08:28:58.067ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8632025-01-28T08:28:58.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57255
8642025-01-28T08:28:58.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 19948 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57255 req_id = 6874b227-7b3d-4243-8709-00134b1ed136 response_code = 200 uri = /timesync
8652025-01-28T08:28:58.091ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1159655526, ip_addr: 69.30.240.102, stratum: 5, ref_time: 1738052937.3298976, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8662025-01-28T08:28:58.091ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1383
8672025-01-28T08:28:58.120ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: f7e28eff-24bd-426b-9b36-aa0bb7d4f888 (service), filesystem_pool: Some(ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 22a252bc-1738-4b5b-be77-8e58b57cb375 (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 9cd4cdae-af73-4fcd-b8b0-09650ce08ef2 (service), filesystem_pool: Some(ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 3c8d927b-0302-4093-96e0-dfe267392b34 (service), filesystem_pool: Some(ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bbb4f67f-9124-4a21-80c3-69a93bc4e35a, kind: Service { id: 3c8d927b-0302-4093-96e0-dfe267392b34 }, name: Name("ntp-3c8d927b-0302-4093-96e0-dfe267392b34"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 119])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: ae4c5a04-efaa-41d1-bdd0-0eef498db688 (service), filesystem_pool: Some(ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7becd06a-0923-4d8d-8b8c-acd02e29b61d (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External } } } }, OmicronZoneConfig { id: 12792ce7-428a-4b31-a7f5-515d82c441f6 (service), filesystem_pool: Some(ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 475abaf9-09d4-4cf1-b911-ba67c065cf71 (service), filesystem_pool: Some(ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External } } } }, OmicronZoneConfig { id: ad1abc9a-d065-49f8-9d71-e7aa9d0349f8 (service), filesystem_pool: Some(ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8682025-01-28T08:28:58.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63207
8692025-01-28T08:28:58.121ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8702025-01-28T08:28:58.121ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8712025-01-28T08:28:58.132ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8722025-01-28T08:28:58.132ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8732025-01-28T08:28:58.141ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8742025-01-28T08:28:58.141ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8752025-01-28T08:28:58.151ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8762025-01-28T08:28:58.151ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8772025-01-28T08:28:58.161ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8782025-01-28T08:28:58.161ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8792025-01-28T08:28:58.169ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8802025-01-28T08:28:58.169ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8812025-01-28T08:28:58.178ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8822025-01-28T08:28:58.178ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8832025-01-28T08:28:58.188ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8842025-01-28T08:28:58.188ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8852025-01-28T08:28:58.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8862025-01-28T08:28:58.197ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-zones.json file = common/src/ledger.rs:177
8872025-01-28T08:28:58.197ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-zones.json file = common/src/ledger.rs:177
8882025-01-28T08:28:58.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8892025-01-28T08:28:58.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8902025-01-28T08:28:58.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8912025-01-28T08:28:58.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8922025-01-28T08:28:58.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8932025-01-28T08:28:58.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8942025-01-28T08:28:58.369ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 file = illumos-utils/src/zone.rs:325
8952025-01-28T08:28:58.373ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688 file = illumos-utils/src/zone.rs:325
8962025-01-28T08:28:58.377ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d file = illumos-utils/src/zone.rs:325
8972025-01-28T08:28:58.384ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8 file = illumos-utils/src/zone.rs:325
8982025-01-28T08:28:58.389ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71 file = illumos-utils/src/zone.rs:325
8992025-01-28T08:28:58.394ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 file = illumos-utils/src/zone.rs:363
9002025-01-28T08:28:58.398ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688 file = illumos-utils/src/zone.rs:363
9012025-01-28T08:28:58.403ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d file = illumos-utils/src/zone.rs:363
9022025-01-28T08:28:58.407ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8 file = illumos-utils/src/zone.rs:363
9032025-01-28T08:28:58.411ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71 file = illumos-utils/src/zone.rs:363
9042025-01-28T08:29:03.222ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='12792ce7-428a-4b31-a7f5-515d82c441f6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9052025-01-28T08:29:03.222ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9062025-01-28T08:29:03.232ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7becd06a-0923-4d8d-8b8c-acd02e29b61d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9072025-01-28T08:29:03.232ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9082025-01-28T08:29:03.273ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='475abaf9-09d4-4cf1-b911-ba67c065cf71'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9092025-01-28T08:29:03.274ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9102025-01-28T08:29:03.280ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ad1abc9a-d065-49f8-9d71-e7aa9d0349f8'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9112025-01-28T08:29:03.280ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9122025-01-28T08:29:03.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6") failed: Property not found. retry in 61.080618ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9132025-01-28T08:29:03.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 60.923837ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9142025-01-28T08:29:03.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8") failed: Property not found. retry in 57.767808ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9152025-01-28T08:29:03.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 58.048346ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9162025-01-28T08:29:03.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6") failed: Property not found. retry in 145.473312ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9172025-01-28T08:29:03.459ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ae4c5a04-efaa-41d1-bdd0-0eef498db688'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9182025-01-28T08:29:03.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 148.708607ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9192025-01-28T08:29:03.467ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9202025-01-28T08:29:03.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8") failed: Property not found. retry in 134.023495ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9212025-01-28T08:29:03.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 67.858377ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9222025-01-28T08:29:03.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 163.233206ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9232025-01-28T08:29:03.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6") failed: Property not found. retry in 293.477206ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9242025-01-28T08:29:03.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688") failed: Property not found. retry in 71.901611ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9252025-01-28T08:29:03.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 144.914933ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9262025-01-28T08:29:03.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8") failed: Property not found. retry in 148.603536ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9272025-01-28T08:29:03.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688") failed: Property not found. retry in 112.973922ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9282025-01-28T08:29:03.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 233.236217ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9292025-01-28T08:29:03.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 510.889394ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9302025-01-28T08:29:03.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8") failed: Property not found. retry in 581.050984ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9312025-01-28T08:29:03.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688") failed: Property not found. retry in 148.707608ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9322025-01-28T08:29:03.875ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 279.953747ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
9332025-01-28T08:29:03.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6") failed: Property not found. retry in 585.912494ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9342025-01-28T08:29:03.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688") failed: Property not found. retry in 425.738139ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9352025-01-28T08:29:04.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 891.900924ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9362025-01-28T08:29:04.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 911.850763ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9372025-01-28T08:29:04.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8") failed: Property not found. retry in 855.593953ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9382025-01-28T08:29:04.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688") failed: Property not found. retry in 1.172774311s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9392025-01-28T08:29:04.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6") failed: Property not found. retry in 639.709256ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9402025-01-28T08:29:04.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 1.462349994s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9412025-01-28T08:29:05.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 828.262948ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9422025-01-28T08:29:05.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8") failed: Property not found. retry in 536.710818ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9432025-01-28T08:29:05.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6") failed: Property not found. retry in 1.491802086s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9442025-01-28T08:29:05.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688") failed: Property not found. retry in 1.48036422s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9452025-01-28T08:29:05.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8") failed: Property not found. retry in 1.374689175s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9462025-01-28T08:29:06.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 1.183092785s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9472025-01-28T08:29:06.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 1.217088178s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9482025-01-28T08:29:06.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6") failed: Property not found. retry in 1.305494846s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9492025-01-28T08:29:07.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688") failed: Property not found. retry in 1.195678246s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9502025-01-28T08:29:07.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8") failed: Property not found. retry in 1.399522412s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9512025-01-28T08:29:07.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 1.120275337s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9522025-01-28T08:29:07.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 812.12943ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9532025-01-28T08:29:08.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6") failed: Property not found. retry in 701.42312ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9542025-01-28T08:29:08.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688") failed: Property not found. retry in 598.488165ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9552025-01-28T08:29:08.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 945.365379ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9562025-01-28T08:29:08.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 826.377997ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9572025-01-28T08:29:08.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8") failed: Property not found. retry in 1.370931347s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9582025-01-28T08:29:08.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6") failed: Property not found. retry in 1.313403453s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9592025-01-28T08:29:08.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688") failed: Property not found. retry in 673.220788ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9602025-01-28T08:29:09.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 947.919982ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9612025-01-28T08:29:09.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 715.561082ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9622025-01-28T08:29:09.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688") failed: Property not found. retry in 1.371460511s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9632025-01-28T08:29:09.886ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53091
9642025-01-28T08:29:09.886ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53091 req_id = 0b48a0bc-390e-45fc-80eb-9cea248bd1c8 response_code = 200 uri = /baseboard
9652025-01-28T08:29:09.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8") failed: Property not found. retry in 1.46054087s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9662025-01-28T08:29:10.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d") failed: Property not found. retry in 1.321903757s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9672025-01-28T08:29:10.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6") failed: Property not found. retry in 793.00756ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9682025-01-28T08:29:10.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 875.574949ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9692025-01-28T08:29:11.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71") failed: Property not found. retry in 502.581852ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9702025-01-28T08:29:11.662ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6
9712025-01-28T08:29:11.662ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_ae4c5a04-efaa-41d1-bdd0-0eef498db688
9722025-01-28T08:29:11.662ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_7becd06a-0923-4d8d-8b8c-acd02e29b61d
9732025-01-28T08:29:11.662ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_ad1abc9a-d065-49f8-9d71-e7aa9d0349f8
9742025-01-28T08:29:11.662ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_475abaf9-09d4-4cf1-b911-ba67c065cf71
9752025-01-28T08:29:11.662ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9762025-01-28T08:29:11.662ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9772025-01-28T08:29:11.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 13101160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63207 req_id = 27d6df56-89ab-45c8-80a4-b4c36e22e477 response_code = 204 uri = /omicron-zones
9782025-01-28T08:29:11.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37249
9792025-01-28T08:29:11.730ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 34753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = a619be87-7ba7-45ea-b9e0-4976c65c2ce5 response_code = 500 uri = /cockroachdb
9802025-01-28T08:29:11.730ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a619be87-7ba7-45ea-b9e0-4976c65c2ce5", "content-length": "124", "date": "Tue, 28 Jan 2025 08:29:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a619be87-7ba7-45ea-b9e0-4976c65c2ce5" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 117.083679ms
9812025-01-28T08:29:11.876ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27659 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = 726effa8-6883-42da-a485-b38e11d116e8 response_code = 500 uri = /cockroachdb
9822025-01-28T08:29:11.876ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "726effa8-6883-42da-a485-b38e11d116e8", "content-length": "124", "date": "Tue, 28 Jan 2025 08:29:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "726effa8-6883-42da-a485-b38e11d116e8" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 88.361843ms
9832025-01-28T08:29:11.990ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25749 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = d83d3ee0-99cc-4a78-b120-944088ab39b6 response_code = 500 uri = /cockroachdb
9842025-01-28T08:29:11.991ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d83d3ee0-99cc-4a78-b120-944088ab39b6", "content-length": "124", "date": "Tue, 28 Jan 2025 08:29:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d83d3ee0-99cc-4a78-b120-944088ab39b6" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 158.947716ms
9852025-01-28T08:29:12.178ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27353 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = ca1177c3-bf78-4b92-8dbe-d56fb5994b16 response_code = 500 uri = /cockroachdb
9862025-01-28T08:29:12.178ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ca1177c3-bf78-4b92-8dbe-d56fb5994b16", "content-length": "124", "date": "Tue, 28 Jan 2025 08:29:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ca1177c3-bf78-4b92-8dbe-d56fb5994b16" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 183.320931ms
9872025-01-28T08:29:12.388ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = c45803a4-24c0-4d3d-b29d-4d02742e9194 response_code = 500 uri = /cockroachdb
9882025-01-28T08:29:12.388ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c45803a4-24c0-4d3d-b29d-4d02742e9194", "content-length": "124", "date": "Tue, 28 Jan 2025 08:29:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c45803a4-24c0-4d3d-b29d-4d02742e9194" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 146.895751ms
9892025-01-28T08:29:12.563ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26779 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = 391d37b3-4c31-4552-9be3-e3ce453f8afa response_code = 500 uri = /cockroachdb
9902025-01-28T08:29:12.563ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "391d37b3-4c31-4552-9be3-e3ce453f8afa", "content-length": "124", "date": "Tue, 28 Jan 2025 08:29:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "391d37b3-4c31-4552-9be3-e3ce453f8afa" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 372.476645ms
9912025-01-28T08:29:12.960ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25745 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = 57bf5ddb-8da4-47d1-9fe0-5ab7ad116bd0 response_code = 500 uri = /cockroachdb
9922025-01-28T08:29:12.960ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "57bf5ddb-8da4-47d1-9fe0-5ab7ad116bd0", "content-length": "124", "date": "Tue, 28 Jan 2025 08:29:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "57bf5ddb-8da4-47d1-9fe0-5ab7ad116bd0" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 251.801472ms
9932025-01-28T08:29:13.238ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25722 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = bcc2ba8b-dc53-44a8-b879-2b1c200cf0e0 response_code = 500 uri = /cockroachdb
9942025-01-28T08:29:13.238ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bcc2ba8b-dc53-44a8-b879-2b1c200cf0e0", "content-length": "124", "date": "Tue, 28 Jan 2025 08:29:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bcc2ba8b-dc53-44a8-b879-2b1c200cf0e0" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 535.611511ms
9952025-01-28T08:29:13.798ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25033 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = 0dc91c97-dde5-4f38-944a-b97442cca60b response_code = 500 uri = /cockroachdb
9962025-01-28T08:29:13.798ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0dc91c97-dde5-4f38-944a-b97442cca60b", "content-length": "124", "date": "Tue, 28 Jan 2025 08:29:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0dc91c97-dde5-4f38-944a-b97442cca60b" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 590.993313ms
9972025-01-28T08:29:14.416ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_12792ce7-428a-4b31-a7f5-515d82c441f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27857 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = 0ad88906-46b3-4522-b16e-3d098cfbfba4 response_code = 500 uri = /cockroachdb
9982025-01-28T08:29:14.416ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0ad88906-46b3-4522-b16e-3d098cfbfba4", "content-length": "124", "date": "Tue, 28 Jan 2025 08:29:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0ad88906-46b3-4522-b16e-3d098cfbfba4" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 283.486583ms
9992025-01-28T08:29:14.729ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3752
10002025-01-28T08:29:37.303ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
10012025-01-28T08:29:51.180ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
10022025-01-28T08:29:51.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36497661 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37249 req_id = d9972870-14c8-4402-90cb-978184f87af1 response_code = 204 uri = /cockroachdb
10032025-01-28T08:29:51.182ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47157
10042025-01-28T08:29:51.183ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 966 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47157 req_id = 48d0149b-945d-4ec4-beaa-2bda375d4b03 response_code = 200 uri = /baseboard
10052025-01-28T08:29:51.188ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 316.550408ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
10062025-01-28T08:29:51.222ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: f7e28eff-24bd-426b-9b36-aa0bb7d4f888 (service), filesystem_pool: Some(ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 22a252bc-1738-4b5b-be77-8e58b57cb375 (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 9cd4cdae-af73-4fcd-b8b0-09650ce08ef2 (service), filesystem_pool: Some(ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 3c8d927b-0302-4093-96e0-dfe267392b34 (service), filesystem_pool: Some(ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bbb4f67f-9124-4a21-80c3-69a93bc4e35a, kind: Service { id: 3c8d927b-0302-4093-96e0-dfe267392b34 }, name: Name("ntp-3c8d927b-0302-4093-96e0-dfe267392b34"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 119])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: ae4c5a04-efaa-41d1-bdd0-0eef498db688 (service), filesystem_pool: Some(ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7becd06a-0923-4d8d-8b8c-acd02e29b61d (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External } } } }, OmicronZoneConfig { id: 12792ce7-428a-4b31-a7f5-515d82c441f6 (service), filesystem_pool: Some(ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 475abaf9-09d4-4cf1-b911-ba67c065cf71 (service), filesystem_pool: Some(ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External } } } }, OmicronZoneConfig { id: ad1abc9a-d065-49f8-9d71-e7aa9d0349f8 (service), filesystem_pool: Some(ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External } } } }, OmicronZoneConfig { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 (service), filesystem_pool: Some(ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 0c766554-1775-42c8-a58a-b13904a6537f (service), filesystem_pool: Some(ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 (service), filesystem_pool: Some(ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c0b76181-3caf-4143-9524-623c025e89cb (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: fc433a3b-1915-4c16-b9e5-81466b17a758 (service), filesystem_pool: Some(ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 9d78f8d8-4e43-4755-9de5-bc92c8908921 (service), filesystem_pool: Some(ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External } } } }, OmicronZoneConfig { id: 35a1a767-5b43-4e9b-ae6b-9020e8bd5e97 (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 4a763fb6-cc99-4aa3-b40d-f91d0afd644b (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: ae85e581-d12f-4dde-b2b1-4517db9bc4b1 (service), filesystem_pool: Some(ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: ac11a41c-0c8c-4577-bc61-190e35fed90a (service), filesystem_pool: Some(ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External } } } }, OmicronZoneConfig { id: e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7 (service), filesystem_pool: Some(ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External } } } }, OmicronZoneConfig { id: ad94633e-6dff-46d5-8258-193c3076b0c4 (service), filesystem_pool: Some(ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 66bdc885-da83-475d-946e-40e9d872fb4d (service), filesystem_pool: Some(ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External } } } }, OmicronZoneConfig { id: fdd13a8e-766e-4016-86fd-61b5027e0364 (service), filesystem_pool: Some(ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External } } } }, OmicronZoneConfig { id: d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab (service), filesystem_pool: Some(ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8494b7da-0eea-4abf-9d60-231d86c53321 (service), filesystem_pool: Some(ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External } } } }, OmicronZoneConfig { id: 15e1fb31-e066-4a05-b614-a5444b057180 (service), filesystem_pool: Some(ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External } } } }, OmicronZoneConfig { id: 0af64d89-e6c1-46cf-9c83-d6b314ebd0e8 (service), filesystem_pool: Some(ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10072025-01-28T08:29:51.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36227
10082025-01-28T08:29:51.223ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10092025-01-28T08:29:51.223ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10102025-01-28T08:29:51.240ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10112025-01-28T08:29:51.240ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10122025-01-28T08:29:51.251ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10132025-01-28T08:29:51.251ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10142025-01-28T08:29:51.261ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10152025-01-28T08:29:51.261ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10162025-01-28T08:29:51.272ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10172025-01-28T08:29:51.272ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10182025-01-28T08:29:51.282ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10192025-01-28T08:29:51.282ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10202025-01-28T08:29:51.292ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10212025-01-28T08:29:51.292ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10222025-01-28T08:29:51.301ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10232025-01-28T08:29:51.301ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10242025-01-28T08:29:51.310ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10252025-01-28T08:29:51.310ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10262025-01-28T08:29:51.321ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10272025-01-28T08:29:51.321ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10282025-01-28T08:29:51.332ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10292025-01-28T08:29:51.332ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10302025-01-28T08:29:51.342ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10312025-01-28T08:29:51.342ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, kind: Crucible }, responder: ... }
10322025-01-28T08:29:51.353ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10332025-01-28T08:29:51.353ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, kind: Crucible }, responder: ... }
10342025-01-28T08:29:51.363ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10352025-01-28T08:29:51.363ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, kind: Crucible }, responder: ... }
10362025-01-28T08:29:51.374ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10372025-01-28T08:29:51.374ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, kind: Crucible }, responder: ... }
10382025-01-28T08:29:51.383ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10392025-01-28T08:29:51.384ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, kind: Crucible }, responder: ... }
10402025-01-28T08:29:51.395ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10412025-01-28T08:29:51.395ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, kind: Crucible }, responder: ... }
10422025-01-28T08:29:51.407ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10432025-01-28T08:29:51.407ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, kind: Crucible }, responder: ... }
10442025-01-28T08:29:51.416ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10452025-01-28T08:29:51.416ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, kind: Crucible }, responder: ... }
10462025-01-28T08:29:51.427ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10472025-01-28T08:29:51.428ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, kind: Crucible }, responder: ... }
10482025-01-28T08:29:51.437ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10492025-01-28T08:29:51.437ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-zones.json file = common/src/ledger.rs:177
10502025-01-28T08:29:51.438ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-zones.json file = common/src/ledger.rs:177
10512025-01-28T08:29:51.438ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10522025-01-28T08:29:51.559ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10532025-01-28T08:29:51.560ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10542025-01-28T08:29:51.574ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10552025-01-28T08:29:51.574ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10562025-01-28T08:29:51.612ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10572025-01-28T08:29:51.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10582025-01-28T08:29:51.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10592025-01-28T08:29:51.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10602025-01-28T08:29:51.613ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10612025-01-28T08:29:51.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10622025-01-28T08:29:51.773ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10632025-01-28T08:29:51.773ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10642025-01-28T08:29:51.774ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10652025-01-28T08:29:51.818ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10662025-01-28T08:29:51.818ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10672025-01-28T08:29:51.818ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10682025-01-28T08:29:51.818ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10692025-01-28T08:29:51.818ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10702025-01-28T08:29:51.818ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10712025-01-28T08:29:51.818ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1 file = illumos-utils/src/zone.rs:325
10722025-01-28T08:29:51.824ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d file = illumos-utils/src/zone.rs:325
10732025-01-28T08:29:51.830ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a file = illumos-utils/src/zone.rs:325
10742025-01-28T08:29:51.836ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7 file = illumos-utils/src/zone.rs:325
10752025-01-28T08:29:51.842ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364 file = illumos-utils/src/zone.rs:325
10762025-01-28T08:29:51.847ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab file = illumos-utils/src/zone.rs:325
10772025-01-28T08:29:52.015ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1 file = illumos-utils/src/zone.rs:363
10782025-01-28T08:29:52.020ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d file = illumos-utils/src/zone.rs:363
10792025-01-28T08:29:52.025ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a file = illumos-utils/src/zone.rs:363
10802025-01-28T08:29:52.030ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7 file = illumos-utils/src/zone.rs:363
10812025-01-28T08:29:52.035ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364 file = illumos-utils/src/zone.rs:363
10822025-01-28T08:29:52.041ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab file = illumos-utils/src/zone.rs:363
10832025-01-28T08:29:52.046ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321 file = illumos-utils/src/zone.rs:325
10842025-01-28T08:29:52.051ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921 file = illumos-utils/src/zone.rs:325
10852025-01-28T08:29:52.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758 file = illumos-utils/src/zone.rs:325
10862025-01-28T08:29:52.061ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b file = illumos-utils/src/zone.rs:325
10872025-01-28T08:29:52.066ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4 file = illumos-utils/src/zone.rs:325
10882025-01-28T08:29:52.071ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180 file = illumos-utils/src/zone.rs:325
10892025-01-28T08:29:52.077ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8 file = illumos-utils/src/zone.rs:325
10902025-01-28T08:29:52.083ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97 file = illumos-utils/src/zone.rs:325
10912025-01-28T08:29:52.089ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321 file = illumos-utils/src/zone.rs:363
10922025-01-28T08:29:52.098ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921 file = illumos-utils/src/zone.rs:363
10932025-01-28T08:29:52.106ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758 file = illumos-utils/src/zone.rs:363
10942025-01-28T08:29:52.114ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b file = illumos-utils/src/zone.rs:363
10952025-01-28T08:29:52.123ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4 file = illumos-utils/src/zone.rs:363
10962025-01-28T08:29:52.133ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180 file = illumos-utils/src/zone.rs:363
10972025-01-28T08:29:52.145ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8 file = illumos-utils/src/zone.rs:363
10982025-01-28T08:29:52.153ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97 file = illumos-utils/src/zone.rs:363
10992025-01-28T08:29:52.222ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11002025-01-28T08:29:52.289ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11012025-01-28T08:29:52.360ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11022025-01-28T08:29:52.419ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11032025-01-28T08:29:52.476ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11042025-01-28T08:29:52.478ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11052025-01-28T08:29:52.478ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11062025-01-28T08:29:52.535ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 252, 73]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11072025-01-28T08:29:52.535ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11082025-01-28T08:29:52.536ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11092025-01-28T08:29:52.536ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11102025-01-28T08:29:52.590ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 187, 58]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11112025-01-28T08:29:52.590ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11122025-01-28T08:29:52.592ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11132025-01-28T08:29:52.592ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11142025-01-28T08:29:52.648ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 162, 134]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11152025-01-28T08:29:52.648ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11162025-01-28T08:29:52.649ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11172025-01-28T08:29:52.649ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11182025-01-28T08:29:52.702ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 254, 23]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11192025-01-28T08:29:52.702ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11202025-01-28T08:29:52.704ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11212025-01-28T08:29:52.704ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11222025-01-28T08:29:52.758ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 225, 55]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11232025-01-28T08:29:52.758ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11242025-01-28T08:29:52.759ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11252025-01-28T08:29:52.759ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11262025-01-28T08:29:52.769ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11272025-01-28T08:29:52.771ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282025-01-28T08:29:52.831ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11292025-01-28T08:29:52.831ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11302025-01-28T08:29:52.834ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11312025-01-28T08:29:52.834ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11322025-01-28T08:29:52.835ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11332025-01-28T08:29:52.835ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11342025-01-28T08:29:52.838ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11352025-01-28T08:29:52.838ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11362025-01-28T08:29:52.838ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11372025-01-28T08:29:52.846ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11382025-01-28T08:29:52.853ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11392025-01-28T08:29:52.853ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11402025-01-28T08:29:52.853ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11412025-01-28T08:29:52.856ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11422025-01-28T08:29:52.859ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11432025-01-28T08:29:52.859ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11442025-01-28T08:29:53.059ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671 file = illumos-utils/src/zone.rs:325
11452025-01-28T08:29:53.072ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb file = illumos-utils/src/zone.rs:325
11462025-01-28T08:29:53.086ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f file = illumos-utils/src/zone.rs:325
11472025-01-28T08:29:53.094ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 file = illumos-utils/src/zone.rs:325
11482025-01-28T08:29:53.108ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 file = illumos-utils/src/zone.rs:325
11492025-01-28T08:29:53.124ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671 file = illumos-utils/src/zone.rs:363
11502025-01-28T08:29:53.135ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb file = illumos-utils/src/zone.rs:363
11512025-01-28T08:29:53.148ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f file = illumos-utils/src/zone.rs:363
11522025-01-28T08:29:53.158ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 file = illumos-utils/src/zone.rs:363
11532025-01-28T08:29:53.171ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 file = illumos-utils/src/zone.rs:363
11542025-01-28T08:29:56.513ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11552025-01-28T08:29:56.513ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
11562025-01-28T08:29:56.721ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1eaf2938-a2ac-484f-832d-16d88783efae/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1779fa62-fb7c-4157-9b9e-b2772b5e447f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11572025-01-28T08:29:56.721ZINFOSledAgent (ServiceManager): Booting oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
11582025-01-28T08:29:56.730ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c9160c9c-7ff5-4cb3-ba7f-1bd4fa9a009c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11592025-01-28T08:29:56.730ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_352e06d5-ecf0-4843-af74-5fa99efbd226/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8d5c1d61-ec04-4b04-a5cc-08d8377b8cd7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11602025-01-28T08:29:56.730ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='152379a8-27ab-48e5-aa7a-bd605095632f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11612025-01-28T08:29:56.730ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d43b4dbf-780a-47dc-83ab-e3d6d4397101'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11622025-01-28T08:29:56.731ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d4b7b239-0878-4ead-8333-e6a05f2bc1cc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11632025-01-28T08:29:56.731ZINFOSledAgent (ServiceManager): Booting oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
11642025-01-28T08:29:56.739ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
11652025-01-28T08:29:56.748ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
11662025-01-28T08:29:56.757ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
11672025-01-28T08:29:56.772ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
11682025-01-28T08:29:57.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 28.580534ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
11692025-01-28T08:29:57.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 73.171567ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
11702025-01-28T08:29:57.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 38.667128ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
11712025-01-28T08:29:57.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 28.560893ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
11722025-01-28T08:29:57.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 94.308866ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
11732025-01-28T08:29:57.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 26.82642ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
11742025-01-28T08:29:57.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 140.068524ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
11752025-01-28T08:29:59.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 85.188601ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
11762025-01-28T08:29:59.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 141.550425ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
11772025-01-28T08:29:59.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 158.238272ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
11782025-01-28T08:29:59.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 262.164736ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
11792025-01-28T08:30:00.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 85.957818ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
11802025-01-28T08:30:00.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 40.941005ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
11812025-01-28T08:30:00.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 67.392069ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
11822025-01-28T08:30:00.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 108.681701ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
11832025-01-28T08:30:00.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 124.274038ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
11842025-01-28T08:30:00.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 283.011663ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
11852025-01-28T08:30:00.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 213.95202ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
11862025-01-28T08:30:00.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 236.074763ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
11872025-01-28T08:30:00.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 102.908152ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
11882025-01-28T08:30:00.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 131.629001ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
11892025-01-28T08:30:00.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 330.154088ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
11902025-01-28T08:30:00.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 540.170217ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
11912025-01-28T08:30:00.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 469.823143ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
11922025-01-28T08:30:00.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 1.07349267s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
11932025-01-28T08:30:02.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 580.675181ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
11942025-01-28T08:30:02.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 191.007876ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
11952025-01-28T08:30:02.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 153.159796ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
11962025-01-28T08:30:02.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 1.1874338s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
11972025-01-28T08:30:02.344ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='683631bd-8700-4096-b755-d5d9d3a2d929'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982025-01-28T08:30:02.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 794.385951ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
11992025-01-28T08:30:02.409ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='972aa45a-b572-41c5-ab8d-0fcf2ffc7751'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12002025-01-28T08:30:02.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 854.038712ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
12012025-01-28T08:30:02.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 910.612999ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
12022025-01-28T08:30:02.686ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
12032025-01-28T08:30:02.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 405.959303ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
12042025-01-28T08:30:02.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 542.22824ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
12052025-01-28T08:30:02.777ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
12062025-01-28T08:30:02.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 516.1639ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
12072025-01-28T08:30:03.031ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12082025-01-28T08:30:03.033ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12092025-01-28T08:30:03.033ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
12102025-01-28T08:30:03.046ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
12112025-01-28T08:30:03.067ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a5440209-1de6-4cf7-8077-0c0703036684/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2709fcc1-6715-4546-89cb-c436a55c3a97'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12122025-01-28T08:30:03.068ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
12132025-01-28T08:30:03.080ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12142025-01-28T08:30:03.083ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
12152025-01-28T08:30:03.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 48.21433ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
12162025-01-28T08:30:03.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 62.809172ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
12172025-01-28T08:30:03.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 940.033315ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
12182025-01-28T08:30:03.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 110.976116ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
12192025-01-28T08:30:03.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 657.551665ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
12202025-01-28T08:30:03.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 120.825836ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
12212025-01-28T08:30:03.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 686.728687ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
12222025-01-28T08:30:03.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.039478582s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
12232025-01-28T08:30:03.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 890.702081ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
12242025-01-28T08:30:03.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 657.421669ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
12252025-01-28T08:30:03.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 918.789901ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
12262025-01-28T08:30:03.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 277.464856ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
12272025-01-28T08:30:03.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 167.945493ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
12282025-01-28T08:30:03.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 68.831136ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
12292025-01-28T08:30:03.807ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='fc433a3b-1915-4c16-b9e5-81466b17a758'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12302025-01-28T08:30:03.807ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
12312025-01-28T08:30:03.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 115.539196ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
12322025-01-28T08:30:03.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 1.256370609s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
12332025-01-28T08:30:03.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 505.64433ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
12342025-01-28T08:30:04.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 246.60805ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
12352025-01-28T08:30:04.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 343.671607ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
12362025-01-28T08:30:04.077ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12372025-01-28T08:30:04.077ZINFOSledAgent (ServiceManager): Booting oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
12382025-01-28T08:30:04.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 781.972385ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
12392025-01-28T08:30:04.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 68.516642ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
12402025-01-28T08:30:04.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 100.788979ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
12412025-01-28T08:30:04.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 200.636996ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
12422025-01-28T08:30:04.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 1.357899969s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
12432025-01-28T08:30:04.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 136.976714ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
12442025-01-28T08:30:04.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 48.562444ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
12452025-01-28T08:30:04.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 1.463304389s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
12462025-01-28T08:30:04.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 1.192524323s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
12472025-01-28T08:30:04.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 101.121858ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
12482025-01-28T08:30:04.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 822.671926ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
12492025-01-28T08:30:04.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 271.574604ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
12502025-01-28T08:30:04.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 710.822696ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
12512025-01-28T08:30:04.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 231.42054ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
12522025-01-28T08:30:04.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 1.091886535s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
12532025-01-28T08:30:04.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 1.27614692s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
12542025-01-28T08:30:04.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 532.683338ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
12552025-01-28T08:30:04.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 455.376589ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
12562025-01-28T08:30:04.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 1.134231584s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
12572025-01-28T08:30:04.923ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12582025-01-28T08:30:04.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 1.214221947s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
12592025-01-28T08:30:04.950ZINFOSledAgent (ServiceManager): Booting oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
12602025-01-28T08:30:05.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 836.424771ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
12612025-01-28T08:30:05.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 605.964618ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
12622025-01-28T08:30:05.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 1.327119924s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
12632025-01-28T08:30:05.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 692.068411ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
12642025-01-28T08:30:05.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 31.560421ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
12652025-01-28T08:30:05.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 1.431103072s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
12662025-01-28T08:30:05.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 94.407892ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
12672025-01-28T08:30:05.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 29.302293ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
12682025-01-28T08:30:05.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 61.830652ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
12692025-01-28T08:30:05.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 66.104779ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
12702025-01-28T08:30:05.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 133.465404ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
12712025-01-28T08:30:05.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 103.816536ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
12722025-01-28T08:30:05.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 86.227414ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
12732025-01-28T08:30:05.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 219.895397ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
12742025-01-28T08:30:05.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 188.203107ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
12752025-01-28T08:30:05.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 139.815513ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
12762025-01-28T08:30:05.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 117.386445ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
12772025-01-28T08:30:05.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 1.003554731s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
12782025-01-28T08:30:05.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 1.478172986s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
12792025-01-28T08:30:05.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 647.360733ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
12802025-01-28T08:30:05.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 508.576224ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
12812025-01-28T08:30:05.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 319.871455ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
12822025-01-28T08:30:05.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 201.645768ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
12832025-01-28T08:30:05.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 469.007724ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
12842025-01-28T08:30:05.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.113200663s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
12852025-01-28T08:30:05.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 635.738707ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
12862025-01-28T08:30:05.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 891.454043ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
12872025-01-28T08:30:05.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 566.004499ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
12882025-01-28T08:30:05.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 522.60775ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
12892025-01-28T08:30:05.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 1.011623307s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
12902025-01-28T08:30:06.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 777.4039ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
12912025-01-28T08:30:06.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 518.172514ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
12922025-01-28T08:30:06.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 624.842004ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
12932025-01-28T08:30:06.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 892.057503ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
12942025-01-28T08:30:06.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 929.156141ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
12952025-01-28T08:30:06.250ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12962025-01-28T08:30:06.251ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
12972025-01-28T08:30:06.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 693.190388ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
12982025-01-28T08:30:06.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 511.908797ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
12992025-01-28T08:30:06.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 42.873894ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
13002025-01-28T08:30:06.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 584.050551ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
13012025-01-28T08:30:06.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 1.360576639s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
13022025-01-28T08:30:06.705ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 938.555435ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
13032025-01-28T08:30:06.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 144.251298ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
13042025-01-28T08:30:06.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 991.733008ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
13052025-01-28T08:30:06.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 871.232336ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
13062025-01-28T08:30:06.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 1.356860026s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
13072025-01-28T08:30:06.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 1.226928553s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
13082025-01-28T08:30:06.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 1.026349428s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
13092025-01-28T08:30:06.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 895.801731ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
13102025-01-28T08:30:06.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 514.276191ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
13112025-01-28T08:30:06.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 246.777467ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
13122025-01-28T08:30:07.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.019486613s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
13132025-01-28T08:30:07.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 1.212813984s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
13142025-01-28T08:30:07.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 1.324596096s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
13152025-01-28T08:30:07.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 1.360318261s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
13162025-01-28T08:30:07.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 1.078969358s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
13172025-01-28T08:30:07.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 807.474988ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
13182025-01-28T08:30:07.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 501.627503ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
13192025-01-28T08:30:07.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 887.084928ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
13202025-01-28T08:30:07.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 503.196319ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
13212025-01-28T08:30:07.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 907.43879ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
13222025-01-28T08:30:07.556ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13232025-01-28T08:30:07.556ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
13242025-01-28T08:30:07.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 985.072852ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
13252025-01-28T08:30:07.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 449.298363ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
13262025-01-28T08:30:07.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 544.717132ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
13272025-01-28T08:30:07.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 746.966675ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
13282025-01-28T08:30:07.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 1.143731683s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
13292025-01-28T08:30:07.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 65.997015ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
13302025-01-28T08:30:07.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 1.457132721s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
13312025-01-28T08:30:07.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 96.322447ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
13322025-01-28T08:30:07.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 1.495276079s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
13332025-01-28T08:30:07.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 1.251770216s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
13342025-01-28T08:30:08.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 165.802878ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
13352025-01-28T08:30:08.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 852.022054ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
13362025-01-28T08:30:08.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.350301065s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
13372025-01-28T08:30:08.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 752.975284ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
13382025-01-28T08:30:08.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 1.127644403s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
13392025-01-28T08:30:08.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 888.120535ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
13402025-01-28T08:30:08.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 407.764007ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
13412025-01-28T08:30:08.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 604.11542ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
13422025-01-28T08:30:08.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 989.670696ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
13432025-01-28T08:30:08.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 840.841534ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
13442025-01-28T08:30:08.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 999.215938ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
13452025-01-28T08:30:08.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 552.021485ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
13462025-01-28T08:30:08.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 674.020691ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
13472025-01-28T08:30:08.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 1.166268916s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
13482025-01-28T08:30:08.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 877.873998ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
13492025-01-28T08:30:08.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 691.011422ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
13502025-01-28T08:30:08.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 727.76729ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
13512025-01-28T08:30:08.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 1.01586642s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
13522025-01-28T08:30:08.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 905.260986ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
13532025-01-28T08:30:08.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 1.193313784s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
13542025-01-28T08:30:08.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 658.771315ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
13552025-01-28T08:30:09.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.419211346s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
13562025-01-28T08:30:09.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 522.588332ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
13572025-01-28T08:30:09.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 928.697613ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
13582025-01-28T08:30:09.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 548.089247ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
13592025-01-28T08:30:09.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 966.381866ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
13602025-01-28T08:30:09.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 1.087857622s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
13612025-01-28T08:30:09.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 903.808068ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
13622025-01-28T08:30:09.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 593.668044ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
13632025-01-28T08:30:09.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 610.711311ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
13642025-01-28T08:30:09.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 669.085604ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
13652025-01-28T08:30:09.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 1.326624558s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
13662025-01-28T08:30:09.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 1.283409475s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
13672025-01-28T08:30:09.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 1.1540946s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
13682025-01-28T08:30:09.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 567.549016ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
13692025-01-28T08:30:09.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 1.473518366s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
13702025-01-28T08:30:09.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 1.075988362s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
13712025-01-28T08:30:09.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 1.020533385s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
13722025-01-28T08:30:09.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 1.417424321s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
13732025-01-28T08:30:09.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 1.341293337s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
13742025-01-28T08:30:09.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 587.186327ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
13752025-01-28T08:30:09.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 752.158037ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
13762025-01-28T08:30:10.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 1.017146004s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
13772025-01-28T08:30:10.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.19023625s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
13782025-01-28T08:30:10.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 1.448923881s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
13792025-01-28T08:30:10.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 884.308731ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
13802025-01-28T08:30:10.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 1.374734885s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
13812025-01-28T08:30:10.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 1.165546821s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
13822025-01-28T08:30:10.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 1.456573228s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
13832025-01-28T08:30:10.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.206490207s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
13842025-01-28T08:30:10.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 1.098040588s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
13852025-01-28T08:30:10.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 714.256688ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
13862025-01-28T08:30:10.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 832.386589ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
13872025-01-28T08:30:10.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 624.723491ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
13882025-01-28T08:30:10.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 545.31437ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
13892025-01-28T08:30:10.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 1.418735962s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
13902025-01-28T08:30:10.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 836.104629ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
13912025-01-28T08:30:11.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 1.321408552s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
13922025-01-28T08:30:11.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 1.101262095s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
13932025-01-28T08:30:11.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 600.187177ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
13942025-01-28T08:30:11.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 1.061514178s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
13952025-01-28T08:30:11.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 1.159296379s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
13962025-01-28T08:30:11.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.178868959s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
13972025-01-28T08:30:11.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 1.232733376s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
13982025-01-28T08:30:11.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 1.067619049s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
13992025-01-28T08:30:11.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 679.756845ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
14002025-01-28T08:30:11.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 1.405403596s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
14012025-01-28T08:30:11.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 608.932514ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
14022025-01-28T08:30:11.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 1.296067114s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
14032025-01-28T08:30:11.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 1.12323869s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
14042025-01-28T08:30:11.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 551.66595ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
14052025-01-28T08:30:11.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.189920944s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
14062025-01-28T08:30:11.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 694.559283ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
14072025-01-28T08:30:11.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 670.826986ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
14082025-01-28T08:30:11.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 1.400618164s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
14092025-01-28T08:30:12.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 976.858265ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
14102025-01-28T08:30:12.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 1.158203258s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
14112025-01-28T08:30:12.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 640.212662ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
14122025-01-28T08:30:12.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 1.295040328s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
14132025-01-28T08:30:12.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 1.224402957s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
14142025-01-28T08:30:12.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 994.024039ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
14152025-01-28T08:30:12.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 546.82293ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
14162025-01-28T08:30:12.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 862.736181ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
14172025-01-28T08:30:12.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 586.220974ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
14182025-01-28T08:30:12.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 1.446121416s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
14192025-01-28T08:30:12.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.211222682s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
14202025-01-28T08:30:12.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 1.065171452s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
14212025-01-28T08:30:12.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 1.017667994s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
14222025-01-28T08:30:12.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 1.047769086s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
14232025-01-28T08:30:12.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 675.435833ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
14242025-01-28T08:30:12.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 708.919114ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
14252025-01-28T08:30:12.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.086120959s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
14262025-01-28T08:30:12.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 1.184913635s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
14272025-01-28T08:30:13.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 868.35975ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
14282025-01-28T08:30:13.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 718.908404ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
14292025-01-28T08:30:13.059ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14302025-01-28T08:30:13.059ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
14312025-01-28T08:30:13.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 546.317086ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
14322025-01-28T08:30:13.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 1.090165939s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
14332025-01-28T08:30:13.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 71.376803ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
14342025-01-28T08:30:13.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 571.239652ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
14352025-01-28T08:30:13.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 1.060040839s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
14362025-01-28T08:30:13.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 138.208425ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
14372025-01-28T08:30:13.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 876.719072ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
14382025-01-28T08:30:13.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 1.178739301s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
14392025-01-28T08:30:13.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 753.400752ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
14402025-01-28T08:30:13.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 107.776051ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
14412025-01-28T08:30:13.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 679.405751ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
14422025-01-28T08:30:13.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 504.601998ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
14432025-01-28T08:30:13.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 1.243271547s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
14442025-01-28T08:30:13.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 735.477747ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
14452025-01-28T08:30:13.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 221.442745ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
14462025-01-28T08:30:13.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 1.049412141s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
14472025-01-28T08:30:13.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.005431057s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
14482025-01-28T08:30:13.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 1.361916853s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
14492025-01-28T08:30:13.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 650.534661ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
14502025-01-28T08:30:13.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 870.74147ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
14512025-01-28T08:30:13.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 1.117053176s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
14522025-01-28T08:30:13.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 1.04353787s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
14532025-01-28T08:30:13.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 1.369171669s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
14542025-01-28T08:30:14.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.28486288s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
14552025-01-28T08:30:14.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 981.403601ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
14562025-01-28T08:30:14.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 1.212011233s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
14572025-01-28T08:30:14.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 814.646713ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
14582025-01-28T08:30:14.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 849.608796ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
14592025-01-28T08:30:14.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 783.581293ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
14602025-01-28T08:30:14.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 1.444514525s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
14612025-01-28T08:30:14.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 612.737254ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
14622025-01-28T08:30:14.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 1.209058145s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
14632025-01-28T08:30:14.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 864.073674ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
14642025-01-28T08:30:14.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 882.791366ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
14652025-01-28T08:30:14.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 1.317538051s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
14662025-01-28T08:30:14.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.367812467s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
14672025-01-28T08:30:14.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 1.329128294s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
14682025-01-28T08:30:14.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 521.740143ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
14692025-01-28T08:30:14.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 1.258249701s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
14702025-01-28T08:30:15.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 1.073995883s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
14712025-01-28T08:30:15.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 729.200905ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
14722025-01-28T08:30:15.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 1.347736095s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
14732025-01-28T08:30:15.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 1.157653009s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
14742025-01-28T08:30:15.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 1.108534747s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
14752025-01-28T08:30:15.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 730.62502ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
14762025-01-28T08:30:15.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 1.433251732s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
14772025-01-28T08:30:15.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.013763751s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
14782025-01-28T08:30:15.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 698.514004ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
14792025-01-28T08:30:15.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 1.067184079s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
14802025-01-28T08:30:15.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 1.297742658s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
14812025-01-28T08:30:15.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 1.152084569s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
14822025-01-28T08:30:15.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 896.507118ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
14832025-01-28T08:30:15.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 757.683919ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
14842025-01-28T08:30:15.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 909.956954ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
14852025-01-28T08:30:15.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 894.910708ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
14862025-01-28T08:30:15.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 1.478918898s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
14872025-01-28T08:30:16.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 830.778152ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
14882025-01-28T08:30:16.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 1.158098266s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
14892025-01-28T08:30:16.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 1.123287814s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
14902025-01-28T08:30:16.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 909.735999ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
14912025-01-28T08:30:16.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.443297392s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
14922025-01-28T08:30:16.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 1.380111729s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
14932025-01-28T08:30:16.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 552.548628ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
14942025-01-28T08:30:16.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 922.011679ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
14952025-01-28T08:30:16.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 738.285312ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
14962025-01-28T08:30:16.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 1.084349603s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
14972025-01-28T08:30:16.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 618.834862ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
14982025-01-28T08:30:16.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 1.394033054s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
14992025-01-28T08:30:16.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 650.914822ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
15002025-01-28T08:30:16.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 750.873984ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
15012025-01-28T08:30:16.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 517.294147ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
15022025-01-28T08:30:16.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 1.412428759s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
15032025-01-28T08:30:16.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 1.357308748s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
15042025-01-28T08:30:16.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 1.492841591s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
15052025-01-28T08:30:16.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 785.05945ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
15062025-01-28T08:30:16.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 1.278464289s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
15072025-01-28T08:30:17.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 1.051988799s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
15082025-01-28T08:30:17.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 1.308421741s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
15092025-01-28T08:30:17.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 591.584007ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
15102025-01-28T08:30:17.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 653.561901ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
15112025-01-28T08:30:17.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 607.332231ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
15122025-01-28T08:30:17.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 1.297170511s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
15132025-01-28T08:30:17.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 655.715915ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
15142025-01-28T08:30:17.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 694.879879ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
15152025-01-28T08:30:17.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 1.425506617s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
15162025-01-28T08:30:17.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 938.157635ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
15172025-01-28T08:30:17.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 905.001657ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
15182025-01-28T08:30:17.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 522.781635ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
15192025-01-28T08:30:17.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 859.613176ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
15202025-01-28T08:30:17.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 740.619324ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
15212025-01-28T08:30:17.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.035229972s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
15222025-01-28T08:30:17.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7") failed: Property not found. retry in 1.212048962s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
15232025-01-28T08:30:17.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 1.405088237s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
15242025-01-28T08:30:17.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 811.117916ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
15252025-01-28T08:30:17.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 672.942452ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
15262025-01-28T08:30:17.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1") failed: Property not found. retry in 1.300151926s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
15272025-01-28T08:30:18.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a") failed: Property not found. retry in 1.435384947s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
15282025-01-28T08:30:18.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4") failed: Property not found. retry in 1.081343009s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
15292025-01-28T08:30:18.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 1.434128911s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
15302025-01-28T08:30:18.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d") failed: Property not found. retry in 1.107591922s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
15312025-01-28T08:30:18.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 618.354847ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
15322025-01-28T08:30:18.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab") failed: Property not found. retry in 917.893723ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
15332025-01-28T08:30:18.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 535.195224ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
15342025-01-28T08:30:18.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321") failed: Property not found. retry in 969.895978ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
15352025-01-28T08:30:18.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f") failed: Property not found. retry in 1.098117979s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
15362025-01-28T08:30:18.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 1.014567248s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
15372025-01-28T08:30:18.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 526.077905ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
15382025-01-28T08:30:18.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8") failed: Property not found. retry in 1.142109761s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
15392025-01-28T08:30:18.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 546.397257ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
15402025-01-28T08:30:18.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180") failed: Property not found. retry in 1.3443365s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
15412025-01-28T08:30:18.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.48080951s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
15422025-01-28T08:30:18.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97") failed: Property not found. retry in 1.167676085s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
15432025-01-28T08:30:18.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758") failed: Property not found. retry in 538.533139ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
15442025-01-28T08:30:18.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364") failed: Property not found. retry in 966.975757ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
15452025-01-28T08:30:19.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 1.134956783s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
15462025-01-28T08:30:19.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 957.062396ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
15472025-01-28T08:30:19.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7") failed: Property not found. retry in 1.052569335s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
15482025-01-28T08:30:19.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b") failed: Property not found. retry in 728.535104ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
15492025-01-28T08:30:19.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 525.421869ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
15502025-01-28T08:30:20.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 790.687731ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
15512025-01-28T08:30:20.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 787.191709ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
15522025-01-28T08:30:20.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 1.082570891s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
15532025-01-28T08:30:20.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.481276966s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
15542025-01-28T08:30:20.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 866.192837ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
15552025-01-28T08:30:20.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 1.331603208s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
15562025-01-28T08:30:21.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 1.231648148s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
15572025-01-28T08:30:21.371ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44061
15582025-01-28T08:30:21.378ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2552 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44061 req_id = 85a3e5cc-320c-489a-86ec-cb5303c742ed response_code = 200 uri = /baseboard
15592025-01-28T08:30:21.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 702.908251ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
15602025-01-28T08:30:21.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 683.353002ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
15612025-01-28T08:30:22.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8") failed: Property not found. retry in 1.038057604s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
15622025-01-28T08:30:22.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.00319856s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
15632025-01-28T08:30:22.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb") failed: Property not found. retry in 1.491201598s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
15642025-01-28T08:30:22.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 1.159102251s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
15652025-01-28T08:30:22.774ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.059475213s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
15662025-01-28T08:30:23.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671") failed: Property not found. retry in 1.045408116s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
15672025-01-28T08:30:23.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921") failed: Property not found. retry in 1.03701645s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
15682025-01-28T08:30:23.869ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.162383797s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
15692025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_ae85e581-d12f-4dde-b2b1-4517db9bc4b1
15702025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_6dd3b16a-15d8-4d3c-bb04-506e7ba24671
15712025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_66bdc885-da83-475d-946e-40e9d872fb4d
15722025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_c0b76181-3caf-4143-9524-623c025e89cb
15732025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_ac11a41c-0c8c-4577-bc61-190e35fed90a
15742025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_e07f14ae-c2ce-4e8f-8686-9c2b0d58a7b7
15752025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_fdd13a8e-766e-4016-86fd-61b5027e0364
15762025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_0c766554-1775-42c8-a58a-b13904a6537f
15772025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_5b00a6ac-8f4d-4247-8546-4d4743dcb0a8
15782025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_d4cfb1d6-0158-4c14-a90b-30c7e3c3d7ab
15792025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_8494b7da-0eea-4abf-9d60-231d86c53321
15802025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_9d78f8d8-4e43-4755-9de5-bc92c8908921
15812025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7
15822025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_fc433a3b-1915-4c16-b9e5-81466b17a758
15832025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_4a763fb6-cc99-4aa3-b40d-f91d0afd644b
15842025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_ad94633e-6dff-46d5-8258-193c3076b0c4
15852025-01-28T08:30:24.782ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_15e1fb31-e066-4a05-b614-a5444b057180
15862025-01-28T08:30:24.783ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_0af64d89-e6c1-46cf-9c83-d6b314ebd0e8
15872025-01-28T08:30:24.783ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_35a1a767-5b43-4e9b-ae6b-9020e8bd5e97
15882025-01-28T08:30:24.784ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15892025-01-28T08:30:24.789ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15902025-01-28T08:30:24.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33570784 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36227 req_id = 363b0bd4-8348-48fe-8951-eb4d260a17dd response_code = 204 uri = /omicron-zones
15912025-01-28T08:30:24.803ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1406
15922025-01-28T08:30:24.813ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
15932025-01-28T08:30:24.817ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
15942025-01-28T08:30:24.853ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1008
15952025-01-28T08:30:24.858ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15962025-01-28T08:30:24.992ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15972025-01-28T08:30:25.167ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15982025-01-28T08:30:25.269ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
15992025-01-28T08:30:25.448ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16002025-01-28T08:30:25.574ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16012025-01-28T08:30:25.930ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16022025-01-28T08:30:26.225ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16032025-01-28T08:30:26.474ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16042025-01-28T08:30:27.027ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16052025-01-28T08:30:27.067ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.051656926s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
16062025-01-28T08:30:27.559ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/686fddce-963a-445f-bb4e-5946a3c29a76/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16072025-01-28T08:30:28.488ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "4ad88e29-d20d-427a-ab88-a55434a78618", "content-length": "113", "date": "Tue, 28 Jan 2025 08:30:28 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "4ad88e29-d20d-427a-ab88-a55434a78618" } file = sled-agent/src/rack_setup/service.rs:1070
16082025-01-28T08:30:29.616ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e91fc1ea-85f7-4eef-a080-f0c676860458", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"686fddce-963a-445f-bb4e-5946a3c29a76\"", request_id: "e91fc1ea-85f7-4eef-a080-f0c676860458" } file = sled-agent/src/rack_setup/service.rs:1070
16092025-01-28T08:30:30.481ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a59b7b5e-630f-494b-849d-d8a1ca612382", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"686fddce-963a-445f-bb4e-5946a3c29a76\"", request_id: "a59b7b5e-630f-494b-849d-d8a1ca612382" } file = sled-agent/src/rack_setup/service.rs:1070
16102025-01-28T08:30:32.427ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "60da04de-d612-4d34-82a8-491e201bea54", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:32 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"09b4ce33-23b9-42cf-84fa-bef739079982\"", request_id: "60da04de-d612-4d34-82a8-491e201bea54" } file = sled-agent/src/rack_setup/service.rs:1070
16112025-01-28T08:30:33.668ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3e5d700f-f154-4e79-abda-53e739336fb9", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"09b4ce33-23b9-42cf-84fa-bef739079982\"", request_id: "3e5d700f-f154-4e79-abda-53e739336fb9" } file = sled-agent/src/rack_setup/service.rs:1070
16122025-01-28T08:30:35.702ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "07a3ed06-9478-419a-be05-a3d523e4a0d1", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"09b4ce33-23b9-42cf-84fa-bef739079982\"", request_id: "07a3ed06-9478-419a-be05-a3d523e4a0d1" } file = sled-agent/src/rack_setup/service.rs:1070
16132025-01-28T08:30:37.525ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "45218b69-9070-4beb-8ab8-430ad1d34e43", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"09b4ce33-23b9-42cf-84fa-bef739079982\"", request_id: "45218b69-9070-4beb-8ab8-430ad1d34e43" } file = sled-agent/src/rack_setup/service.rs:1070
16142025-01-28T08:30:39.386ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d399d4e1-62f9-42ae-a57d-d12bfdd893ce", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"09b4ce33-23b9-42cf-84fa-bef739079982\"", request_id: "d399d4e1-62f9-42ae-a57d-d12bfdd893ce" } file = sled-agent/src/rack_setup/service.rs:1070
16152025-01-28T08:30:41.801ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6f31a55a-6ec9-497c-a42a-65481e8cf8a4", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"09b4ce33-23b9-42cf-84fa-bef739079982\"", request_id: "6f31a55a-6ec9-497c-a42a-65481e8cf8a4" } file = sled-agent/src/rack_setup/service.rs:1070
16162025-01-28T08:30:46.112ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "26f98a9c-6102-4543-934e-917793af4256", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"09b4ce33-23b9-42cf-84fa-bef739079982\"", request_id: "26f98a9c-6102-4543-934e-917793af4256" } file = sled-agent/src/rack_setup/service.rs:1070
16172025-01-28T08:30:51.414ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48188
16182025-01-28T08:30:51.414ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48188 req_id = 587e5000-fe60-4346-86bf-e6249d6a1226 response_code = 200 uri = /baseboard
16192025-01-28T08:30:51.993ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b7f5cad9-632e-4afd-8fbb-94d7c36afec5", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"09b4ce33-23b9-42cf-84fa-bef739079982\"", request_id: "b7f5cad9-632e-4afd-8fbb-94d7c36afec5" } file = sled-agent/src/rack_setup/service.rs:1070
16202025-01-28T08:30:55.443ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d33e4640-19e0-4b69-99bc-73e423222353", "content-length": "173", "date": "Tue, 28 Jan 2025 08:30:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"09b4ce33-23b9-42cf-84fa-bef739079982\"", request_id: "d33e4640-19e0-4b69-99bc-73e423222353" } file = sled-agent/src/rack_setup/service.rs:1070
16212025-01-28T08:31:00.355ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9b100796-6220-4ca6-93f4-4662abbf26dc", "content-length": "173", "date": "Tue, 28 Jan 2025 08:31:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"09b4ce33-23b9-42cf-84fa-bef739079982\"", request_id: "9b100796-6220-4ca6-93f4-4662abbf26dc" } file = sled-agent/src/rack_setup/service.rs:1070
16222025-01-28T08:31:04.387ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
16232025-01-28T08:31:04.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50130
16242025-01-28T08:31:04.478ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16252025-01-28T08:31:04.479ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16262025-01-28T08:31:04.479ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-zones.json file = common/src/ledger.rs:177
16272025-01-28T08:31:04.483ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-zones.json file = common/src/ledger.rs:177
16282025-01-28T08:31:04.496ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16292025-01-28T08:31:04.496ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1eaf2938-a2ac-484f-832d-16d88783efae
16302025-01-28T08:31:04.519ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16312025-01-28T08:31:04.519ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9
16322025-01-28T08:31:04.542ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16332025-01-28T08:31:04.542ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6
16342025-01-28T08:31:04.562ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16352025-01-28T08:31:04.562ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_352e06d5-ecf0-4843-af74-5fa99efbd226
16362025-01-28T08:31:04.583ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16372025-01-28T08:31:04.583ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e
16382025-01-28T08:31:04.601ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16392025-01-28T08:31:04.601ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a5440209-1de6-4cf7-8077-0c0703036684
16402025-01-28T08:31:04.623ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16412025-01-28T08:31:04.623ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50
16422025-01-28T08:31:04.641ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16432025-01-28T08:31:04.641ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4
16442025-01-28T08:31:04.661ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16452025-01-28T08:31:04.661ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53
16462025-01-28T08:31:04.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 197010 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50130 req_id = 242f35ab-eeb9-4b68-b8dc-405868d8a557 response_code = 200 uri = /inventory
16472025-01-28T08:31:08.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39041
16482025-01-28T08:31:08.147ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16492025-01-28T08:31:08.147ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16502025-01-28T08:31:08.147ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16512025-01-28T08:31:08.147ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16522025-01-28T08:31:08.147ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16532025-01-28T08:31:08.147ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16542025-01-28T08:31:08.147ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16552025-01-28T08:31:08.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39041 req_id = 00329e71-7866-4d67-8655-c37152a20a23 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16562025-01-28T08:31:08.148ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1080
16572025-01-28T08:31:08.152ZINFOSledAgent (RSS): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16582025-01-28T08:31:08.152ZINFOSledAgent (RSS): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16592025-01-28T08:31:08.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48928
16602025-01-28T08:31:08.452ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16612025-01-28T08:31:08.452ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16622025-01-28T08:31:08.452ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-zones.json file = common/src/ledger.rs:177
16632025-01-28T08:31:08.454ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-zones.json file = common/src/ledger.rs:177
16642025-01-28T08:31:08.467ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16652025-01-28T08:31:08.467ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1eaf2938-a2ac-484f-832d-16d88783efae
16662025-01-28T08:31:08.491ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16672025-01-28T08:31:08.491ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9
16682025-01-28T08:31:08.514ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16692025-01-28T08:31:08.514ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6
16702025-01-28T08:31:08.539ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16712025-01-28T08:31:08.539ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_352e06d5-ecf0-4843-af74-5fa99efbd226
16722025-01-28T08:31:08.561ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16732025-01-28T08:31:08.561ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e
16742025-01-28T08:31:08.581ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16752025-01-28T08:31:08.581ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a5440209-1de6-4cf7-8077-0c0703036684
16762025-01-28T08:31:08.603ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16772025-01-28T08:31:08.603ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50
16782025-01-28T08:31:08.624ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16792025-01-28T08:31:08.624ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4
16802025-01-28T08:31:08.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64929
16812025-01-28T08:31:08.642ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16822025-01-28T08:31:08.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16832025-01-28T08:31:08.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16842025-01-28T08:31:08.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16852025-01-28T08:31:08.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16862025-01-28T08:31:08.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16872025-01-28T08:31:08.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16882025-01-28T08:31:08.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 506 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64929 req_id = 07b269a3-c93b-426c-97ca-3560d4a1442f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16892025-01-28T08:31:08.643ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16902025-01-28T08:31:08.643ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53
16912025-01-28T08:31:08.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203990 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48928 req_id = f6d8a0c6-5867-419f-b0e4-f07437664a6e response_code = 200 uri = /inventory
16922025-01-28T08:31:09.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41659
16932025-01-28T08:31:09.390ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16942025-01-28T08:31:09.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16952025-01-28T08:31:09.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16962025-01-28T08:31:09.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16972025-01-28T08:31:09.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16982025-01-28T08:31:09.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16992025-01-28T08:31:09.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17002025-01-28T08:31:09.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41659 req_id = 9fac53f7-651f-453e-af75-0168eed53719 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17012025-01-28T08:31:09.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50178
17022025-01-28T08:31:09.418ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17032025-01-28T08:31:09.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17042025-01-28T08:31:09.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17052025-01-28T08:31:09.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17062025-01-28T08:31:09.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17072025-01-28T08:31:09.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17082025-01-28T08:31:09.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17092025-01-28T08:31:09.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50178 req_id = 7396e103-cf8a-4574-9985-29c090acc31b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17102025-01-28T08:31:13.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51145
17112025-01-28T08:31:13.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 725 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51145 req_id = 17120b87-192c-4790-8b88-01648235a612 response_code = 200 uri = /vpc-routes
17122025-01-28T08:31:13.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
17132025-01-28T08:31:13.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1589 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51145 req_id = 93012c53-ed7b-4cbb-9dfb-f1d6010075e5 response_code = 204 uri = /eip-gateways
17142025-01-28T08:31:13.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51145 req_id = c4990330-cd74-4be3-ab97-ecdabaea94a8 response_code = 204 uri = /vpc-routes
17152025-01-28T08:31:18.160ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:51492 remote_addr = [fd00:1122:3344:101::d]:64358 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
17162025-01-28T08:31:18.188ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27178 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 4b5c6d35-3508-4fb5-b9c7-10e71600fce5 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
17172025-01-28T08:31:21.450ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38011
17182025-01-28T08:31:21.450ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38011 req_id = d8d33ea5-5964-4e97-857b-649e4eb68911 response_code = 200 uri = /baseboard
17192025-01-28T08:31:31.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44538
17202025-01-28T08:31:31.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44538 req_id = f57202da-1ece-4c7a-9dcb-1a6a212e62d3 response_code = 200 uri = /vpc-routes
17212025-01-28T08:31:31.126ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
17222025-01-28T08:31:31.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44538 req_id = 474fcd7e-2476-4a25-8aeb-0a7e96c864d1 response_code = 204 uri = /eip-gateways
17232025-01-28T08:31:31.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44538 req_id = 404c5d1b-e8b8-41e9-91d3-fb7a81b9cf5c response_code = 204 uri = /vpc-routes
17242025-01-28T08:31:31.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51318
17252025-01-28T08:31:31.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51318 req_id = b8c8c51b-b214-4e6a-a168-cf03e38d6d05 response_code = 200 uri = /v2p
17262025-01-28T08:31:31.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64237
17272025-01-28T08:31:31.542ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17282025-01-28T08:31:31.636ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17292025-01-28T08:31:31.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164112 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64237 req_id = e5dfde2c-bf00-4d63-a32d-bf4568cd6781 response_code = 204 uri = /switch-ports
17302025-01-28T08:31:31.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46376
17312025-01-28T08:31:31.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46376 req_id = 490851f5-1023-4e97-93d9-5d497c66d7a0 response_code = 200 uri = /vpc-routes
17322025-01-28T08:31:31.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64237 req_id = 0acc790d-0dc7-4eba-becc-1bf0ad34a6bb response_code = 200 uri = /network-bootstore-config
17332025-01-28T08:31:31.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50935
17342025-01-28T08:31:31.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50935 req_id = 7e4b0238-18a6-4537-a151-818332d38edc response_code = 200 uri = /v2p
17352025-01-28T08:31:31.747ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17362025-01-28T08:31:31.747ZINFOSledAgent (bootstore): Writing ledger to /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17372025-01-28T08:31:31.748ZINFOSledAgent (bootstore): Writing ledger to /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17382025-01-28T08:31:31.749ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17392025-01-28T08:31:31.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64237 req_id = d9048e02-c526-4bb4-bd84-d747e136378a response_code = 204 uri = /network-bootstore-config
17402025-01-28T08:31:31.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34566
17412025-01-28T08:31:31.751ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17422025-01-28T08:31:31.795ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17432025-01-28T08:31:31.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34566 req_id = 7914b177-9589-4fdf-838c-ff0f5722ffcd response_code = 204 uri = /switch-ports
17442025-01-28T08:31:31.852ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
17452025-01-28T08:31:31.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46376 req_id = 476efe4e-09e0-4362-953b-ea1a53e0e56d response_code = 204 uri = /eip-gateways
17462025-01-28T08:31:31.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34566 req_id = 7af3bfd2-2c8a-45b5-8b5c-c8a81f1cda26 response_code = 200 uri = /network-bootstore-config
17472025-01-28T08:31:31.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46376 req_id = 7ce796bc-402e-4d23-8c82-9c394b25d834 response_code = 204 uri = /vpc-routes
17482025-01-28T08:31:32.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36556
17492025-01-28T08:31:32.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36556 req_id = f309629a-d9ca-476a-86ed-29ba3dcbd03a response_code = 200 uri = /vpc-routes
17502025-01-28T08:31:32.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46087
17512025-01-28T08:31:32.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46087 req_id = 60e0f7dc-6c7e-4347-b1d0-ceaf6da8f4a3 response_code = 200 uri = /v2p
17522025-01-28T08:31:32.318ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
17532025-01-28T08:31:32.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36556 req_id = 1ac64fe4-5b6d-451f-8db0-bfe08f9ccbf3 response_code = 204 uri = /eip-gateways
17542025-01-28T08:31:32.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36556 req_id = bde24875-21f2-4993-aa40-3880a6915dd0 response_code = 204 uri = /vpc-routes
17552025-01-28T08:31:32.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63345
17562025-01-28T08:31:32.723ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17572025-01-28T08:31:32.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17582025-01-28T08:31:32.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96740 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63345 req_id = 775cfd2d-38ec-4836-9246-482e3baf44e4 response_code = 204 uri = /switch-ports
17592025-01-28T08:31:32.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63345 req_id = 554fc146-3326-4b52-b09c-fa069a3a15dc response_code = 200 uri = /network-bootstore-config
17602025-01-28T08:31:48.167ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8032 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = e22f9bd7-3785-46d8-a662-e10cb4facc04 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
17612025-01-28T08:31:51.484ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37966
17622025-01-28T08:31:51.485ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37966 req_id = 9c713e98-5768-4ce9-81d4-ab729951b6db response_code = 200 uri = /baseboard
17632025-01-28T08:32:01.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35748
17642025-01-28T08:32:01.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35748 req_id = 4c5a73d0-d5d8-468f-ac9d-25fdb2ba0933 response_code = 200 uri = /vpc-routes
17652025-01-28T08:32:01.066ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
17662025-01-28T08:32:01.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35748 req_id = 7a58d074-8eee-43b9-b05d-5aaa3ba4d8ce response_code = 204 uri = /eip-gateways
17672025-01-28T08:32:01.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35748 req_id = 132aa5b8-877e-400d-b7bf-53cd67e60068 response_code = 204 uri = /vpc-routes
17682025-01-28T08:32:01.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37711
17692025-01-28T08:32:01.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37711 req_id = aeb4dfc6-a2e7-46b3-a392-946264db0c06 response_code = 200 uri = /v2p
17702025-01-28T08:32:01.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52995
17712025-01-28T08:32:01.265ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17722025-01-28T08:32:01.303ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17732025-01-28T08:32:01.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100118 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52995 req_id = a120c3ec-b159-45ad-ae2f-7e3b1b7a26e8 response_code = 204 uri = /switch-ports
17742025-01-28T08:32:01.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52995 req_id = 82d5c535-6e98-4970-a73e-66aa084d31ee response_code = 200 uri = /network-bootstore-config
17752025-01-28T08:32:01.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47222
17762025-01-28T08:32:01.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47222 req_id = 801f2560-cfed-4d04-8992-6041a31e3802 response_code = 200 uri = /vpc-routes
17772025-01-28T08:32:01.447ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
17782025-01-28T08:32:01.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47222 req_id = 0711ac2b-e4f9-4f82-8c09-b466c2113383 response_code = 204 uri = /eip-gateways
17792025-01-28T08:32:01.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47222 req_id = bdc03d48-2b65-4402-aca1-2f928279c298 response_code = 204 uri = /vpc-routes
17802025-01-28T08:32:01.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64280
17812025-01-28T08:32:01.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64280 req_id = 6229c0e3-af49-4f0c-a8a3-dfb8e7de4e1d response_code = 200 uri = /v2p
17822025-01-28T08:32:01.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39043
17832025-01-28T08:32:01.510ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17842025-01-28T08:32:01.546ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17852025-01-28T08:32:01.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87752 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39043 req_id = 2e91cd52-f14b-4d98-9f19-f1d9e8528177 response_code = 204 uri = /switch-ports
17862025-01-28T08:32:01.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39043 req_id = e82703f5-384f-4732-bc77-4e6b6b532752 response_code = 200 uri = /network-bootstore-config
17872025-01-28T08:32:02.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44281
17882025-01-28T08:32:02.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44281 req_id = cded2963-cd12-4be3-8579-4507d001c298 response_code = 200 uri = /vpc-routes
17892025-01-28T08:32:02.098ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
17902025-01-28T08:32:02.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44281 req_id = 91a5fc22-d85f-4302-bee2-71ac96ce4931 response_code = 204 uri = /eip-gateways
17912025-01-28T08:32:02.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44281 req_id = d6b2e342-dbdb-4351-891b-6808be1f9124 response_code = 204 uri = /vpc-routes
17922025-01-28T08:32:02.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58695
17932025-01-28T08:32:02.118ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17942025-01-28T08:32:02.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17952025-01-28T08:32:02.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92189 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58695 req_id = d8eea1e7-227d-4190-908f-18bf71132edd response_code = 204 uri = /switch-ports
17962025-01-28T08:32:02.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58695 req_id = a168a6ad-683c-40b9-9465-ae1436dce55a response_code = 200 uri = /network-bootstore-config
17972025-01-28T08:32:02.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38322
17982025-01-28T08:32:02.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38322 req_id = ed87079c-4175-4d5e-b0db-eb1a23acaf75 response_code = 200 uri = /v2p
17992025-01-28T08:32:18.167ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7493 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = e864e9a6-dcc8-4505-a115-b93a8fa191f9 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
18002025-01-28T08:32:21.518ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58530
18012025-01-28T08:32:21.518ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58530 req_id = 1c10ca2e-e5ea-4489-9d9d-5cf1aba4312a response_code = 200 uri = /baseboard
18022025-01-28T08:32:31.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46546
18032025-01-28T08:32:31.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46546 req_id = 5676f988-87b4-4a8c-affc-8af967273f66 response_code = 200 uri = /v2p
18042025-01-28T08:32:31.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52889
18052025-01-28T08:32:31.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52889 req_id = 3ac5663a-cf78-4bb5-84bc-e3cd7cfa4c18 response_code = 200 uri = /vpc-routes
18062025-01-28T08:32:31.245ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
18072025-01-28T08:32:31.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52889 req_id = e85ade4d-9410-479b-8d20-bcb809c26af5 response_code = 204 uri = /eip-gateways
18082025-01-28T08:32:31.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52889 req_id = abf6fdeb-5d44-4bfb-9cf7-9b3d5f7c5bcb response_code = 204 uri = /vpc-routes
18092025-01-28T08:32:31.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44721
18102025-01-28T08:32:31.466ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18112025-01-28T08:32:31.502ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18122025-01-28T08:32:31.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111328 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44721 req_id = 6e5a74cd-2ac4-4db2-9995-f12c0a491edd response_code = 204 uri = /switch-ports
18132025-01-28T08:32:31.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45755
18142025-01-28T08:32:31.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44721 req_id = 52848b69-e353-46b5-a12c-f1abf3278a27 response_code = 200 uri = /network-bootstore-config
18152025-01-28T08:32:31.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45755 req_id = 6e11791f-20b2-4acf-9a3c-e57d6ce5f5fc response_code = 200 uri = /vpc-routes
18162025-01-28T08:32:31.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
18172025-01-28T08:32:31.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45755 req_id = 6349dc1a-b8ca-402a-9b7c-d70efe335352 response_code = 204 uri = /eip-gateways
18182025-01-28T08:32:31.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55947
18192025-01-28T08:32:31.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55947 req_id = 411d8c81-b94c-4edd-a3c3-6360e3a8347a response_code = 200 uri = /v2p
18202025-01-28T08:32:31.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45755 req_id = 43bd61a4-ba5f-4d5c-9c14-606b249cf238 response_code = 204 uri = /vpc-routes
18212025-01-28T08:32:31.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56322
18222025-01-28T08:32:31.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18232025-01-28T08:32:31.785ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18242025-01-28T08:32:31.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98752 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56322 req_id = 65c58617-7a13-4256-965d-dc4ad0931106 response_code = 204 uri = /switch-ports
18252025-01-28T08:32:31.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56322 req_id = 67975d15-9d58-44dc-987b-23edea2a252e response_code = 200 uri = /network-bootstore-config
18262025-01-28T08:32:32.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45984
18272025-01-28T08:32:32.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45984 req_id = 09c5f01d-5f6f-4efb-8f5a-2a2a51de08f2 response_code = 200 uri = /vpc-routes
18282025-01-28T08:32:32.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
18292025-01-28T08:32:32.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45984 req_id = c7b2eb1e-9c49-4450-9e92-96c83471cd5f response_code = 204 uri = /eip-gateways
18302025-01-28T08:32:32.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45984 req_id = 0633b083-b253-4694-96b7-33d94116d4c5 response_code = 204 uri = /vpc-routes
18312025-01-28T08:32:32.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38166
18322025-01-28T08:32:32.300ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18332025-01-28T08:32:32.344ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18342025-01-28T08:32:32.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104499 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38166 req_id = 44580385-a426-4337-bd2f-cec7206952eb response_code = 204 uri = /switch-ports
18352025-01-28T08:32:32.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33554
18362025-01-28T08:32:32.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38166 req_id = fef33f8a-c7ae-475f-9969-4e2755e88c0c response_code = 200 uri = /network-bootstore-config
18372025-01-28T08:32:32.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33554 req_id = 38cb0159-6f27-4de5-a34d-eab3c57d561c response_code = 200 uri = /v2p
18382025-01-28T08:32:48.167ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7599 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = b9ed842c-2c29-49ca-b0d4-954333acbd62 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
18392025-01-28T08:32:51.551ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48457
18402025-01-28T08:32:51.551ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48457 req_id = e2a8d65d-7895-4bc1-a4d3-759d9124073c response_code = 200 uri = /baseboard
18412025-01-28T08:33:00.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57378
18422025-01-28T08:33:00.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57378 req_id = 42ebd9c1-b617-4d26-9312-fb232db58a1a response_code = 200 uri = /vpc-routes
18432025-01-28T08:33:01.009ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
18442025-01-28T08:33:01.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57378 req_id = 01748b9b-78d9-42e1-9fb3-67ba5c65c15f response_code = 204 uri = /eip-gateways
18452025-01-28T08:33:01.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57378 req_id = b807b9b4-a897-4785-b22e-575e5e03ab69 response_code = 204 uri = /vpc-routes
18462025-01-28T08:33:01.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61073
18472025-01-28T08:33:01.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61073 req_id = eda5f16a-3598-444d-abe8-ea1b9d731bb7 response_code = 200 uri = /v2p
18482025-01-28T08:33:01.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60699
18492025-01-28T08:33:01.183ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18502025-01-28T08:33:01.227ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18512025-01-28T08:33:01.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114078 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60699 req_id = 84af6dd7-0e8c-468a-b4f4-f263c5a584e6 response_code = 204 uri = /switch-ports
18522025-01-28T08:33:01.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60699 req_id = dd723b3c-dca0-45b2-a8ba-d19593b99ccc response_code = 200 uri = /network-bootstore-config
18532025-01-28T08:33:01.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59103
18542025-01-28T08:33:01.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59103 req_id = 9463f17c-69d4-4572-8a4a-0f470bd8fb2b response_code = 200 uri = /vpc-routes
18552025-01-28T08:33:01.433ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
18562025-01-28T08:33:01.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59103 req_id = 951c1334-e5af-4afb-9925-85c5e868da5c response_code = 204 uri = /eip-gateways
18572025-01-28T08:33:01.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59103 req_id = c4b66bd1-48de-4097-a2c0-af85f0417f4f response_code = 204 uri = /vpc-routes
18582025-01-28T08:33:01.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43289
18592025-01-28T08:33:01.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43289 req_id = 6f8f7e41-b022-4fb7-bc08-c27d6c58164b response_code = 200 uri = /v2p
18602025-01-28T08:33:01.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33039
18612025-01-28T08:33:01.579ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18622025-01-28T08:33:01.616ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18632025-01-28T08:33:01.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90233 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33039 req_id = 04fc710b-e784-4db2-8b89-3ecdab32f3a7 response_code = 204 uri = /switch-ports
18642025-01-28T08:33:01.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33039 req_id = 4a9b7c8f-6a63-464e-8447-9ff27a851cf0 response_code = 200 uri = /network-bootstore-config
18652025-01-28T08:33:02.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57186
18662025-01-28T08:33:02.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57186 req_id = f3cb10ee-de1e-4f02-aa55-ae8147a95b9e response_code = 200 uri = /vpc-routes
18672025-01-28T08:33:02.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
18682025-01-28T08:33:02.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57186 req_id = 58332881-7b44-4ade-8fa3-50e0fb040e26 response_code = 204 uri = /eip-gateways
18692025-01-28T08:33:02.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47410
18702025-01-28T08:33:02.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47410 req_id = d1e36ea7-efcc-48d5-ace0-dd7f9f32c943 response_code = 200 uri = /v2p
18712025-01-28T08:33:02.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47590
18722025-01-28T08:33:02.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18732025-01-28T08:33:02.228ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18742025-01-28T08:33:02.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90744 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47590 req_id = 2c36eb49-1e52-4925-84a8-00a8c34ea3df response_code = 204 uri = /switch-ports
18752025-01-28T08:33:02.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57186 req_id = 69e2c980-bb9e-4f3b-8dbe-5b7d962b5d94 response_code = 204 uri = /vpc-routes
18762025-01-28T08:33:02.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47590 req_id = 05c6afb3-f939-4759-a38e-543a00f53520 response_code = 200 uri = /network-bootstore-config
18772025-01-28T08:33:18.167ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7497 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 638f116e-eb61-4da7-a755-4b3932b434c4 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
18782025-01-28T08:33:21.584ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35756
18792025-01-28T08:33:21.584ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35756 req_id = 8b9db5ec-48b7-41bb-b943-19d6f08453b9 response_code = 200 uri = /baseboard
18802025-01-28T08:33:31.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45897
18812025-01-28T08:33:31.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45897 req_id = 3083713e-0a1d-401c-9857-c884a6993d20 response_code = 200 uri = /vpc-routes
18822025-01-28T08:33:31.327ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
18832025-01-28T08:33:31.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45897 req_id = 1ee6156e-3f5e-469b-b246-71d757c21a14 response_code = 204 uri = /eip-gateways
18842025-01-28T08:33:31.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55213
18852025-01-28T08:33:31.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55213 req_id = 80d7253e-63c2-4258-b92c-79363cad4bb0 response_code = 200 uri = /v2p
18862025-01-28T08:33:31.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45897 req_id = de2c0ef4-c611-45db-a38b-a64bafd63cfb response_code = 204 uri = /vpc-routes
18872025-01-28T08:33:31.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63315
18882025-01-28T08:33:31.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63315 req_id = 1c2ae0d3-ef08-40a4-94bb-7750c4a3a5b1 response_code = 200 uri = /vpc-routes
18892025-01-28T08:33:31.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62477
18902025-01-28T08:33:31.510ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18912025-01-28T08:33:31.554ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18922025-01-28T08:33:31.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98650 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62477 req_id = e8d39dcf-e1bc-4279-83e1-830527acbe70 response_code = 204 uri = /switch-ports
18932025-01-28T08:33:31.609ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
18942025-01-28T08:33:31.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62477 req_id = 1ce5f990-e0c9-470c-b5a3-4669aaeb91c6 response_code = 200 uri = /network-bootstore-config
18952025-01-28T08:33:31.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63315 req_id = 7930833e-2376-4c74-816d-f291a145b890 response_code = 204 uri = /eip-gateways
18962025-01-28T08:33:31.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32795
18972025-01-28T08:33:31.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32795 req_id = af0700bd-993b-4ebd-9896-86d2c001fffa response_code = 200 uri = /v2p
18982025-01-28T08:33:31.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63315 req_id = c1087b49-d4aa-4731-b0cb-f04d1c07f2df response_code = 204 uri = /vpc-routes
18992025-01-28T08:33:31.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55241
19002025-01-28T08:33:31.827ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19012025-01-28T08:33:31.879ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19022025-01-28T08:33:31.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129615 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55241 req_id = f09e125b-0985-45e4-a026-3d1584180a43 response_code = 204 uri = /switch-ports
19032025-01-28T08:33:31.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55241 req_id = 45694980-bd31-48db-ad1e-91d8dac709ea response_code = 200 uri = /network-bootstore-config
19042025-01-28T08:33:32.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35149
19052025-01-28T08:33:32.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35149 req_id = 8c432ab8-9daa-4737-98b1-83811f6d2a2d response_code = 200 uri = /vpc-routes
19062025-01-28T08:33:32.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39064
19072025-01-28T08:33:32.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39064 req_id = 0b1d8e76-825e-4a28-afb0-eb654cbdf151 response_code = 200 uri = /v2p
19082025-01-28T08:33:32.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
19092025-01-28T08:33:32.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35149 req_id = 415a003a-7bbe-4d16-aea4-8d93465ed0c2 response_code = 204 uri = /eip-gateways
19102025-01-28T08:33:32.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64743
19112025-01-28T08:33:32.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19122025-01-28T08:33:32.417ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19132025-01-28T08:33:32.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86758 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64743 req_id = f9098411-08b2-44e8-a113-800ced3fc102 response_code = 204 uri = /switch-ports
19142025-01-28T08:33:32.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35149 req_id = 7f9e6787-6bf2-49fa-bddb-4c0855f4396e response_code = 204 uri = /vpc-routes
19152025-01-28T08:33:32.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64743 req_id = 57c45da1-3ba8-46aa-b68e-953928ece774 response_code = 200 uri = /network-bootstore-config
19162025-01-28T08:33:33.779ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19172025-01-28T08:33:48.167ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8069 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = db43f437-5394-412b-929e-05d177f6e500 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
19182025-01-28T08:33:51.617ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49709
19192025-01-28T08:33:51.617ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49709 req_id = 573d987a-9de4-4ab1-b77c-05d6d439073b response_code = 200 uri = /baseboard
19202025-01-28T08:34:01.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64595
19212025-01-28T08:34:01.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64595 req_id = 4950365f-ab7b-41c9-8a0c-ffeb9ab0ec3a response_code = 200 uri = /vpc-routes
19222025-01-28T08:34:01.063ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
19232025-01-28T08:34:01.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64595 req_id = 8251551e-06fb-4d71-a36c-dceeab342250 response_code = 204 uri = /eip-gateways
19242025-01-28T08:34:01.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64595 req_id = d7fcc0e7-c0db-47c5-8c65-28a3e501283a response_code = 204 uri = /vpc-routes
19252025-01-28T08:34:01.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36239
19262025-01-28T08:34:01.149ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19272025-01-28T08:34:01.195ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19282025-01-28T08:34:01.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120616 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36239 req_id = 7d74c57d-fd77-431c-ab7a-c9b8be1721a7 response_code = 204 uri = /switch-ports
19292025-01-28T08:34:01.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44961
19302025-01-28T08:34:01.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44961 req_id = e6ed6f6f-bc47-48dc-9342-9e488cbdb171 response_code = 200 uri = /v2p
19312025-01-28T08:34:01.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36239 req_id = 9ea965e3-491f-4c25-87fe-08cb54078d7f response_code = 200 uri = /network-bootstore-config
19322025-01-28T08:34:01.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44929
19332025-01-28T08:34:01.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44929 req_id = 0deb9e8e-a611-42b8-96af-dbde991af900 response_code = 200 uri = /vpc-routes
19342025-01-28T08:34:01.370ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
19352025-01-28T08:34:01.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44929 req_id = cc6ac628-0b45-4051-b1dd-c4f1f62f537f response_code = 204 uri = /eip-gateways
19362025-01-28T08:34:01.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44929 req_id = 0a1e2798-fe72-4d1e-9d9b-399ba55604d3 response_code = 204 uri = /vpc-routes
19372025-01-28T08:34:01.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38038
19382025-01-28T08:34:01.435ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19392025-01-28T08:34:01.474ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19402025-01-28T08:34:01.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38038 req_id = a76ac96a-d529-4b3a-9acd-9201e12aab78 response_code = 204 uri = /switch-ports
19412025-01-28T08:34:01.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35777
19422025-01-28T08:34:01.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35777 req_id = b6082ddd-afba-4af3-b6f3-b922dd1d072f response_code = 200 uri = /v2p
19432025-01-28T08:34:01.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38038 req_id = 5b940b87-d799-42ac-97bb-feb4aa500665 response_code = 200 uri = /network-bootstore-config
19442025-01-28T08:34:02.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46684
19452025-01-28T08:34:02.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46684 req_id = 03b05370-f921-432e-a31b-0b56be49e428 response_code = 200 uri = /vpc-routes
19462025-01-28T08:34:02.060ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
19472025-01-28T08:34:02.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46684 req_id = b9274aca-8ccc-4dd2-a5d8-4d51c655e2a4 response_code = 204 uri = /eip-gateways
19482025-01-28T08:34:02.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52509
19492025-01-28T08:34:02.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52509 req_id = 3f1bc494-322c-4bbe-a985-a76daaa1ee81 response_code = 200 uri = /v2p
19502025-01-28T08:34:02.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46684 req_id = 59a222ec-69ba-45d9-b67d-d3b65cc9ec92 response_code = 204 uri = /vpc-routes
19512025-01-28T08:34:02.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48517
19522025-01-28T08:34:02.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19532025-01-28T08:34:02.230ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19542025-01-28T08:34:02.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99041 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48517 req_id = 7ac547bc-5457-465d-9d7c-2ba719040f30 response_code = 204 uri = /switch-ports
19552025-01-28T08:34:02.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48517 req_id = f7963c70-b697-42b3-956f-0b2b3376f11a response_code = 200 uri = /network-bootstore-config
19562025-01-28T08:34:18.168ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7280 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = b34a0864-6254-47df-9516-698b14b59c49 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
19572025-01-28T08:34:21.652ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61882
19582025-01-28T08:34:21.653ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61882 req_id = e8934a79-f28d-4688-bc7b-bd6b0f292767 response_code = 200 uri = /baseboard
19592025-01-28T08:34:30.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35774
19602025-01-28T08:34:30.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35774 req_id = 5d673e96-6d9d-450e-9427-1a9382b09fda response_code = 200 uri = /vpc-routes
19612025-01-28T08:34:31.010ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
19622025-01-28T08:34:31.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35774 req_id = 4e794da7-9a91-4c3a-a135-55825834dd6b response_code = 204 uri = /eip-gateways
19632025-01-28T08:34:31.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35774 req_id = d12360df-aba8-4262-adc6-22fef71af8e7 response_code = 204 uri = /vpc-routes
19642025-01-28T08:34:31.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39995
19652025-01-28T08:34:31.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39995 req_id = b3ac223f-e58e-429d-af50-b6cb85f856c3 response_code = 200 uri = /v2p
19662025-01-28T08:34:31.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39940
19672025-01-28T08:34:31.380ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19682025-01-28T08:34:31.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19692025-01-28T08:34:31.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39940 req_id = 557a52eb-6af3-466a-a25d-9cd19f7e74b1 response_code = 204 uri = /switch-ports
19702025-01-28T08:34:31.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44125
19712025-01-28T08:34:31.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44125 req_id = 722747cf-6683-4027-afaa-23d6fe446ca6 response_code = 200 uri = /vpc-routes
19722025-01-28T08:34:31.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39940 req_id = 5a3e26f6-8ad9-4b17-b7c7-f77a21344a64 response_code = 200 uri = /network-bootstore-config
19732025-01-28T08:34:31.629ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
19742025-01-28T08:34:31.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44125 req_id = 26b53940-9e33-4cb3-983e-bfb49e0ae625 response_code = 204 uri = /eip-gateways
19752025-01-28T08:34:31.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33525
19762025-01-28T08:34:31.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33525 req_id = 74d6b66b-d58e-411a-8478-e086212ca6e2 response_code = 200 uri = /v2p
19772025-01-28T08:34:31.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55305
19782025-01-28T08:34:31.726ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19792025-01-28T08:34:31.764ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19802025-01-28T08:34:31.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96197 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55305 req_id = 2c41be79-bddc-4ae6-ba5d-795fb6ee569f response_code = 204 uri = /switch-ports
19812025-01-28T08:34:31.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55305 req_id = b6847b5b-732a-4987-8581-abda33bd680d response_code = 200 uri = /network-bootstore-config
19822025-01-28T08:34:31.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44125 req_id = c03a1f7d-4c02-45f7-b336-994011e7504a response_code = 204 uri = /vpc-routes
19832025-01-28T08:34:32.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65503
19842025-01-28T08:34:32.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65503 req_id = 4d1b3b85-4c65-4638-bec7-0430699fac7c response_code = 200 uri = /vpc-routes
19852025-01-28T08:34:32.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
19862025-01-28T08:34:32.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65503 req_id = 5a9dbecb-0331-4c68-84ac-73e4bbc3c9d4 response_code = 204 uri = /eip-gateways
19872025-01-28T08:34:32.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33109
19882025-01-28T08:34:32.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33109 req_id = fc41b803-7964-42d2-8d83-c5ad34377112 response_code = 200 uri = /v2p
19892025-01-28T08:34:32.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65503 req_id = 310cf756-ad36-4c22-8f91-f9898c8597f0 response_code = 204 uri = /vpc-routes
19902025-01-28T08:34:32.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56462
19912025-01-28T08:34:32.654ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19922025-01-28T08:34:32.693ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19932025-01-28T08:34:32.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96005 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56462 req_id = 0d99aa29-de5f-4bff-b44b-4c5ad001aaf8 response_code = 204 uri = /switch-ports
19942025-01-28T08:34:32.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56462 req_id = 8763c97b-cb3a-4210-9d9c-d0d633d4cd09 response_code = 200 uri = /network-bootstore-config
19952025-01-28T08:34:48.167ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7215 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = f36d6437-4bfe-4e8b-bbf5-d34577e29dbd response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
19962025-01-28T08:34:51.686ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48154
19972025-01-28T08:34:51.686ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48154 req_id = 1e7c2364-0584-4609-a60c-2d0e13476f7b response_code = 200 uri = /baseboard
19982025-01-28T08:35:00.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65435
19992025-01-28T08:35:00.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65435 req_id = 30b16b4f-9ecd-4541-b44a-e5dac5e3dd0c response_code = 200 uri = /vpc-routes
20002025-01-28T08:35:00.949ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
20012025-01-28T08:35:00.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65435 req_id = 9ed94e28-259d-4419-a487-1b5669b8686b response_code = 204 uri = /eip-gateways
20022025-01-28T08:35:00.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65435 req_id = 654d8931-3613-4395-8f75-b7c475f339de response_code = 204 uri = /vpc-routes
20032025-01-28T08:35:01.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56219
20042025-01-28T08:35:01.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56219 req_id = c028be50-30f2-4ef8-ad88-5f8e9f2a4877 response_code = 200 uri = /v2p
20052025-01-28T08:35:01.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35507
20062025-01-28T08:35:01.273ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20072025-01-28T08:35:01.315ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20082025-01-28T08:35:01.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106066 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35507 req_id = 90ae9311-c050-4c45-93ed-77e8b3fb7f33 response_code = 204 uri = /switch-ports
20092025-01-28T08:35:01.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39396
20102025-01-28T08:35:01.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35507 req_id = e31727d7-48f6-4d2d-a641-02059edee528 response_code = 200 uri = /network-bootstore-config
20112025-01-28T08:35:01.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39396 req_id = aa57239e-86bd-4d8c-81a5-a184284931ac response_code = 200 uri = /vpc-routes
20122025-01-28T08:35:01.408ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
20132025-01-28T08:35:01.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39396 req_id = ba0e3a5f-eceb-48cf-93a0-a8c57323c705 response_code = 204 uri = /eip-gateways
20142025-01-28T08:35:01.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39396 req_id = 8c37af24-0adb-42c7-b569-1a43459dc80b response_code = 204 uri = /vpc-routes
20152025-01-28T08:35:01.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59238
20162025-01-28T08:35:01.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59238 req_id = 8327db75-dfab-4834-9943-31bb90cfda5d response_code = 200 uri = /v2p
20172025-01-28T08:35:01.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37660
20182025-01-28T08:35:01.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20192025-01-28T08:35:01.622ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20202025-01-28T08:35:01.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90824 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37660 req_id = a3ccb59e-c685-4098-8e3d-5149a259641e response_code = 204 uri = /switch-ports
20212025-01-28T08:35:01.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37660 req_id = abc3c4fc-2129-4ae6-a213-fccd73c20663 response_code = 200 uri = /network-bootstore-config
20222025-01-28T08:35:02.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47481
20232025-01-28T08:35:02.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47481 req_id = fcf8a617-9034-4d57-9dee-dd44f7e0d358 response_code = 200 uri = /v2p
20242025-01-28T08:35:02.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53611
20252025-01-28T08:35:02.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53611 req_id = afd2ef1b-bd00-44c4-9e3e-350d83d14558 response_code = 200 uri = /vpc-routes
20262025-01-28T08:35:02.131ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
20272025-01-28T08:35:02.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53611 req_id = 93a2af86-dc9d-4f61-bdd8-7937e0e0ddbd response_code = 204 uri = /eip-gateways
20282025-01-28T08:35:02.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53611 req_id = ca1769ef-828b-4c75-a3d9-a15f5b66d310 response_code = 204 uri = /vpc-routes
20292025-01-28T08:35:02.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36536
20302025-01-28T08:35:02.173ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20312025-01-28T08:35:02.213ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20322025-01-28T08:35:02.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97644 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36536 req_id = a04341f9-9c7d-445d-9830-213cac519f1e response_code = 204 uri = /switch-ports
20332025-01-28T08:35:02.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36536 req_id = 9e630762-baa4-40dc-b37b-3da39d442c01 response_code = 200 uri = /network-bootstore-config
20342025-01-28T08:35:18.167ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7426 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = c69abe72-85d6-494a-a559-e2836f937a25 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
20352025-01-28T08:35:21.718ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56851
20362025-01-28T08:35:21.718ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56851 req_id = 48ee9be6-7274-4b6e-960c-244a64e2d66e response_code = 200 uri = /baseboard
20372025-01-28T08:35:31.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43183
20382025-01-28T08:35:31.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43183 req_id = 7ac12292-f1fb-4b9f-8695-fa5c76f55bb1 response_code = 200 uri = /v2p
20392025-01-28T08:35:31.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44584
20402025-01-28T08:35:31.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44584 req_id = 6f451ee3-f928-454f-85b3-18976d6ca180 response_code = 200 uri = /vpc-routes
20412025-01-28T08:35:31.264ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
20422025-01-28T08:35:31.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44584 req_id = a19a616c-5cb9-4241-b708-8103c91394b0 response_code = 204 uri = /eip-gateways
20432025-01-28T08:35:31.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44584 req_id = ed473bc8-a823-4853-a117-08ef9c0226e9 response_code = 204 uri = /vpc-routes
20442025-01-28T08:35:31.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55633
20452025-01-28T08:35:31.327ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20462025-01-28T08:35:31.367ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20472025-01-28T08:35:31.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96597 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55633 req_id = 6ee912e1-00d5-425f-b1e5-2a2656628455 response_code = 204 uri = /switch-ports
20482025-01-28T08:35:31.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55633 req_id = 173b9215-c335-4fce-b8d5-804f58b848a6 response_code = 200 uri = /network-bootstore-config
20492025-01-28T08:35:31.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51467
20502025-01-28T08:35:31.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51467 req_id = 32c51de8-192c-456d-8920-f9ee491b7711 response_code = 200 uri = /vpc-routes
20512025-01-28T08:35:31.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34228
20522025-01-28T08:35:31.520ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20532025-01-28T08:35:31.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20542025-01-28T08:35:31.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20552025-01-28T08:35:31.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20562025-01-28T08:35:31.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20572025-01-28T08:35:31.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20582025-01-28T08:35:31.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20592025-01-28T08:35:31.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 392 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34228 req_id = 94f539f5-e3ed-468c-a327-613054a753c4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20602025-01-28T08:35:31.558ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
20612025-01-28T08:35:31.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51467 req_id = f893aba1-0a59-4208-a7b5-62b49de9c582 response_code = 204 uri = /eip-gateways
20622025-01-28T08:35:31.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51467 req_id = 47e2054a-18a2-4f6c-acc7-eb59b8e207af response_code = 204 uri = /vpc-routes
20632025-01-28T08:35:31.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37906
20642025-01-28T08:35:31.665ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20652025-01-28T08:35:31.705ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20662025-01-28T08:35:31.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96529 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37906 req_id = e6e00464-8d7b-4c43-81c1-45587ce8a617 response_code = 204 uri = /switch-ports
20672025-01-28T08:35:31.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52316
20682025-01-28T08:35:31.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62193
20692025-01-28T08:35:31.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37906 req_id = 64179a60-958f-4dc6-b7ca-68c63070dc99 response_code = 200 uri = /network-bootstore-config
20702025-01-28T08:35:31.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52316 req_id = 4d0580a2-3014-4738-bd14-984aab5ee790 response_code = 200 uri = /v2p
20712025-01-28T08:35:31.762ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20722025-01-28T08:35:31.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20732025-01-28T08:35:31.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20742025-01-28T08:35:31.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20752025-01-28T08:35:31.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20762025-01-28T08:35:31.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20772025-01-28T08:35:31.762ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20782025-01-28T08:35:31.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62193 req_id = 0864c27d-8354-49f8-8233-7447afc1aec1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20792025-01-28T08:35:32.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47948
20802025-01-28T08:35:32.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47948 req_id = acf7d922-c5e5-4c13-83d2-5476f11633ce response_code = 200 uri = /vpc-routes
20812025-01-28T08:35:32.110ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
20822025-01-28T08:35:32.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47948 req_id = b75a2439-9af0-4774-b949-f9f9a1d3c175 response_code = 204 uri = /eip-gateways
20832025-01-28T08:35:32.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47948 req_id = dceae25d-8266-44d5-9f16-778efa9568d4 response_code = 204 uri = /vpc-routes
20842025-01-28T08:35:32.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60895
20852025-01-28T08:35:32.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60895 req_id = f3e285b7-eb1f-43f0-a685-c3941f006c13 response_code = 200 uri = /v2p
20862025-01-28T08:35:32.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33888
20872025-01-28T08:35:32.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20882025-01-28T08:35:32.409ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20892025-01-28T08:35:32.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100656 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33888 req_id = 988d14db-4748-4e41-90d8-39eaccbba91d response_code = 204 uri = /switch-ports
20902025-01-28T08:35:32.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33888 req_id = 8b6bee52-7301-4a4c-8611-d8815bcd1b8a response_code = 200 uri = /network-bootstore-config
20912025-01-28T08:35:32.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50816
20922025-01-28T08:35:32.496ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20932025-01-28T08:35:32.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20942025-01-28T08:35:32.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20952025-01-28T08:35:32.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20962025-01-28T08:35:32.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20972025-01-28T08:35:32.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20982025-01-28T08:35:32.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20992025-01-28T08:35:32.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 398 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50816 req_id = 9b1ae486-8797-48b0-b5d4-76eda41ad07d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21002025-01-28T08:35:48.167ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7410 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 871d8707-40ed-48e0-944b-6b95f64d3fcf response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
21012025-01-28T08:35:51.751ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58934
21022025-01-28T08:35:51.751ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58934 req_id = e217e9a1-c2e7-450d-aae7-6ac8a7f0b690 response_code = 200 uri = /baseboard
21032025-01-28T08:36:00.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57266
21042025-01-28T08:36:00.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57266 req_id = 808f6fa6-6686-4c1c-b075-9398003d4fea response_code = 200 uri = /vpc-routes
21052025-01-28T08:36:01.013ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
21062025-01-28T08:36:01.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57266 req_id = 2cd6659b-c912-4fd4-a93e-e28e0d0ecb63 response_code = 204 uri = /eip-gateways
21072025-01-28T08:36:01.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57266 req_id = d86ff79a-be74-408c-95e7-5aae8bb7e663 response_code = 204 uri = /vpc-routes
21082025-01-28T08:36:01.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35876
21092025-01-28T08:36:01.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35876 req_id = 60790650-7b0e-4109-8132-4ccc0c0f7678 response_code = 200 uri = /v2p
21102025-01-28T08:36:01.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34767
21112025-01-28T08:36:01.193ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21122025-01-28T08:36:01.240ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21132025-01-28T08:36:01.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117729 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34767 req_id = 59058291-b2cb-4f51-bd64-761a21013d6a response_code = 204 uri = /switch-ports
21142025-01-28T08:36:01.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34767 req_id = 99183f3a-cf64-443a-8e2c-b8db84c58702 response_code = 200 uri = /network-bootstore-config
21152025-01-28T08:36:01.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54074
21162025-01-28T08:36:01.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54074 req_id = 80f330a4-fe06-41c8-8378-545529a7933a response_code = 200 uri = /vpc-routes
21172025-01-28T08:36:01.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51086
21182025-01-28T08:36:01.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51086 req_id = ef1c38ed-c7b1-4046-ae3c-92378fd4f098 response_code = 200 uri = /v2p
21192025-01-28T08:36:01.466ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
21202025-01-28T08:36:01.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54074 req_id = 494ac40d-1dd6-44c1-99d3-c71e504615df response_code = 204 uri = /eip-gateways
21212025-01-28T08:36:01.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54074 req_id = 31426b03-8fdf-448c-958e-d6efa8794a17 response_code = 204 uri = /vpc-routes
21222025-01-28T08:36:01.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59264
21232025-01-28T08:36:01.544ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21242025-01-28T08:36:01.582ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21252025-01-28T08:36:01.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94122 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59264 req_id = fb36b042-19b0-47cb-b24e-62c48d07dfe2 response_code = 204 uri = /switch-ports
21262025-01-28T08:36:01.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59264 req_id = 7752bfa5-0768-4eae-8533-99bc95aa792f response_code = 200 uri = /network-bootstore-config
21272025-01-28T08:36:02.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59887
21282025-01-28T08:36:02.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59887 req_id = 8f7f4586-1209-4dcb-8e86-f87ba9f8b48b response_code = 200 uri = /vpc-routes
21292025-01-28T08:36:02.097ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
21302025-01-28T08:36:02.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59887 req_id = dbfd8f21-8f8f-4d5f-8749-15412d911674 response_code = 204 uri = /eip-gateways
21312025-01-28T08:36:02.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42059
21322025-01-28T08:36:02.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42059 req_id = b1eb2326-001f-4758-a506-dce7f217765d response_code = 200 uri = /v2p
21332025-01-28T08:36:02.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59887 req_id = 263bed2c-36ee-4622-9366-7b347ce11611 response_code = 204 uri = /vpc-routes
21342025-01-28T08:36:02.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40402
21352025-01-28T08:36:02.157ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21362025-01-28T08:36:02.195ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21372025-01-28T08:36:02.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96273 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40402 req_id = 4f854f7d-c20d-4e4a-a024-88f9c14092fb response_code = 204 uri = /switch-ports
21382025-01-28T08:36:02.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40402 req_id = a1a90ace-c231-41b9-9261-5dd1d5396c3b response_code = 200 uri = /network-bootstore-config
21392025-01-28T08:36:18.167ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6934 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 6aa5c0f7-10e4-4240-80cb-4275dd7916eb response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
21402025-01-28T08:36:21.783ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57460
21412025-01-28T08:36:21.783ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57460 req_id = b0574e48-5f46-40e0-98a6-dae6a59bc919 response_code = 200 uri = /baseboard
21422025-01-28T08:36:31.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58872
21432025-01-28T08:36:31.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58872 req_id = 29281151-7c90-492c-bcd4-8b2b20da0198 response_code = 200 uri = /vpc-routes
21442025-01-28T08:36:31.135ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
21452025-01-28T08:36:31.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58872 req_id = 58be047b-421c-4800-804f-35bcf1b4be21 response_code = 204 uri = /eip-gateways
21462025-01-28T08:36:31.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58872 req_id = afcaebcd-132b-42f8-bfe0-f5b6c5222589 response_code = 204 uri = /vpc-routes
21472025-01-28T08:36:31.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46877
21482025-01-28T08:36:31.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46877 req_id = e641ddde-6906-4416-a56a-56730a657acb response_code = 200 uri = /v2p
21492025-01-28T08:36:31.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61860
21502025-01-28T08:36:31.305ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21512025-01-28T08:36:31.355ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21522025-01-28T08:36:31.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114167 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61860 req_id = e72cfa25-e228-44da-8158-01da55dd0951 response_code = 204 uri = /switch-ports
21532025-01-28T08:36:31.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61860 req_id = 5d665ce0-6afe-4594-a809-c95737aaa670 response_code = 200 uri = /network-bootstore-config
21542025-01-28T08:36:31.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41843
21552025-01-28T08:36:31.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41843 req_id = 20b6e1ab-69d4-457f-b4f7-92e42715676c response_code = 200 uri = /vpc-routes
21562025-01-28T08:36:31.524ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
21572025-01-28T08:36:31.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41843 req_id = 87630f01-5fe9-40f5-bfc8-ee1ddf2c5824 response_code = 204 uri = /eip-gateways
21582025-01-28T08:36:31.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34996
21592025-01-28T08:36:31.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34996 req_id = 75428498-a9b0-4953-a172-fc5ac8126d80 response_code = 200 uri = /v2p
21602025-01-28T08:36:31.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41843 req_id = d108ed4f-be23-43d8-8431-c83adef86d97 response_code = 204 uri = /vpc-routes
21612025-01-28T08:36:31.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49821
21622025-01-28T08:36:31.640ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21632025-01-28T08:36:31.678ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21642025-01-28T08:36:31.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93093 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49821 req_id = a52844dc-ec66-4d9f-bd05-12cf38460beb response_code = 204 uri = /switch-ports
21652025-01-28T08:36:31.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49821 req_id = 0b989fe4-f2f8-4ae1-b2ca-1ab2b0d00244 response_code = 200 uri = /network-bootstore-config
21662025-01-28T08:36:32.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39088
21672025-01-28T08:36:32.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39088 req_id = ec66cd1e-a72a-48b9-ba5e-983a8dffd120 response_code = 200 uri = /vpc-routes
21682025-01-28T08:36:32.370ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
21692025-01-28T08:36:32.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39088 req_id = ef7483d7-0ddf-47eb-a3ab-1c5401dc6770 response_code = 204 uri = /eip-gateways
21702025-01-28T08:36:32.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54429
21712025-01-28T08:36:32.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54429 req_id = 412dfa95-2783-4a07-b3c2-d2ca08eef8d8 response_code = 200 uri = /v2p
21722025-01-28T08:36:32.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39088 req_id = ba13fca8-a5d7-4837-901b-4f863956d529 response_code = 204 uri = /vpc-routes
21732025-01-28T08:36:32.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55741
21742025-01-28T08:36:32.565ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21752025-01-28T08:36:32.606ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21762025-01-28T08:36:32.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99557 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55741 req_id = ceb41441-1cac-4827-969b-2fb5dbbddfca response_code = 204 uri = /switch-ports
21772025-01-28T08:36:32.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55741 req_id = 7be28f19-1131-468f-900c-ab01e6f797cb response_code = 200 uri = /network-bootstore-config
21782025-01-28T08:36:48.168ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7268 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = e29213fa-df2b-4c65-ba1a-9690951a3b2e response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
21792025-01-28T08:36:51.815ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51875
21802025-01-28T08:36:51.815ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51875 req_id = e0bc212b-561e-4428-b7b8-ccda1c343e99 response_code = 200 uri = /baseboard
21812025-01-28T08:37:01.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44003
21822025-01-28T08:37:01.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44003 req_id = 9fcb7f45-89fa-4f06-97d9-5ae7c080e218 response_code = 200 uri = /vpc-routes
21832025-01-28T08:37:01.081ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
21842025-01-28T08:37:01.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44003 req_id = b8ae8e53-d558-4555-ad6c-c7c12c58d1c3 response_code = 204 uri = /eip-gateways
21852025-01-28T08:37:01.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44003 req_id = 9f5c4668-80eb-450d-a9ea-5a7595530028 response_code = 204 uri = /vpc-routes
21862025-01-28T08:37:01.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40369
21872025-01-28T08:37:01.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40369 req_id = 4c28c926-7101-41c7-bb3d-361f13533a5a response_code = 200 uri = /v2p
21882025-01-28T08:37:01.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33829
21892025-01-28T08:37:01.156ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21902025-01-28T08:37:01.198ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21912025-01-28T08:37:01.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33829 req_id = 633a235d-b1a8-4b31-98ad-4ec36fa885b6 response_code = 204 uri = /switch-ports
21922025-01-28T08:37:01.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33829 req_id = e461ca55-3c99-4e23-96ae-6d490275ce15 response_code = 200 uri = /network-bootstore-config
21932025-01-28T08:37:01.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50162
21942025-01-28T08:37:01.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50162 req_id = da275b52-689e-47b0-a59f-8197cad493b9 response_code = 200 uri = /vpc-routes
21952025-01-28T08:37:01.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55110
21962025-01-28T08:37:01.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55110 req_id = 866ac1c7-b54f-491d-b0db-bc18c6b8f907 response_code = 200 uri = /v2p
21972025-01-28T08:37:01.411ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
21982025-01-28T08:37:01.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50162 req_id = b11e2fa8-a3d8-4c73-bfef-40ef2a01cf1d response_code = 204 uri = /eip-gateways
21992025-01-28T08:37:01.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50162 req_id = c4a0741d-9e5f-48c4-8afa-b0d8a90ed80c response_code = 204 uri = /vpc-routes
22002025-01-28T08:37:01.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48240
22012025-01-28T08:37:01.459ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22022025-01-28T08:37:01.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22032025-01-28T08:37:01.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92878 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48240 req_id = 2c633f5f-733b-481c-b863-968ff4322f0a response_code = 204 uri = /switch-ports
22042025-01-28T08:37:01.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48240 req_id = 9203900f-2fef-43ee-99a2-f327b8162b32 response_code = 200 uri = /network-bootstore-config
22052025-01-28T08:37:02.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49668
22062025-01-28T08:37:02.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49668 req_id = 368617d5-8d13-46f7-8368-ae077d87471d response_code = 200 uri = /vpc-routes
22072025-01-28T08:37:02.074ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
22082025-01-28T08:37:02.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49668 req_id = 9dea395e-38c1-4d81-bb42-a2045aa57cda response_code = 204 uri = /eip-gateways
22092025-01-28T08:37:02.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57900
22102025-01-28T08:37:02.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57900 req_id = e44328e1-7a63-465b-855c-10acd15c129f response_code = 200 uri = /v2p
22112025-01-28T08:37:02.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49668 req_id = 0546631d-f179-4f0c-9e63-c8650a0a59fd response_code = 204 uri = /vpc-routes
22122025-01-28T08:37:02.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64415
22132025-01-28T08:37:02.178ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22142025-01-28T08:37:02.217ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22152025-01-28T08:37:02.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98358 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64415 req_id = 54bbd821-25e5-45de-83bc-8b94341a23a9 response_code = 204 uri = /switch-ports
22162025-01-28T08:37:02.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64415 req_id = b23413e4-783b-4cdc-840b-990d3a18fbf4 response_code = 200 uri = /network-bootstore-config
22172025-01-28T08:37:18.168ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7463 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 797581e4-bb24-4a9f-a844-833e2fcea188 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
22182025-01-28T08:37:21.848ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42931
22192025-01-28T08:37:21.848ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42931 req_id = dff64cbc-61df-4518-8c32-a0ef51cc962b response_code = 200 uri = /baseboard
22202025-01-28T08:37:31.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51079
22212025-01-28T08:37:31.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51079 req_id = 285f8ec7-e42f-4307-aa44-9a532b59f10e response_code = 200 uri = /v2p
22222025-01-28T08:37:31.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50245
22232025-01-28T08:37:31.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50245 req_id = 0c677e87-92df-43e9-a366-d5414aafc245 response_code = 200 uri = /vpc-routes
22242025-01-28T08:37:31.344ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
22252025-01-28T08:37:31.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50245 req_id = d3cf13ea-cab2-424f-957f-81540d2ffa45 response_code = 204 uri = /eip-gateways
22262025-01-28T08:37:31.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50245 req_id = 17ca8f05-13e5-4e09-a627-7ab91eb4991e response_code = 204 uri = /vpc-routes
22272025-01-28T08:37:31.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39856
22282025-01-28T08:37:31.461ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22292025-01-28T08:37:31.500ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22302025-01-28T08:37:31.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97729 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39856 req_id = 847e779b-15b8-4b70-a449-09e24eaf371a response_code = 204 uri = /switch-ports
22312025-01-28T08:37:31.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42124
22322025-01-28T08:37:31.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42124 req_id = 9afab243-47cd-429d-9286-873970b922b0 response_code = 200 uri = /v2p
22332025-01-28T08:37:31.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39856 req_id = dce638f8-4704-495a-99bf-5403fd3478e0 response_code = 200 uri = /network-bootstore-config
22342025-01-28T08:37:31.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60017
22352025-01-28T08:37:31.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60017 req_id = e3d2d310-7699-4138-95a5-8bd9c38bdfc0 response_code = 200 uri = /vpc-routes
22362025-01-28T08:37:31.604ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
22372025-01-28T08:37:31.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60017 req_id = e344f04a-a76e-4079-a93b-0d8aa37b1877 response_code = 204 uri = /eip-gateways
22382025-01-28T08:37:31.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60017 req_id = 6a4a9f69-2281-4085-a753-e887ec6a3eae response_code = 204 uri = /vpc-routes
22392025-01-28T08:37:31.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49166
22402025-01-28T08:37:31.673ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22412025-01-28T08:37:31.710ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22422025-01-28T08:37:31.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88619 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49166 req_id = c6d83a07-f848-4538-b17b-e54f72a8e9dc response_code = 204 uri = /switch-ports
22432025-01-28T08:37:31.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49166 req_id = c74cc2a7-7fe8-41cf-8d9d-fd1b05da4316 response_code = 200 uri = /network-bootstore-config
22442025-01-28T08:37:32.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64629
22452025-01-28T08:37:32.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64629 req_id = 8330bb5e-2297-497f-ad2a-62039383ee9f response_code = 200 uri = /vpc-routes
22462025-01-28T08:37:32.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
22472025-01-28T08:37:32.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64629 req_id = 174b5fd7-cb19-43bf-a5e9-950c624d5def response_code = 204 uri = /eip-gateways
22482025-01-28T08:37:32.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64629 req_id = 42ff8f87-b19d-4619-9fbf-adf7a36bfaf0 response_code = 204 uri = /vpc-routes
22492025-01-28T08:37:32.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46641
22502025-01-28T08:37:32.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46641 req_id = 7e719c09-51c8-4039-a40c-eda0b11b5fea response_code = 200 uri = /v2p
22512025-01-28T08:37:32.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49181
22522025-01-28T08:37:32.333ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22532025-01-28T08:37:32.370ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22542025-01-28T08:37:32.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93724 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49181 req_id = afc1efdc-5263-4cc4-8de9-83382d06e722 response_code = 204 uri = /switch-ports
22552025-01-28T08:37:32.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49181 req_id = 4dea1ad8-6f4f-42c1-b5be-f412fbdbcc41 response_code = 200 uri = /network-bootstore-config
22562025-01-28T08:37:48.168ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7294 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 3bdabca0-58c9-46f0-bb63-f14d1de9bdc9 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
22572025-01-28T08:37:51.881ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38233
22582025-01-28T08:37:51.881ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38233 req_id = 84340bcd-0e6d-4885-8307-3d9c98d397c4 response_code = 200 uri = /baseboard
22592025-01-28T08:38:01.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62913
22602025-01-28T08:38:01.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62913 req_id = fe770d85-e110-44a4-afbe-5436388e9570 response_code = 200 uri = /vpc-routes
22612025-01-28T08:38:01.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
22622025-01-28T08:38:01.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62913 req_id = 4b89b78d-c37e-4342-8e8a-69031555da1b response_code = 204 uri = /eip-gateways
22632025-01-28T08:38:01.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62913 req_id = 7db07258-46d5-47c3-af77-911c94d7fa45 response_code = 204 uri = /vpc-routes
22642025-01-28T08:38:01.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59485
22652025-01-28T08:38:01.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59485 req_id = b665727d-f21d-49b6-9c95-3c03ee431ea6 response_code = 200 uri = /v2p
22662025-01-28T08:38:01.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43731
22672025-01-28T08:38:01.129ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22682025-01-28T08:38:01.167ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22692025-01-28T08:38:01.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119925 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43731 req_id = 7f3b8212-bf81-45b4-94ab-5a647b03be73 response_code = 204 uri = /switch-ports
22702025-01-28T08:38:01.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43731 req_id = aed4972d-1d6e-4e21-a14f-9affa8f869e8 response_code = 200 uri = /network-bootstore-config
22712025-01-28T08:38:01.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46510
22722025-01-28T08:38:01.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46510 req_id = 9e720494-53e3-4b39-9338-6edb1d0669fd response_code = 200 uri = /vpc-routes
22732025-01-28T08:38:01.399ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
22742025-01-28T08:38:01.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46510 req_id = 4206aae3-5c7a-4fe3-ba9e-e83d1f55af95 response_code = 204 uri = /eip-gateways
22752025-01-28T08:38:01.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34873
22762025-01-28T08:38:01.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34873 req_id = 366576d3-37d6-462a-af9a-057c216afc62 response_code = 200 uri = /v2p
22772025-01-28T08:38:01.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46510 req_id = 332d416f-e3f5-4bb8-b44b-34efe8c0b606 response_code = 204 uri = /vpc-routes
22782025-01-28T08:38:01.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40491
22792025-01-28T08:38:01.464ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22802025-01-28T08:38:01.503ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22812025-01-28T08:38:01.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40491 req_id = e177b60a-3e6e-436f-8d61-7616260fa5ae response_code = 204 uri = /switch-ports
22822025-01-28T08:38:01.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40491 req_id = b81bd535-d593-47d8-868e-987c8c9397b2 response_code = 200 uri = /network-bootstore-config
22832025-01-28T08:38:02.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60272
22842025-01-28T08:38:02.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60272 req_id = 85478706-fcf8-4814-9729-aff7b9fba995 response_code = 200 uri = /vpc-routes
22852025-01-28T08:38:02.110ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
22862025-01-28T08:38:02.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60272 req_id = 56db6fb9-5302-4508-86d7-4452795dd8dd response_code = 204 uri = /eip-gateways
22872025-01-28T08:38:02.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60272 req_id = 4639ad1a-204e-4172-8324-ea7a437cb50f response_code = 204 uri = /vpc-routes
22882025-01-28T08:38:02.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46414
22892025-01-28T08:38:02.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46414 req_id = 67ceeb4a-1ec6-4bc7-b204-64147e4dda21 response_code = 200 uri = /v2p
22902025-01-28T08:38:02.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42073
22912025-01-28T08:38:02.185ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22922025-01-28T08:38:02.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22932025-01-28T08:38:02.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92538 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42073 req_id = eb3e9787-616e-42aa-b442-c4a14cda3071 response_code = 204 uri = /switch-ports
22942025-01-28T08:38:02.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42073 req_id = 66226645-ecb5-4a30-ab5b-4bbcbe735293 response_code = 200 uri = /network-bootstore-config
22952025-01-28T08:38:18.168ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7112 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 5aaa125a-b906-4427-a49b-fe2fdf2ac0fd response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
22962025-01-28T08:38:19.438ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22972025-01-28T08:38:19.438ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22982025-01-28T08:38:19.468ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2011, tv_nsec: 758247998 } time_to_next_cleanup = 599.99999482s
22992025-01-28T08:38:21.914ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35699
23002025-01-28T08:38:21.914ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35699 req_id = 73423bfd-bae4-4c33-be20-ddc84ebf3bbd response_code = 200 uri = /baseboard
23012025-01-28T08:38:31.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47344
23022025-01-28T08:38:31.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47344 req_id = fde4d23d-156a-4fd4-8ecc-afb6dbe031fe response_code = 200 uri = /vpc-routes
23032025-01-28T08:38:31.278ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
23042025-01-28T08:38:31.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47344 req_id = b886782d-7085-4256-9667-85e3a6c3cffa response_code = 204 uri = /eip-gateways
23052025-01-28T08:38:31.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53481
23062025-01-28T08:38:31.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53481 req_id = 02494693-85eb-439d-9487-0f1bdf9f5a93 response_code = 200 uri = /v2p
23072025-01-28T08:38:31.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47344 req_id = 9f0ca136-9799-476d-8a01-010992be4066 response_code = 204 uri = /vpc-routes
23082025-01-28T08:38:31.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52348
23092025-01-28T08:38:31.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52348 req_id = 3ad3826e-7083-407b-9760-c20800ed4387 response_code = 200 uri = /vpc-routes
23102025-01-28T08:38:31.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55727
23112025-01-28T08:38:31.379ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23122025-01-28T08:38:31.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23132025-01-28T08:38:31.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55727 req_id = e0680088-3f1a-4dcd-aa8b-2473d1683dd4 response_code = 204 uri = /switch-ports
23142025-01-28T08:38:31.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
23152025-01-28T08:38:31.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52348 req_id = a986ffb4-b032-43b3-b7e7-a76d341dc019 response_code = 204 uri = /eip-gateways
23162025-01-28T08:38:31.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55727 req_id = d4a5ce87-3f62-46cc-a35a-68f281dc4b0a response_code = 200 uri = /network-bootstore-config
23172025-01-28T08:38:31.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52348 req_id = 7b9f8307-6cc8-47e5-8c7e-7edc82cb87d1 response_code = 204 uri = /vpc-routes
23182025-01-28T08:38:31.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40508
23192025-01-28T08:38:31.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40508 req_id = 3a08677e-8649-424e-a092-10d360d2e348 response_code = 200 uri = /v2p
23202025-01-28T08:38:31.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46739
23212025-01-28T08:38:31.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23222025-01-28T08:38:31.611ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23232025-01-28T08:38:31.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93058 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46739 req_id = f64dc439-5c16-425f-8667-0225ed6aed5e response_code = 204 uri = /switch-ports
23242025-01-28T08:38:31.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46739 req_id = cbc937c2-4bc6-4b2a-b7cd-27665309f362 response_code = 200 uri = /network-bootstore-config
23252025-01-28T08:38:32.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46226
23262025-01-28T08:38:32.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46226 req_id = 3c7ecc7b-c88c-44eb-b2aa-d9acc97d88d1 response_code = 200 uri = /vpc-routes
23272025-01-28T08:38:32.197ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
23282025-01-28T08:38:32.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46226 req_id = 89391dba-06f2-484d-befb-92f02a4774c8 response_code = 204 uri = /eip-gateways
23292025-01-28T08:38:32.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46226 req_id = 76a823a4-4349-4243-b75a-ca84ec9c2ba4 response_code = 204 uri = /vpc-routes
23302025-01-28T08:38:32.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40305
23312025-01-28T08:38:32.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40305 req_id = 42193043-5b71-4b6b-a16c-aa167bdc5b7d response_code = 200 uri = /v2p
23322025-01-28T08:38:32.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38333
23332025-01-28T08:38:32.347ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23342025-01-28T08:38:32.384ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23352025-01-28T08:38:32.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91597 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38333 req_id = 95f7b38c-05cb-4c20-8720-17c7a8b03f24 response_code = 204 uri = /switch-ports
23362025-01-28T08:38:32.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38333 req_id = 6725109c-63dd-47d4-8aff-6356cd17a593 response_code = 200 uri = /network-bootstore-config
23372025-01-28T08:38:33.782ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23382025-01-28T08:38:48.168ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7878 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 54d41ea9-00b1-44b6-964f-82f0a0cdcf6e response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
23392025-01-28T08:38:51.948ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41312
23402025-01-28T08:38:51.948ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41312 req_id = 1bbcb962-2e84-4e88-bab4-4d3e1ddc0951 response_code = 200 uri = /baseboard
23412025-01-28T08:39:01.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39041
23422025-01-28T08:39:01.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39041 req_id = 8698a9b7-f2de-47f6-af71-940c0e4dd142 response_code = 200 uri = /vpc-routes
23432025-01-28T08:39:01.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46493
23442025-01-28T08:39:01.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46493 req_id = 005da474-718c-404b-a808-2c3b17fc1a95 response_code = 200 uri = /v2p
23452025-01-28T08:39:01.079ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
23462025-01-28T08:39:01.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39041 req_id = fc09245d-ba96-4ef2-90dc-1032e006422b response_code = 204 uri = /eip-gateways
23472025-01-28T08:39:01.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39041 req_id = 1bb2d166-fd2d-4fb5-8f6c-65ba810410cd response_code = 204 uri = /vpc-routes
23482025-01-28T08:39:01.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57887
23492025-01-28T08:39:01.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23502025-01-28T08:39:01.211ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23512025-01-28T08:39:01.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137667 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57887 req_id = 3545de6a-4b3c-45cb-a5d4-e5b31ed6d7ab response_code = 204 uri = /switch-ports
23522025-01-28T08:39:01.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57887 req_id = 5d1dbd7c-eae7-43f1-b0a4-c4adc14d70b9 response_code = 200 uri = /network-bootstore-config
23532025-01-28T08:39:01.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47928
23542025-01-28T08:39:01.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47928 req_id = f7c25bb3-d5fa-4166-8a6a-77b02728e3d9 response_code = 200 uri = /vpc-routes
23552025-01-28T08:39:01.366ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
23562025-01-28T08:39:01.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47928 req_id = 80d525ae-aa35-46c1-87d4-d255858d9e73 response_code = 204 uri = /eip-gateways
23572025-01-28T08:39:01.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47928 req_id = d23abc26-8b58-4b38-b589-cda8b6dfeaa4 response_code = 204 uri = /vpc-routes
23582025-01-28T08:39:01.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34634
23592025-01-28T08:39:01.416ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23602025-01-28T08:39:01.455ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23612025-01-28T08:39:01.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95590 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34634 req_id = 6116499f-7530-4aee-be4c-9934b8e3e11f response_code = 204 uri = /switch-ports
23622025-01-28T08:39:01.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62140
23632025-01-28T08:39:01.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62140 req_id = fe759cf9-3394-4f28-a636-1bf7ce23ea5d response_code = 200 uri = /v2p
23642025-01-28T08:39:01.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34634 req_id = 57c7788f-858c-4506-887e-5c23fa0047f5 response_code = 200 uri = /network-bootstore-config
23652025-01-28T08:39:02.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57201
23662025-01-28T08:39:02.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57201 req_id = c25e45a5-9918-488f-9729-800f8d8d32df response_code = 200 uri = /vpc-routes
23672025-01-28T08:39:02.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50635
23682025-01-28T08:39:02.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50635 req_id = 72e92a90-37ce-45a6-982e-7015abd6aeb9 response_code = 200 uri = /v2p
23692025-01-28T08:39:02.189ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
23702025-01-28T08:39:02.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57201 req_id = f3fb9279-d784-44f9-b9c1-db47ae60710f response_code = 204 uri = /eip-gateways
23712025-01-28T08:39:02.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57201 req_id = 0cdb3020-0f84-4d99-8374-a125364340c4 response_code = 204 uri = /vpc-routes
23722025-01-28T08:39:02.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47304
23732025-01-28T08:39:02.211ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23742025-01-28T08:39:02.249ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23752025-01-28T08:39:02.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95235 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47304 req_id = 58c28b01-622e-4570-b0f3-e31556922a9b response_code = 204 uri = /switch-ports
23762025-01-28T08:39:02.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47304 req_id = e1c93062-d24d-4196-a3b5-3b71e8d0de7e response_code = 200 uri = /network-bootstore-config
23772025-01-28T08:39:18.169ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7862 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 8da85e43-4d12-4e40-a8af-8b353988fdd6 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
23782025-01-28T08:39:21.981ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62361
23792025-01-28T08:39:21.981ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62361 req_id = 29046cea-13a3-4b0c-8ed4-4481477ee06f response_code = 200 uri = /baseboard
23802025-01-28T08:39:31.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42815
23812025-01-28T08:39:31.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42815 req_id = adcbc59c-3109-4440-9db8-782f6d3dda05 response_code = 200 uri = /vpc-routes
23822025-01-28T08:39:31.284ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
23832025-01-28T08:39:31.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42815 req_id = 34bd7a7e-3ea2-4661-8953-f86c3be15e91 response_code = 204 uri = /eip-gateways
23842025-01-28T08:39:31.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42155
23852025-01-28T08:39:31.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42155 req_id = 967e816f-ed72-493f-acf9-1b0d89b92cd1 response_code = 200 uri = /v2p
23862025-01-28T08:39:31.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42815 req_id = 738971c5-f409-42fa-bab8-846d9ccab675 response_code = 204 uri = /vpc-routes
23872025-01-28T08:39:31.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33619
23882025-01-28T08:39:31.369ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23892025-01-28T08:39:31.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23902025-01-28T08:39:31.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93558 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33619 req_id = 692fadf7-9a0a-4646-939e-c921a4351969 response_code = 204 uri = /switch-ports
23912025-01-28T08:39:31.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33619 req_id = cfa58524-6704-43d9-8397-fc8bfe0154d1 response_code = 200 uri = /network-bootstore-config
23922025-01-28T08:39:31.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48659
23932025-01-28T08:39:31.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48659 req_id = 849faa55-4133-401a-8155-ff5ba7cec243 response_code = 200 uri = /v2p
23942025-01-28T08:39:31.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52124
23952025-01-28T08:39:31.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52124 req_id = 01ea8327-ba42-47bd-9402-29b395758e16 response_code = 200 uri = /vpc-routes
23962025-01-28T08:39:31.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
23972025-01-28T08:39:31.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52124 req_id = 7e81f12e-954a-49c5-8af6-667a67fe520b response_code = 204 uri = /eip-gateways
23982025-01-28T08:39:31.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52124 req_id = 66acf040-28cb-401a-8351-5dd525f325fb response_code = 204 uri = /vpc-routes
23992025-01-28T08:39:31.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33454
24002025-01-28T08:39:31.623ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24012025-01-28T08:39:31.660ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24022025-01-28T08:39:31.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90291 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33454 req_id = 1c7a9c9d-86b1-4338-87ef-40d4f1d67b78 response_code = 204 uri = /switch-ports
24032025-01-28T08:39:31.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33454 req_id = d4275909-9087-4c53-b0eb-194111850616 response_code = 200 uri = /network-bootstore-config
24042025-01-28T08:39:32.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38945
24052025-01-28T08:39:32.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38945 req_id = c772fe01-dfd5-4201-b4c2-7eccbf430470 response_code = 200 uri = /vpc-routes
24062025-01-28T08:39:32.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35240
24072025-01-28T08:39:32.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35240 req_id = bad4c9c3-fdb0-4dae-a762-a4ff943fd080 response_code = 200 uri = /v2p
24082025-01-28T08:39:32.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
24092025-01-28T08:39:32.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38945 req_id = a78a8d67-f625-4123-8145-d84d75e94ed4 response_code = 204 uri = /eip-gateways
24102025-01-28T08:39:32.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38945 req_id = add326bf-ac52-486d-9ede-2d95472b1578 response_code = 204 uri = /vpc-routes
24112025-01-28T08:39:32.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41115
24122025-01-28T08:39:32.370ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24132025-01-28T08:39:32.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24142025-01-28T08:39:32.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92026 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41115 req_id = 684ae829-989a-4623-9604-c09bef0dbb6c response_code = 204 uri = /switch-ports
24152025-01-28T08:39:32.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41115 req_id = 334a62da-b7d4-49bc-83f1-bfec313aaa76 response_code = 200 uri = /network-bootstore-config
24162025-01-28T08:39:48.168ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7330 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = d78b8e3e-39f4-440b-9343-655cee29c989 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
24172025-01-28T08:39:52.016ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42264
24182025-01-28T08:39:52.016ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42264 req_id = 22bc0865-cb01-4ac7-aa74-daa906b15974 response_code = 200 uri = /baseboard
24192025-01-28T08:40:00.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40502
24202025-01-28T08:40:00.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40502 req_id = d1eea012-d7f5-48aa-ac65-b962c9c36030 response_code = 200 uri = /vpc-routes
24212025-01-28T08:40:01.007ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
24222025-01-28T08:40:01.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40502 req_id = cdd76a00-4418-44c6-8bca-a1cd58b3052c response_code = 204 uri = /eip-gateways
24232025-01-28T08:40:01.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40502 req_id = 385edf38-66a3-46da-9183-1816f26f0321 response_code = 204 uri = /vpc-routes
24242025-01-28T08:40:01.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37145
24252025-01-28T08:40:01.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37145 req_id = d9807e64-04e2-40b1-94b1-5002977c33f3 response_code = 200 uri = /v2p
24262025-01-28T08:40:01.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42491
24272025-01-28T08:40:01.196ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24282025-01-28T08:40:01.243ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24292025-01-28T08:40:01.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101024 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42491 req_id = c0dfaa1b-6bb4-406b-ac4d-4382f3fb6155 response_code = 204 uri = /switch-ports
24302025-01-28T08:40:01.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42491 req_id = d542aac6-0b1e-45ba-a101-2a37f5985662 response_code = 200 uri = /network-bootstore-config
24312025-01-28T08:40:01.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52349
24322025-01-28T08:40:01.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52349 req_id = 5eda8e5d-4ee4-4597-9628-d631cf2b96cb response_code = 200 uri = /vpc-routes
24332025-01-28T08:40:01.369ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
24342025-01-28T08:40:01.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52349 req_id = 835f9854-10b4-4167-8744-78520f2b4c55 response_code = 204 uri = /eip-gateways
24352025-01-28T08:40:01.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52349 req_id = 38f7f7d1-f0ce-4803-b2a1-e6f4da04567e response_code = 204 uri = /vpc-routes
24362025-01-28T08:40:01.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61755
24372025-01-28T08:40:01.494ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24382025-01-28T08:40:01.532ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24392025-01-28T08:40:01.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93490 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61755 req_id = ce036b53-0fd4-426b-a7e6-e1884f1165fa response_code = 204 uri = /switch-ports
24402025-01-28T08:40:01.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49872
24412025-01-28T08:40:01.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61755 req_id = 82b56874-4e9c-4296-966b-cdd453fbbe99 response_code = 200 uri = /network-bootstore-config
24422025-01-28T08:40:01.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49872 req_id = ca8364fa-0c7b-4952-a826-a4499a00b9dc response_code = 200 uri = /v2p
24432025-01-28T08:40:01.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61187
24442025-01-28T08:40:01.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61187 req_id = e8ef4a34-9701-4f75-9b31-fa831f7c69d8 response_code = 200 uri = /vpc-routes
24452025-01-28T08:40:02.031ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
24462025-01-28T08:40:02.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61187 req_id = 922cbba3-5793-434e-98cf-af068413720a response_code = 204 uri = /eip-gateways
24472025-01-28T08:40:02.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61187 req_id = c52289e0-4388-497f-9d92-727620623153 response_code = 204 uri = /vpc-routes
24482025-01-28T08:40:02.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58611
24492025-01-28T08:40:02.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58611 req_id = 2d44dee4-ed5f-4414-b765-d605e7ec2ee7 response_code = 200 uri = /v2p
24502025-01-28T08:40:02.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35861
24512025-01-28T08:40:02.146ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24522025-01-28T08:40:02.181ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24532025-01-28T08:40:02.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91816 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35861 req_id = 3590d6dc-bbaa-4434-9aec-64e6817d09e9 response_code = 204 uri = /switch-ports
24542025-01-28T08:40:02.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35861 req_id = 7d32bf67-8f4f-4750-8b75-79a5b0a300c3 response_code = 200 uri = /network-bootstore-config
24552025-01-28T08:40:18.168ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7300 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 05045104-705c-46f3-94f4-06d60ce2fc15 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
24562025-01-28T08:40:22.048ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57450
24572025-01-28T08:40:22.048ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57450 req_id = d6451b22-bec8-43be-bbe8-492bd374d5ce response_code = 200 uri = /baseboard
24582025-01-28T08:40:31.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33908
24592025-01-28T08:40:31.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33908 req_id = 55c07d05-6444-4b9b-a729-b9c18912b58c response_code = 200 uri = /v2p
24602025-01-28T08:40:31.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44209
24612025-01-28T08:40:31.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44209 req_id = e32b281a-a382-4a8e-94af-f61f0d5a4acc response_code = 200 uri = /vpc-routes
24622025-01-28T08:40:31.269ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
24632025-01-28T08:40:31.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44209 req_id = 780891c3-c4ca-47d9-947a-23cbfabe3ffa response_code = 204 uri = /eip-gateways
24642025-01-28T08:40:31.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44209 req_id = 3769457c-c28c-4d1d-8a7d-70d71239a620 response_code = 204 uri = /vpc-routes
24652025-01-28T08:40:31.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48507
24662025-01-28T08:40:31.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48507 req_id = 1b4b6a58-3936-44dc-bb34-30bcf8fbfc72 response_code = 200 uri = /vpc-routes
24672025-01-28T08:40:31.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42486
24682025-01-28T08:40:31.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24692025-01-28T08:40:31.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24702025-01-28T08:40:31.539ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-zones.json file = common/src/ledger.rs:177
24712025-01-28T08:40:31.540ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-zones.json file = common/src/ledger.rs:177
24722025-01-28T08:40:31.556ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24732025-01-28T08:40:31.556ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1eaf2938-a2ac-484f-832d-16d88783efae
24742025-01-28T08:40:31.570ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
24752025-01-28T08:40:31.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48507 req_id = 7cdb6ad5-288f-4918-81d0-a99524e78742 response_code = 204 uri = /eip-gateways
24762025-01-28T08:40:31.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 456 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48507 req_id = 571d8781-e6b4-4090-8878-0b738104102f response_code = 204 uri = /vpc-routes
24772025-01-28T08:40:31.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62419
24782025-01-28T08:40:31.586ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24792025-01-28T08:40:31.590ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24802025-01-28T08:40:31.590ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9
24812025-01-28T08:40:31.623ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24822025-01-28T08:40:31.623ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6
24832025-01-28T08:40:31.635ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24842025-01-28T08:40:31.653ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24852025-01-28T08:40:31.653ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_352e06d5-ecf0-4843-af74-5fa99efbd226
24862025-01-28T08:40:31.684ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24872025-01-28T08:40:31.684ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e
24882025-01-28T08:40:31.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120247 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62419 req_id = f8e48b8e-29cf-468e-aa8b-8d03c5cce7db response_code = 204 uri = /switch-ports
24892025-01-28T08:40:31.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62419 req_id = 7d30ab84-4ab0-45b7-afd2-80ffae8edd28 response_code = 200 uri = /network-bootstore-config
24902025-01-28T08:40:31.711ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24912025-01-28T08:40:31.711ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a5440209-1de6-4cf7-8077-0c0703036684
24922025-01-28T08:40:31.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43326
24932025-01-28T08:40:31.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63885
24942025-01-28T08:40:31.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63885 req_id = 2a8e2386-bc6a-4932-8e9e-869472735073 response_code = 200 uri = /v2p
24952025-01-28T08:40:31.726ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24962025-01-28T08:40:31.726ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24972025-01-28T08:40:31.726ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-zones.json file = common/src/ledger.rs:177
24982025-01-28T08:40:31.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60843
24992025-01-28T08:40:31.731ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-zones.json file = common/src/ledger.rs:177
25002025-01-28T08:40:31.731ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25012025-01-28T08:40:31.740ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25022025-01-28T08:40:31.741ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50
25032025-01-28T08:40:31.756ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25042025-01-28T08:40:31.756ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1eaf2938-a2ac-484f-832d-16d88783efae
25052025-01-28T08:40:31.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25062025-01-28T08:40:31.779ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25072025-01-28T08:40:31.779ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9
25082025-01-28T08:40:31.794ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25092025-01-28T08:40:31.794ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4
25102025-01-28T08:40:31.810ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25112025-01-28T08:40:31.810ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6
25122025-01-28T08:40:31.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47532
25132025-01-28T08:40:31.824ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25142025-01-28T08:40:31.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25152025-01-28T08:40:31.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25162025-01-28T08:40:31.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25172025-01-28T08:40:31.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25182025-01-28T08:40:31.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25192025-01-28T08:40:31.824ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25202025-01-28T08:40:31.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47532 req_id = 0baa7aa9-d4ae-480b-b001-348f466532e4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25212025-01-28T08:40:31.824ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25222025-01-28T08:40:31.824ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53
25232025-01-28T08:40:31.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60843 req_id = b4e81eba-02a4-4881-b119-1fb2097f65b9 response_code = 204 uri = /switch-ports
25242025-01-28T08:40:31.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50988
25252025-01-28T08:40:31.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60843 req_id = ffe76497-2ebb-47c1-8fd2-4199ff86372d response_code = 200 uri = /network-bootstore-config
25262025-01-28T08:40:31.843ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25272025-01-28T08:40:31.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25282025-01-28T08:40:31.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25292025-01-28T08:40:31.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 304262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42486 req_id = c90369a6-d9eb-4fbe-b3fb-b714e58f487e response_code = 200 uri = /inventory
25302025-01-28T08:40:31.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25312025-01-28T08:40:31.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25322025-01-28T08:40:31.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25332025-01-28T08:40:31.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25342025-01-28T08:40:31.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 869 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50988 req_id = 673eff5d-cf7d-4fdc-90f7-77ed56a74559 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25352025-01-28T08:40:31.850ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25362025-01-28T08:40:31.850ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_352e06d5-ecf0-4843-af74-5fa99efbd226
25372025-01-28T08:40:31.884ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25382025-01-28T08:40:31.884ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e
25392025-01-28T08:40:31.921ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25402025-01-28T08:40:31.922ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a5440209-1de6-4cf7-8077-0c0703036684
25412025-01-28T08:40:31.956ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25422025-01-28T08:40:31.956ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50
25432025-01-28T08:40:31.990ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25442025-01-28T08:40:31.990ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4
25452025-01-28T08:40:32.023ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25462025-01-28T08:40:32.023ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53
25472025-01-28T08:40:32.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 323680 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43326 req_id = c782d5e9-3f2e-4ccf-a6aa-eb7d29776ae6 response_code = 200 uri = /inventory
25482025-01-28T08:40:32.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64256
25492025-01-28T08:40:32.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64256 req_id = e6a25a1f-a8cc-4144-bb10-57b1c842e611 response_code = 200 uri = /vpc-routes
25502025-01-28T08:40:32.344ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
25512025-01-28T08:40:32.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64256 req_id = b9e4b360-b28b-4e4d-b137-133c75fc42fd response_code = 204 uri = /eip-gateways
25522025-01-28T08:40:32.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64256 req_id = 56d66cbe-3569-4ff1-ba85-f037854f1f1b response_code = 204 uri = /vpc-routes
25532025-01-28T08:40:32.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56634
25542025-01-28T08:40:32.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25552025-01-28T08:40:32.427ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25562025-01-28T08:40:32.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104830 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56634 req_id = aa70d57c-8fdf-445a-8718-b8a4c4cd60c4 response_code = 204 uri = /switch-ports
25572025-01-28T08:40:32.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33869
25582025-01-28T08:40:32.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33869 req_id = f0e7208e-b8c9-4dd8-9d8d-a397633cd377 response_code = 200 uri = /v2p
25592025-01-28T08:40:32.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56634 req_id = f51f9093-0ca9-4e48-aae3-5c196ddc8cfe response_code = 200 uri = /network-bootstore-config
25602025-01-28T08:40:32.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41267
25612025-01-28T08:40:32.571ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25622025-01-28T08:40:32.571ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25632025-01-28T08:40:32.571ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/config/omicron-zones.json file = common/src/ledger.rs:177
25642025-01-28T08:40:32.572ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/config/omicron-zones.json file = common/src/ledger.rs:177
25652025-01-28T08:40:32.584ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1eaf2938-a2ac-484f-832d-16d88783efae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25662025-01-28T08:40:32.584ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1eaf2938-a2ac-484f-832d-16d88783efae
25672025-01-28T08:40:32.607ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25682025-01-28T08:40:32.607ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9
25692025-01-28T08:40:32.629ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c817f79-1d14-4008-a5e7-be06bcd83ba6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25702025-01-28T08:40:32.629ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5c817f79-1d14-4008-a5e7-be06bcd83ba6
25712025-01-28T08:40:32.649ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 352e06d5-ecf0-4843-af74-5fa99efbd226 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25722025-01-28T08:40:32.649ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_352e06d5-ecf0-4843-af74-5fa99efbd226
25732025-01-28T08:40:32.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36309
25742025-01-28T08:40:32.653ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8878cfd3-5edd-4a75-9869-ca3070bd649c, kind: Service { id: fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7 }, name: Name("external-dns-fd6e214c-6c25-4400-9ba1-1dd0fd4d17f7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 55])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79d4f4a-b317-401d-be05-09f9f6c2ca48, kind: Service { id: 6dd3b16a-15d8-4d3c-bb04-506e7ba24671 }, name: Name("external-dns-6dd3b16a-15d8-4d3c-bb04-506e7ba24671"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0443e352-5d90-4898-b0e1-b2f5bab119ba, kind: Service { id: c0b76181-3caf-4143-9524-623c025e89cb }, name: Name("nexus-c0b76181-3caf-4143-9524-623c025e89cb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7081b447-0041-4655-9bee-124dcdf69918, kind: Service { id: 0c766554-1775-42c8-a58a-b13904a6537f }, name: Name("nexus-0c766554-1775-42c8-a58a-b13904a6537f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8919df88-7756-42da-a985-7b7ac91b6263, kind: Service { id: 5b00a6ac-8f4d-4247-8546-4d4743dcb0a8 }, name: Name("nexus-5b00a6ac-8f4d-4247-8546-4d4743dcb0a8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 23])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25752025-01-28T08:40:32.654ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25762025-01-28T08:40:32.654ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25772025-01-28T08:40:32.654ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25782025-01-28T08:40:32.654ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25792025-01-28T08:40:32.654ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25802025-01-28T08:40:32.654ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25812025-01-28T08:40:32.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 566 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36309 req_id = 8e13a18e-da23-4201-b797-c139318dc75a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25822025-01-28T08:40:32.670ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 65f70e9d-f097-45c2-b78f-8e8c52c0855e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25832025-01-28T08:40:32.670ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_65f70e9d-f097-45c2-b78f-8e8c52c0855e
25842025-01-28T08:40:32.690ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a5440209-1de6-4cf7-8077-0c0703036684 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25852025-01-28T08:40:32.690ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a5440209-1de6-4cf7-8077-0c0703036684
25862025-01-28T08:40:32.711ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 72e3aa90-129e-420c-961e-0b8eb9c32b50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25872025-01-28T08:40:32.711ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_72e3aa90-129e-420c-961e-0b8eb9c32b50
25882025-01-28T08:40:32.730ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16ab1080-f20a-4d32-aa52-5837725fb1c4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25892025-01-28T08:40:32.730ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16ab1080-f20a-4d32-aa52-5837725fb1c4
25902025-01-28T08:40:32.750ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a4c32692-ab15-409f-bef7-ff53a7c22c53 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25912025-01-28T08:40:32.750ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a4c32692-ab15-409f-bef7-ff53a7c22c53
25922025-01-28T08:40:32.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190448 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41267 req_id = 22256c16-2666-4a31-92ad-b42ed77aa1e0 response_code = 200 uri = /inventory
25932025-01-28T08:40:48.168ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7101 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = c627a63f-f602-468a-a70e-c08cf9324e5d response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
25942025-01-28T08:40:52.081ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61142
25952025-01-28T08:40:52.082ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61142 req_id = 6481cf28-a310-4c45-b35e-b348425b7738 response_code = 200 uri = /baseboard
25962025-01-28T08:41:00.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50460
25972025-01-28T08:41:00.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50460 req_id = ebe4de71-1a65-44c7-8302-b1989371086f response_code = 200 uri = /vpc-routes
25982025-01-28T08:41:01.031ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
25992025-01-28T08:41:01.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50460 req_id = d89f4055-ae6c-45f6-9a5a-e9ad23821a29 response_code = 204 uri = /eip-gateways
26002025-01-28T08:41:01.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50460 req_id = f5ff8bf5-d49c-4c2c-97ac-3dff267f555a response_code = 204 uri = /vpc-routes
26012025-01-28T08:41:01.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44356
26022025-01-28T08:41:01.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44356 req_id = 139fd6fb-655a-4bc3-9a70-64a0406a0466 response_code = 200 uri = /v2p
26032025-01-28T08:41:01.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41523
26042025-01-28T08:41:01.086ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26052025-01-28T08:41:01.123ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26062025-01-28T08:41:01.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93326 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41523 req_id = 907f0c44-3d20-41d4-ab6b-f521c5c87105 response_code = 204 uri = /switch-ports
26072025-01-28T08:41:01.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41523 req_id = 89257083-8f9a-4b5c-aef2-5af09851ffd4 response_code = 200 uri = /network-bootstore-config
26082025-01-28T08:41:01.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51293
26092025-01-28T08:41:01.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51293 req_id = 691353a5-dc00-4df5-977f-2561e085a3c1 response_code = 200 uri = /vpc-routes
26102025-01-28T08:41:01.425ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
26112025-01-28T08:41:01.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51293 req_id = 813f6894-0e39-4307-95ae-d7d60ec6d44d response_code = 204 uri = /eip-gateways
26122025-01-28T08:41:01.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48653
26132025-01-28T08:41:01.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48653 req_id = 0e1cf6cf-60df-41e0-9f0c-1af908406305 response_code = 200 uri = /v2p
26142025-01-28T08:41:01.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51293 req_id = bba0e245-b7f9-4562-8c3e-3149780c6255 response_code = 204 uri = /vpc-routes
26152025-01-28T08:41:01.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34831
26162025-01-28T08:41:01.498ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26172025-01-28T08:41:01.535ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26182025-01-28T08:41:01.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34831 req_id = 18f28627-b764-439d-a621-2b8d1942c373 response_code = 204 uri = /switch-ports
26192025-01-28T08:41:01.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34831 req_id = 40a9d386-18f3-4319-9159-063cdd7beeaf response_code = 200 uri = /network-bootstore-config
26202025-01-28T08:41:02.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56974
26212025-01-28T08:41:02.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56974 req_id = d967b4b9-e772-449f-b8cb-61cbd0f0bcd9 response_code = 200 uri = /vpc-routes
26222025-01-28T08:41:02.099ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
26232025-01-28T08:41:02.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56974 req_id = d40cf984-a930-4ee4-9479-14bc515183ea response_code = 204 uri = /eip-gateways
26242025-01-28T08:41:02.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56974 req_id = e6e421fe-e749-4aec-9baf-6a2110fc0aae response_code = 204 uri = /vpc-routes
26252025-01-28T08:41:02.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56317
26262025-01-28T08:41:02.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56317 req_id = f96f343e-b6fc-49cb-b3f5-faebdd8dd14b response_code = 200 uri = /v2p
26272025-01-28T08:41:02.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38198
26282025-01-28T08:41:02.213ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26292025-01-28T08:41:02.253ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26302025-01-28T08:41:02.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97447 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38198 req_id = da0064ce-3fa9-4940-9a22-4a717639e525 response_code = 204 uri = /switch-ports
26312025-01-28T08:41:02.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38198 req_id = 559dc4a1-640e-4c79-b659-9787523f47af response_code = 200 uri = /network-bootstore-config
26322025-01-28T08:41:18.169ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7486 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 64dab708-987a-4305-a84b-7d8956be7f93 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
26332025-01-28T08:41:22.115ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49285
26342025-01-28T08:41:22.115ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49285 req_id = 1e43c4a3-23ce-4221-8a32-291221c8c12d response_code = 200 uri = /baseboard
26352025-01-28T08:41:31.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56916
26362025-01-28T08:41:31.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56916 req_id = 5796b5ec-5982-4ec5-8c66-6d92f4d7b4ad response_code = 200 uri = /vpc-routes
26372025-01-28T08:41:31.085ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
26382025-01-28T08:41:31.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56916 req_id = c646b4cc-b7b2-45a5-9073-41c79fe41e0c response_code = 204 uri = /eip-gateways
26392025-01-28T08:41:31.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58801
26402025-01-28T08:41:31.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58801 req_id = 2bfcee3a-17ad-45f8-8737-bdb1ff4ba316 response_code = 200 uri = /v2p
26412025-01-28T08:41:31.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56916 req_id = 4dee23a6-440f-4efc-967d-57768831581c response_code = 204 uri = /vpc-routes
26422025-01-28T08:41:31.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63872
26432025-01-28T08:41:31.280ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26442025-01-28T08:41:31.328ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26452025-01-28T08:41:31.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105738 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63872 req_id = 873ea564-6175-4b97-8a36-231c55e48830 response_code = 204 uri = /switch-ports
26462025-01-28T08:41:31.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63872 req_id = f19cd088-7a94-49e3-b16d-d6f85524acb6 response_code = 200 uri = /network-bootstore-config
26472025-01-28T08:41:31.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36911
26482025-01-28T08:41:31.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36911 req_id = 00351eea-a9ee-4fb9-bc84-e5955a03cfb9 response_code = 200 uri = /v2p
26492025-01-28T08:41:31.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43460
26502025-01-28T08:41:31.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43460 req_id = 34965a63-915e-40e5-843e-db89d743c3ac response_code = 200 uri = /vpc-routes
26512025-01-28T08:41:31.588ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
26522025-01-28T08:41:31.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43460 req_id = b606d4a5-973e-4a64-9946-b49a14d40dbd response_code = 204 uri = /eip-gateways
26532025-01-28T08:41:31.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43460 req_id = 08431fa8-5a3f-4131-8a7e-978314ce3375 response_code = 204 uri = /vpc-routes
26542025-01-28T08:41:31.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33252
26552025-01-28T08:41:31.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26562025-01-28T08:41:31.779ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26572025-01-28T08:41:31.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88384 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33252 req_id = e7757983-461d-4768-9783-a3799138cdf1 response_code = 204 uri = /switch-ports
26582025-01-28T08:41:31.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33252 req_id = ea4a32dc-b0c1-4b1a-bb68-bc8941fa2ebc response_code = 200 uri = /network-bootstore-config
26592025-01-28T08:41:32.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52430
26602025-01-28T08:41:32.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52430 req_id = 95de2db9-e039-49d5-9f2c-d16ec3acb363 response_code = 200 uri = /vpc-routes
26612025-01-28T08:41:32.235ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
26622025-01-28T08:41:32.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52430 req_id = a9f3dd17-239d-4572-98ef-141a7331271b response_code = 204 uri = /eip-gateways
26632025-01-28T08:41:32.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55981
26642025-01-28T08:41:32.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55981 req_id = 09db832a-cff0-4e7d-aa16-b677ca0b439c response_code = 200 uri = /v2p
26652025-01-28T08:41:32.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52430 req_id = 560207f1-54ee-416b-826d-739d6e11bb82 response_code = 204 uri = /vpc-routes
26662025-01-28T08:41:32.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40302
26672025-01-28T08:41:32.377ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26682025-01-28T08:41:32.413ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26692025-01-28T08:41:32.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90701 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40302 req_id = 5a55d181-ae16-4213-8548-f7e8f7fc39ff response_code = 204 uri = /switch-ports
26702025-01-28T08:41:32.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40302 req_id = 45a49402-caae-4105-b36d-26a63bb0c3b4 response_code = 200 uri = /network-bootstore-config
26712025-01-28T08:41:48.169ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7516 local_addr = [fd00:1122:3344:101::1]:51492 method = GET remote_addr = [fd00:1122:3344:101::d]:64358 req_id = 6f20d46c-7dba-471c-b33d-9e1836f33ba1 response_code = 200 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 uri = /09b4ce33-23b9-42cf-84fa-bef739079982
26722025-01-28T08:41:48.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53231
26732025-01-28T08:41:48.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53231 req_id = 93b9ebd1-b2ca-4d01-b5ea-463b449199fd response_code = 200 uri = /v2p
26742025-01-28T08:41:48.492ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(9012395) }
26752025-01-28T08:41:48.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 488 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53231 req_id = bc8df1b7-1971-4148-95ac-fb4bdd706cde response_code = 204 uri = /v2p
26762025-01-28T08:41:48.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44870
26772025-01-28T08:41:48.668ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e4b0e1d1-c165-4d16-bebc-421ab35dd79a, kind: Instance { id: c34f9a16-a829-4623-b161-68417d56d864 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9012395), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e4b0e1d1-c165-4d16-bebc-421ab35dd79a, kind: Instance { id: c34f9a16-a829-4623-b161-68417d56d864 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9012395), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e4b0e1d1-c165-4d16-bebc-421ab35dd79a, kind: Instance { id: c34f9a16-a829-4623-b161-68417d56d864 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9012395), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9012395))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e4b0e1d1-c165-4d16-bebc-421ab35dd79a, kind: Instance { id: c34f9a16-a829-4623-b161-68417d56d864 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9012395), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 18559f69-b48a-4209-b03e-0e5e4f456152, slot: 0, read_only: false, vcr_json: .., name: "disk-41eeb4d0cd6" }], boot_settings: Some(InstanceBootSettings { order: [18559f69-b48a-4209-b03e-0e5e4f456152] }), cloud_init_bytes: Some(..) } instance_id = c34f9a16-a829-4623-b161-68417d56d864 metadata = InstanceMetadata { silo_id: 3b1b7fea-e8d2-4d91-ad10-12353c6bbfff, project_id: 75c48bc7-055d-4e22-bba1-de7c840c7c2e } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-28T08:41:48.656798082Z }
26782025-01-28T08:41:48.668ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = c34f9a16-a829-4623-b161-68417d56d864 migration_id = None propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
26792025-01-28T08:41:48.668ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = c34f9a16-a829-4623-b161-68417d56d864 migration_id = None propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e4b0e1d1-c165-4d16-bebc-421ab35dd79a, kind: Instance { id: c34f9a16-a829-4623-b161-68417d56d864 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9012395), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e4b0e1d1-c165-4d16-bebc-421ab35dd79a, kind: Instance { id: c34f9a16-a829-4623-b161-68417d56d864 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9012395), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e4b0e1d1-c165-4d16-bebc-421ab35dd79a, kind: Instance { id: c34f9a16-a829-4623-b161-68417d56d864 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9012395), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9012395))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e4b0e1d1-c165-4d16-bebc-421ab35dd79a, kind: Instance { id: c34f9a16-a829-4623-b161-68417d56d864 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9012395), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 18559f69-b48a-4209-b03e-0e5e4f456152, slot: 0, read_only: false, vcr_json: .., name: "disk-41eeb4d0cd6" }], boot_settings: Some(InstanceBootSettings { order: [18559f69-b48a-4209-b03e-0e5e4f456152] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-28T08:41:48.656798082Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26802025-01-28T08:41:48.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 13663 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44870 req_id = 196d8ca5-fb74-44d5-92d2-a163ac1d2a7c response_code = 200 uri = /vmms/46785bdb-92a5-4b79-9f99-d935a65533b2
26812025-01-28T08:41:48.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44985
26822025-01-28T08:41:48.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 976 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44985 req_id = 9799b4e7-f191-41d0-9d88-995271fb7a95 response_code = 200 uri = /vmms/46785bdb-92a5-4b79-9f99-d935a65533b2/state
26832025-01-28T08:41:48.791ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 9012395 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26842025-01-28T08:41:48.792ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26852025-01-28T08:41:48.831ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2 file = illumos-utils/src/zone.rs:325 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
26862025-01-28T08:41:48.853ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2 file = illumos-utils/src/zone.rs:363 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
26872025-01-28T08:41:48.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62628
26882025-01-28T08:41:48.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62628 req_id = 8fda2952-7c24-40d1-9de4-dc09b4bba656 response_code = 200 uri = /vpc-routes
26892025-01-28T08:41:48.921ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {e4b0e1d1-c165-4d16-bebc-421ab35dd79a: {10.151.2.175: {fc9a26a5-d35e-4c41-8286-c782509d8a4a}, 10.151.2.176: {fc9a26a5-d35e-4c41-8286-c782509d8a4a}}} }
26902025-01-28T08:41:50.402ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
26912025-01-28T08:41:50.403ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2 zone file = illumos-utils/src/running_zone.rs:488 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 zone = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
26922025-01-28T08:41:50.604ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2") failed: Property not found. retry in 32.637783ms file = illumos-utils/src/svc.rs:42 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 zone = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
26932025-01-28T08:41:50.646ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2") failed: Property not found. retry in 87.81786ms file = illumos-utils/src/svc.rs:42 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 zone = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
26942025-01-28T08:41:50.747ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2") failed: Property not found. retry in 172.783527ms file = illumos-utils/src/svc.rs:42 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 zone = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
26952025-01-28T08:41:50.934ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2") failed: Property not found. retry in 567.746249ms file = illumos-utils/src/svc.rs:42 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 zone = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
26962025-01-28T08:41:51.516ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2") failed: Property not found. retry in 798.690547ms file = illumos-utils/src/svc.rs:42 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 zone = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
26972025-01-28T08:41:52.148ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58208
26982025-01-28T08:41:52.148ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58208 req_id = 593777c8-da8a-470e-a73a-10235f579ad7 response_code = 200 uri = /baseboard
26992025-01-28T08:41:52.325ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2") failed: Property not found. retry in 696.328308ms file = illumos-utils/src/svc.rs:42 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 zone = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
27002025-01-28T08:41:53.033ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2") failed: Property not found. retry in 649.316349ms file = illumos-utils/src/svc.rs:42 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 zone = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
27012025-01-28T08:41:53.694ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2") failed: Property not found. retry in 1.205568915s file = illumos-utils/src/svc.rs:42 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 zone = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
27022025-01-28T08:41:54.912ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2") failed: Property not found. retry in 1.07295024s file = illumos-utils/src/svc.rs:42 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 zone = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
27032025-01-28T08:41:56.016ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2 file = sled-agent/src/instance.rs:2068 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27042025-01-28T08:41:56.024ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2") failed: Property not found. retry in 69.842108ms file = illumos-utils/src/svc.rs:42 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27052025-01-28T08:41:56.105ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27062025-01-28T08:41:56.144ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27072025-01-28T08:41:56.220ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27082025-01-28T08:41:56.221ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-28T08:41:56.221305681Z } file = sled-agent/src/instance.rs:781 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27092025-01-28T08:41:56.221ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = c34f9a16-a829-4623-b161-68417d56d864 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-28T08:41:56.221305681Z } propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27102025-01-28T08:41:56.221ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-28T08:41:56.221305681Z }, migration_in: None, migration_out: None }
27112025-01-28T08:41:56.233ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
27122025-01-28T08:41:56.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7312368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62628 req_id = fd177a82-e455-46c3-af6b-e2eb8372e8ed response_code = 204 uri = /eip-gateways
27132025-01-28T08:41:56.295ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-28T08:41:56.295861206Z } file = sled-agent/src/instance.rs:781 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27142025-01-28T08:41:56.295ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = c34f9a16-a829-4623-b161-68417d56d864 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-28T08:41:56.295861206Z } propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27152025-01-28T08:41:56.295ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-28T08:41:56.295861206Z }, migration_in: None, migration_out: None }
27162025-01-28T08:41:56.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62628 req_id = 5235481c-7133-485b-933e-8fb5d127e57b response_code = 204 uri = /vpc-routes
27172025-01-28T08:42:00.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42544
27182025-01-28T08:42:00.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42544 req_id = 794d5bcb-2405-43e1-81e4-c2f0b0ea1cca response_code = 200 uri = /vpc-routes
27192025-01-28T08:42:00.991ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {e4b0e1d1-c165-4d16-bebc-421ab35dd79a: {10.151.2.176: {fc9a26a5-d35e-4c41-8286-c782509d8a4a}, 10.151.2.175: {fc9a26a5-d35e-4c41-8286-c782509d8a4a}}} }
27202025-01-28T08:42:00.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42544 req_id = e0a8f0fd-6c0d-4166-b41e-455c190c59f2 response_code = 204 uri = /eip-gateways
27212025-01-28T08:42:01.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56620
27222025-01-28T08:42:01.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 966 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56620 req_id = 1c19a76c-32a8-4592-aef2-aed6fca925c8 response_code = 200 uri = /vmms/46785bdb-92a5-4b79-9f99-d935a65533b2/state
27232025-01-28T08:42:01.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44690
27242025-01-28T08:42:01.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44690 req_id = 3f73e12a-c8b9-4949-a54d-945f5b14e529 response_code = 200 uri = /v2p
27252025-01-28T08:42:01.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42544 req_id = 6270b54f-a971-4d94-98e7-d68b1dd21407 response_code = 204 uri = /vpc-routes
27262025-01-28T08:42:01.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43920
27272025-01-28T08:42:01.313ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27282025-01-28T08:42:01.356ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27292025-01-28T08:42:01.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43920 req_id = 5c5347da-225a-4a13-bef4-3428699aa492 response_code = 204 uri = /switch-ports
27302025-01-28T08:42:01.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56900
27312025-01-28T08:42:01.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54168
27322025-01-28T08:42:01.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54168 req_id = 2faea317-4c0d-403f-bd0e-6c1bbf015c11 response_code = 200 uri = /vpc-routes
27332025-01-28T08:42:01.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43920 req_id = c91ca089-d06b-465e-93b8-f70ae02f56ac response_code = 200 uri = /network-bootstore-config
27342025-01-28T08:42:01.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56900 req_id = 0b0b1e9a-2a3f-4cd8-98cd-345f4c8d588a response_code = 200 uri = /vmms/46785bdb-92a5-4b79-9f99-d935a65533b2/state
27352025-01-28T08:42:01.435ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {e4b0e1d1-c165-4d16-bebc-421ab35dd79a: {10.151.2.176: {fc9a26a5-d35e-4c41-8286-c782509d8a4a}, 10.151.2.175: {fc9a26a5-d35e-4c41-8286-c782509d8a4a}}} }
27362025-01-28T08:42:01.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54168 req_id = 3371543e-336a-4bfa-a05e-c0ce0e0d9d19 response_code = 204 uri = /eip-gateways
27372025-01-28T08:42:01.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54168 req_id = 70358318-a99f-4b7b-b914-dc8879009e0f response_code = 204 uri = /vpc-routes
27382025-01-28T08:42:01.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40885
27392025-01-28T08:42:01.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40885 req_id = 14296cac-1a21-43df-86b6-322b73ae3180 response_code = 200 uri = /v2p
27402025-01-28T08:42:01.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41350
27412025-01-28T08:42:01.570ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27422025-01-28T08:42:01.609ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27432025-01-28T08:42:01.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93541 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41350 req_id = 8c1b5d50-a14b-4a8b-9d16-23a627f954fd response_code = 204 uri = /switch-ports
27442025-01-28T08:42:01.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41350 req_id = d3777bcf-53fe-413e-8741-890452c913d5 response_code = 200 uri = /network-bootstore-config
27452025-01-28T08:42:02.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58244
27462025-01-28T08:42:02.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58244 req_id = 21a11ca9-6570-4237-9e12-1d783efb98e9 response_code = 200 uri = /vmms/46785bdb-92a5-4b79-9f99-d935a65533b2/state
27472025-01-28T08:42:02.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46897
27482025-01-28T08:42:02.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46897 req_id = 8f443b0e-c4b1-40af-951a-b4d2635821ca response_code = 200 uri = /vpc-routes
27492025-01-28T08:42:02.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {e4b0e1d1-c165-4d16-bebc-421ab35dd79a: {10.151.2.176: {fc9a26a5-d35e-4c41-8286-c782509d8a4a}, 10.151.2.175: {fc9a26a5-d35e-4c41-8286-c782509d8a4a}}} }
27502025-01-28T08:42:02.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46897 req_id = 60230898-f55c-4f3c-8ce8-847e738be831 response_code = 204 uri = /eip-gateways
27512025-01-28T08:42:02.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45357
27522025-01-28T08:42:02.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45357 req_id = 9b5b67e5-fb7e-4e5b-b643-c30627b841d5 response_code = 200 uri = /v2p
27532025-01-28T08:42:02.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46897 req_id = 5525b253-8659-46f2-948e-34c47abe56a7 response_code = 204 uri = /vpc-routes
27542025-01-28T08:42:02.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51554
27552025-01-28T08:42:02.195ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27562025-01-28T08:42:02.237ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27572025-01-28T08:42:02.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51554 req_id = 56103d4c-b6c0-4799-9a33-666024c752b1 response_code = 204 uri = /switch-ports
27582025-01-28T08:42:02.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51554 req_id = b9b40a15-c213-414e-93fb-0f4406a8e14c response_code = 200 uri = /network-bootstore-config
27592025-01-28T08:42:06.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43779
27602025-01-28T08:42:06.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 508 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43779 req_id = 117a35bb-702b-493d-b848-e600e7fb9dbc response_code = 200 uri = /vmms/46785bdb-92a5-4b79-9f99-d935a65533b2/state
27612025-01-28T08:42:06.484ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-28T08:42:06.484002383Z } file = sled-agent/src/instance.rs:781 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27622025-01-28T08:42:06.484ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = c34f9a16-a829-4623-b161-68417d56d864 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-28T08:42:06.484002383Z } propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27632025-01-28T08:42:06.484ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-28T08:42:06.484002383Z }, migration_in: None, migration_out: None }
27642025-01-28T08:42:06.502ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-28T08:42:06.502570508Z } file = sled-agent/src/instance.rs:781 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27652025-01-28T08:42:06.502ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = c34f9a16-a829-4623-b161-68417d56d864 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-28T08:42:06.502570508Z } propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27662025-01-28T08:42:06.502ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27672025-01-28T08:42:06.502ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27682025-01-28T08:42:06.502ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 12834758219789643591 n_samples = 6 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
27692025-01-28T08:42:06.502ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 17645079441070559920 n_samples = 6 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
27702025-01-28T08:42:06.502ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27712025-01-28T08:42:06.503ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/08f533e4-d3c4-4dd8-bb4b-4913baff1188/debug/bundle/zone", "/pool/int/58c81fd8-118a-4cf1-8c66-964d853e036f/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/1eaf2938-a2ac-484f-832d-16d88783efae/crypt/debug", "/pool/ext/54be4ab9-0890-4dc3-b8b7-6e3c99c09ab9/crypt/debug", "/pool/ext/5c817f79-1d14-4008-a5e7-be06bcd83ba6/crypt/debug", "/pool/ext/352e06d5-ecf0-4843-af74-5fa99efbd226/crypt/debug", "/pool/ext/65f70e9d-f097-45c2-b78f-8e8c52c0855e/crypt/debug", "/pool/ext/a5440209-1de6-4cf7-8077-0c0703036684/crypt/debug", "/pool/ext/72e3aa90-129e-420c-961e-0b8eb9c32b50/crypt/debug", "/pool/ext/16ab1080-f20a-4d32-aa52-5837725fb1c4/crypt/debug", "/pool/ext/a4c32692-ab15-409f-bef7-ff53a7c22c53/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2
27722025-01-28T08:42:07.157ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2", bundle_id: 01c5befe-63d3-4180-84c8-561095d0395c }, time_created: 2025-01-28T08:42:06.504386004Z, version: 0, cause: TerminatedInstance }
27732025-01-28T08:42:07.157ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_46785bdb-92a5-4b79-9f99-d935a65533b2 file = sled-agent/src/instance.rs:1314 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27742025-01-28T08:42:08.963ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27752025-01-28T08:42:08.980ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(9012395), kind: System }
27762025-01-28T08:42:08.980ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(9012395), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27772025-01-28T08:42:08.981ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-28T08:42:08.981040553Z }, migration_in: None, migration_out: None }
27782025-01-28T08:42:09.016ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-28T08:42:08.981040553Z }, migration_in: None, migration_out: None }
27792025-01-28T08:42:09.021ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = c34f9a16-a829-4623-b161-68417d56d864 propolis_id = 46785bdb-92a5-4b79-9f99-d935a65533b2
27802025-01-28T08:42:09.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51588
27812025-01-28T08:42:09.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51588 req_id = 7c77bed6-bba1-47f7-96fd-ff36a0f884f5 response_code = 200 uri = /vpc-routes
27822025-01-28T08:42:09.729ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {e4b0e1d1-c165-4d16-bebc-421ab35dd79a: {10.151.2.175: {fc9a26a5-d35e-4c41-8286-c782509d8a4a}, 10.151.2.176: {fc9a26a5-d35e-4c41-8286-c782509d8a4a}}} }
27832025-01-28T08:42:09.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51588 req_id = ce4a8eee-022f-4250-b4dc-e319f159ee38 response_code = 204 uri = /eip-gateways
27842025-01-28T08:42:09.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51588 req_id = 3821f829-23e7-410f-ad4d-7e4ef5678797 response_code = 204 uri = /vpc-routes
27852025-01-28T08:42:09.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64997
27862025-01-28T08:42:09.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64997 req_id = 3b8776ed-f5c7-4244-a7d3-a1fe7789f5fa response_code = 200 uri = /v2p
27872025-01-28T08:42:10.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53660
27882025-01-28T08:42:10.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53660 req_id = 5cbbf901-582f-4bb3-90d3-119d8e376e70 response_code = 200 uri = /v2p
27892025-01-28T08:42:10.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36186
27902025-01-28T08:42:10.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36186 req_id = e55197bf-4023-46dc-a812-8e13596adabf response_code = 200 uri = /vpc-routes
27912025-01-28T08:42:10.378ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
27922025-01-28T08:42:10.378ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982
27932025-01-28T08:42:10.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36186 req_id = 23da890a-d5a9-4864-80af-1b9741a36bf1 response_code = 204 uri = /eip-gateways
27942025-01-28T08:42:10.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36186 req_id = 3f9f1188-9f5e-4ad1-9a8a-512279aef697 response_code = 204 uri = /vpc-routes
27952025-01-28T08:42:11.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40121
27962025-01-28T08:42:11.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40121 req_id = 7ea3a958-4b8d-4da3-9ef4-d0d8ac86862b response_code = 200 uri = /vpc-routes
27972025-01-28T08:42:11.236ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 09b4ce33-23b9-42cf-84fa-bef739079982 values = ExternalIpGatewayMap { mappings: {} }
27982025-01-28T08:42:11.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40121 req_id = 2454afd3-e056-44dd-9730-11d6e18799bd response_code = 204 uri = /eip-gateways
27992025-01-28T08:42:11.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40121 req_id = 9a44a04d-bd94-45a0-885d-4bf519ab4448 response_code = 204 uri = /vpc-routes