Max level shown:
1 [ Jan 18 05:31:10 Enabled. ]
2 [ Jan 18 05:31:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 18 05:31:10 Method "start" exited with status 0. ]
4 [ Jan 18 05:31:10 Rereading configuration. ]
5 [ Jan 18 05:31:10 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-18T05:31:10.558ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-18T05:31:10.558ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-18T05:31:10.611ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-18T05:31:10.611ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-18T05:31:10.728ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-18T05:31:10.737ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-18T05:31:10.744ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-18T05:31:11.345ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-01-18T05:31:11.480ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-18T05:31:11.480ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-18T05:31:11.480ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-18T05:31:11.480ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-18T05:31:11.480ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-01-18T05:31:11.480ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-01-18T05:31:11.483ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-18T05:31:11.483ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-18T05:31:11.483ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-18T05:31:11.483ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-18T05:31:11.483ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-18T05:31:11.483ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-18T05:31:11.483ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-18T05:31:11.483ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-18T05:31:11.483ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-18T05:31:11.495ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-18T05:31:11.495ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool)
322025-01-18T05:31:11.595ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal }
332025-01-18T05:31:11.957ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-18T05:31:11.957ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-18T05:31:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-18T05:31:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-18T05:31:11.957ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-18T05:31:11.957ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-18T05:31:11.957ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-18T05:31:11.966ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-18T05:31:11.966ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool)
422025-01-18T05:31:12.056ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal }
432025-01-18T05:31:12.414ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-18T05:31:12.414ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-18T05:31:12.414ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-18T05:31:12.414ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-18T05:31:12.414ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-18T05:31:12.414ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-18T05:31:12.414ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
522025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532025-01-18T05:31:12.414ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
542025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552025-01-18T05:31:12.414ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-18T05:31:12.414ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-18T05:31:12.414ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-18T05:31:12.414ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-18T05:31:12.414ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-18T05:31:12.414ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-18T05:31:12.414ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-18T05:31:12.414ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-18T05:31:12.414ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-18T05:31:12.414ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-18T05:31:12.414ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-18T05:31:12.414ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-18T05:31:12.414ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-18T05:31:12.414ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-18T05:31:12.414ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-18T05:31:12.414ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-18T05:31:12.414ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-18T05:31:12.414ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-18T05:31:12.414ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-18T05:31:12.414ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-18T05:31:12.414ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-18T05:31:12.414ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-18T05:31:12.414ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-18T05:31:12.414ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-18T05:31:12.414ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922025-01-18T05:31:12.414ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-18T05:31:12.414ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-18T05:31:12.414ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-18T05:31:12.414ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-18T05:31:12.414ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992025-01-18T05:31:12.414ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1002025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-01-18T05:31:12.414ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-01-18T05:31:12.414ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-18T05:31:12.414ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-18T05:31:12.414ZINFOSledAgent (bootstore): No ledger in /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-01-18T05:31:12.414ZINFOSledAgent (bootstore): No ledger in /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-01-18T05:31:12.414ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-01-18T05:31:12.414ZINFOSledAgent (bootstore): No ledger in /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-01-18T05:31:12.414ZINFOSledAgent (bootstore): No ledger in /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-01-18T05:31:12.414ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-01-18T05:31:12.414ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-18T05:31:12.414ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-18T05:31:12.425ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132025-01-18T05:31:12.425ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1114, tv_nsec: 305687572 } time_to_next_cleanup = 599.999940399s
1142025-01-18T05:31:12.425ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1152025-01-18T05:31:12.425ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-18T05:31:12.425ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-18T05:31:12.425ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-18T05:31:12.428ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-01-18T05:31:12.430ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-01-18T05:31:12.431ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-18T05:31:12.431ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-18T05:31:12.431ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-18T05:31:12.431ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-18T05:31:12.431ZINFOSledAgent (RSS): No ledger in /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-18T05:31:12.431ZINFOSledAgent (RSS): No ledger in /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-18T05:31:12.431ZINFOSledAgent (RSS): No ledger in /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-18T05:31:12.431ZINFOSledAgent (RSS): No ledger in /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-18T05:31:12.431ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-18T05:31:12.431ZINFOSledAgent (RSS): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-18T05:31:12.431ZINFOSledAgent (RSS): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-18T05:31:12.431ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-18T05:31:12.431ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-18T05:31:12.431ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-18T05:31:12.431ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-18T05:31:12.431ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-01-18T05:31:12.431ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-01-18T05:31:12.431ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-01-18T05:31:12.431ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-01-18T05:31:12.432ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: bcda1f83-6e29-4607-a063-c64866d2cd5c (sled), rack_id: e5888020-2e37-4225-aaee-782292a70375, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-01-18T05:31:12.433ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1412025-01-18T05:31:12.433ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1422025-01-18T05:31:12.437ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-18T05:31:12.443ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-18T05:31:12.443ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-18T05:31:12.447ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-18T05:31:12.447ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-18T05:31:12.447ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:32827
1482025-01-18T05:31:12.448ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: bcda1f83-6e29-4607-a063-c64866d2cd5c (sled), rack_id: e5888020-2e37-4225-aaee-782292a70375, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-18T05:31:12.448ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-18T05:31:12.448ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-18T05:31:12.448ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-18T05:31:12.448ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-18T05:31:12.448ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-18T05:31:12.448ZINFOSledAgent (StorageManager): No ledger in /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-18T05:31:12.448ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562025-01-18T05:31:12.448ZINFOSledAgent (StorageManager): No ledger in /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-18T05:31:12.448ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-18T05:31:12.448ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-18T05:31:12.448ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-18T05:31:12.448ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-18T05:31:12.448ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-18T05:31:12.464ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-18T05:31:12.484ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-18T05:31:12.498ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
1652025-01-18T05:31:12.498ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1662025-01-18T05:31:12.498ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
1672025-01-18T05:31:12.498ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1682025-01-18T05:31:12.501ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1692025-01-18T05:31:12.505ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 145.753459ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e4c5da31-96f9-4da6-a2e7-918d3baa4021", "content-length": "124", "date": "Sat, 18 Jan 2025 05:31:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e4c5da31-96f9-4da6-a2e7-918d3baa4021" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-18T05:31:12.511ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_0ef62e45-6587-4c56-80fb-d82ceac2b8d7/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-18T05:31:12.536ZINFOSledAgent: successfully created encrypted zvol: name="oxi_0ef62e45-6587-4c56-80fb-d82ceac2b8d7/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-18T05:31:12.536ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_0ef62e45-6587-4c56-80fb-d82ceac2b8d7/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-18T05:31:12.541ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
1742025-01-18T05:31:12.541ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-18T05:31:12.541ZINFOSledAgent (BackingFs): Ensuring dataset oxi_0ef62e45-6587-4c56-80fb-d82ceac2b8d7/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-18T05:31:12.609ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772025-01-18T05:31:12.652ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782025-01-18T05:31:12.653ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 136.176404ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a7538e6b-ab14-4825-915f-37c36a2fc2ef", "content-length": "124", "date": "Sat, 18 Jan 2025 05:31:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a7538e6b-ab14-4825-915f-37c36a2fc2ef" } file = clients/ddm-admin-client/src/lib.rs:177
1792025-01-18T05:31:12.790ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-18T05:31:12.790ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 100.319484ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2b5dde0e-1a79-42f5-ba11-79593c4aa82a", "content-length": "124", "date": "Sat, 18 Jan 2025 05:31:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2b5dde0e-1a79-42f5-ba11-79593c4aa82a" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-18T05:31:12.836ZINFOSledAgent (BackingFs): Mounting oxi_0ef62e45-6587-4c56-80fb-d82ceac2b8d7/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-18T05:31:12.849ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-18T05:31:12.849ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-18T05:31:12.849ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-18T05:31:12.849ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-18T05:31:12.892ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-18T05:31:12.892ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 227.517544ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e56c2a8b-9990-4adf-8b09-f60015f8b9ee", "content-length": "124", "date": "Sat, 18 Jan 2025 05:31:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e56c2a8b-9990-4adf-8b09-f60015f8b9ee" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-18T05:31:13.120ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-18T05:31:13.121ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 147.046687ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4b64b50d-f0bf-47c7-84b3-2fcea3ac06ee", "content-length": "124", "date": "Sat, 18 Jan 2025 05:31:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4b64b50d-f0bf-47c7-84b3-2fcea3ac06ee" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-18T05:31:13.270ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-18T05:31:13.270ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 257.771656ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c1dd2c08-6d52-4ed0-9d9f-19c35f076cc4", "content-length": "124", "date": "Sat, 18 Jan 2025 05:31:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c1dd2c08-6d52-4ed0-9d9f-19c35f076cc4" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-18T05:31:13.529ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-18T05:31:13.530ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 278.780097ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "16ba4138-cdfd-4b45-8298-a42d049ce4bf", "content-length": "124", "date": "Sat, 18 Jan 2025 05:31:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "16ba4138-cdfd-4b45-8298-a42d049ce4bf" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-18T05:31:13.581ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
1952025-01-18T05:31:13.587ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:64085 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
1962025-01-18T05:31:13.587ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
1972025-01-18T05:31:13.587ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:64085 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = bcda1f83-6e29-4607-a063-c64866d2cd5c sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
1982025-01-18T05:31:13.588ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 226.004932ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
1992025-01-18T05:31:13.589ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2002025-01-18T05:31:13.589ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2012025-01-18T05:31:13.589ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2022025-01-18T05:31:13.589ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2032025-01-18T05:31:13.809ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042025-01-18T05:31:13.816ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 536.372258ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2052025-01-18T05:31:14.354ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 985.898541ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2062025-01-18T05:31:15.342ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.840331988s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2072025-01-18T05:31:16.187ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2082025-01-18T05:31:16.187ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2092025-01-18T05:31:16.187ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2102025-01-18T05:31:16.187ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2112025-01-18T05:31:16.187ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2122025-01-18T05:31:16.187ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2132025-01-18T05:31:16.189ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2142025-01-18T05:31:16.191ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2152025-01-18T05:31:16.191ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='2c53064d-075f-4696-be8f-f0fa3fbd79e2'/> <propval type="astring" name="rack_id" value='e5888020-2e37-4225-aaee-782292a70375'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe28:4ed8'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='e5888020-2e37-4225-aaee-782292a70375'/> <propval type="astring" name="sled_id" value='bcda1f83-6e29-4607-a063-c64866d2cd5c'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='bcda1f83-6e29-4607-a063-c64866d2cd5c'/> <propval type="astring" name="rack_uuid" value='e5888020-2e37-4225-aaee-782292a70375'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='bcda1f83-6e29-4607-a063-c64866d2cd5c'/> <propval type="astring" name="rack_uuid" value='e5888020-2e37-4225-aaee-782292a70375'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-18T05:31:16.191ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-18T05:31:16.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 26.955958ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-18T05:31:16.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 132.842904ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-18T05:31:16.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 280.573717ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-01-18T05:31:17.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 560.553239ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-18T05:31:17.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 799.59745ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-18T05:31:18.184ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.220348959s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2232025-01-18T05:31:18.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.115006909s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-01-18T05:31:20.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 738.252491ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-01-18T05:31:20.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 952.468286ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2262025-01-18T05:31:22.218ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/bcda1f83-6e29-4607-a063-c64866d2cd5c) file = sled-agent/src/nexus.rs:527 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2272025-01-18T05:31:22.248ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2282025-01-18T05:31:22.249ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2292025-01-18T05:31:22.250ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2302025-01-18T05:31:22.250ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312025-01-18T05:31:22.250ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322025-01-18T05:31:22.250ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-01-18T05:31:22.250ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-01-18T05:31:22.250ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352025-01-18T05:31:22.250ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362025-01-18T05:31:22.250ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2372025-01-18T05:31:22.250ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:32827
2382025-01-18T05:31:22.434ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2392025-01-18T05:31:22.434ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2402025-01-18T05:31:22.436ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.715670386s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2412025-01-18T05:31:22.440ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422025-01-18T05:31:22.440ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2432025-01-18T05:31:22.440ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442025-01-18T05:31:22.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42041
2452025-01-18T05:31:22.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-01-18T05:31:22.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2472025-01-18T05:31:22.729ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-01-18T05:31:22.729ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-zones.json file = common/src/ledger.rs:188
2492025-01-18T05:31:22.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 398 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42041 req_id = 3b976613-3777-4873-a9f9-5100550e7c5b response_code = 200 uri = /inventory
2502025-01-18T05:31:22.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42842
2512025-01-18T05:31:22.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42842 req_id = c3bfa551-f793-4797-9f1e-9569333db62e response_code = 200 uri = /sled-role
2522025-01-18T05:31:22.789ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 16340b12-beb7-4784-8d30-91b09e067cd7 (physical_disk), pool_id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 2648d71f-9660-4eae-8f1f-0e48631175da (physical_disk), pool_id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 2fb77b20-da4b-4caa-9a3a-484c50abe892 (physical_disk), pool_id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 4096fef0-99b9-4cd8-ba48-420dee7f7078 (physical_disk), pool_id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 68d207ab-125f-47a9-9521-8b0a3b0a1770 (physical_disk), pool_id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7513b350-740a-45c0-bb25-1fc86bf3673c (physical_disk), pool_id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 962a7f89-f0ca-4370-8c7b-bdbfb271b5c8 (physical_disk), pool_id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a071517f-8940-4810-84aa-ed04128e369f (physical_disk), pool_id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: ddca93c0-9599-43de-b6ac-24c8a293c318 (physical_disk), pool_id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2532025-01-18T05:31:22.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48704
2542025-01-18T05:31:22.789ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2552025-01-18T05:31:22.789ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 16340b12-beb7-4784-8d30-91b09e067cd7 (physical_disk), pool_id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 2648d71f-9660-4eae-8f1f-0e48631175da (physical_disk), pool_id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 2fb77b20-da4b-4caa-9a3a-484c50abe892 (physical_disk), pool_id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 4096fef0-99b9-4cd8-ba48-420dee7f7078 (physical_disk), pool_id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 68d207ab-125f-47a9-9521-8b0a3b0a1770 (physical_disk), pool_id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7513b350-740a-45c0-bb25-1fc86bf3673c (physical_disk), pool_id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 962a7f89-f0ca-4370-8c7b-bdbfb271b5c8 (physical_disk), pool_id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a071517f-8940-4810-84aa-ed04128e369f (physical_disk), pool_id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: ddca93c0-9599-43de-b6ac-24c8a293c318 (physical_disk), pool_id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2562025-01-18T05:31:22.789ZINFOSledAgent (StorageManager): No ledger in /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572025-01-18T05:31:22.789ZINFOSledAgent (StorageManager): No ledger in /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582025-01-18T05:31:22.789ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2592025-01-18T05:31:22.789ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2602025-01-18T05:31:22.789ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2612025-01-18T05:31:22.789ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2622025-01-18T05:31:22.789ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2632025-01-18T05:31:22.918ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2642025-01-18T05:31:22.918ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool)
2652025-01-18T05:31:23.382ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bcda1f83-6e29-4607-a063-c64866d2cd5c) file = sled-agent/src/probe_manager.rs:231 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2662025-01-18T05:31:23.603ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2672025-01-18T05:31:23.605ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5664636444645776685 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2682025-01-18T05:31:23.605ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11988985600415669928 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
2692025-01-18T05:31:23.654ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }
2702025-01-18T05:31:23.664ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2712025-01-18T05:31:23.664ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2722025-01-18T05:31:23.664ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2732025-01-18T05:31:23.664ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2742025-01-18T05:31:23.664ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752025-01-18T05:31:23.664ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762025-01-18T05:31:23.664ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2772025-01-18T05:31:23.700ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2782025-01-18T05:31:23.708ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crypt/zone file = sled-storage/src/dataset.rs:302
2792025-01-18T05:31:23.849ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417 file = sled-storage/src/dataset.rs:388
2802025-01-18T05:31:23.858ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2812025-01-18T05:31:23.858ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2822025-01-18T05:31:23.858ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2832025-01-18T05:31:23.858ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842025-01-18T05:31:23.858ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2852025-01-18T05:31:23.868ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2862025-01-18T05:31:23.868ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool)
2872025-01-18T05:31:23.960ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }
2882025-01-18T05:31:23.966ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2892025-01-18T05:31:23.966ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2902025-01-18T05:31:23.966ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2912025-01-18T05:31:23.966ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2922025-01-18T05:31:23.966ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932025-01-18T05:31:23.966ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942025-01-18T05:31:23.966ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2952025-01-18T05:31:24.004ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2962025-01-18T05:31:24.013ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone file = sled-storage/src/dataset.rs:302
2972025-01-18T05:31:24.149ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 file = sled-storage/src/dataset.rs:388
2982025-01-18T05:31:24.157ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2992025-01-18T05:31:24.157ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3002025-01-18T05:31:24.157ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3012025-01-18T05:31:24.157ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3022025-01-18T05:31:24.157ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032025-01-18T05:31:24.166ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3042025-01-18T05:31:24.166ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool)
3052025-01-18T05:31:24.259ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }
3062025-01-18T05:31:24.267ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3072025-01-18T05:31:24.267ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3082025-01-18T05:31:24.267ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3092025-01-18T05:31:24.267ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3102025-01-18T05:31:24.267ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112025-01-18T05:31:24.267ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122025-01-18T05:31:24.267ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3132025-01-18T05:31:24.301ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142025-01-18T05:31:24.309ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone file = sled-storage/src/dataset.rs:302
3152025-01-18T05:31:24.383ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bcda1f83-6e29-4607-a063-c64866d2cd5c) file = sled-agent/src/probe_manager.rs:231 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
3162025-01-18T05:31:24.449ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175 file = sled-storage/src/dataset.rs:388
3172025-01-18T05:31:24.457ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3182025-01-18T05:31:24.457ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3192025-01-18T05:31:24.457ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3202025-01-18T05:31:24.457ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3212025-01-18T05:31:24.457ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222025-01-18T05:31:24.468ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3232025-01-18T05:31:24.468ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool)
3242025-01-18T05:31:24.561ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }
3252025-01-18T05:31:24.568ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3262025-01-18T05:31:24.568ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3272025-01-18T05:31:24.568ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3282025-01-18T05:31:24.568ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3292025-01-18T05:31:24.568ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302025-01-18T05:31:24.568ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312025-01-18T05:31:24.568ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3322025-01-18T05:31:24.604ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332025-01-18T05:31:24.612ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone file = sled-storage/src/dataset.rs:302
3342025-01-18T05:31:24.748ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_18259e54-9e24-4df6-8524-340cf6c3dae0 file = sled-storage/src/dataset.rs:388
3352025-01-18T05:31:24.756ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3362025-01-18T05:31:24.756ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3372025-01-18T05:31:24.756ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3382025-01-18T05:31:24.756ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3392025-01-18T05:31:24.756ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402025-01-18T05:31:24.766ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3412025-01-18T05:31:24.766ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d55380f8-3d86-4c31-b244-3f6e51844733 (zpool)
3422025-01-18T05:31:24.861ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }
3432025-01-18T05:31:24.869ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3442025-01-18T05:31:24.869ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3452025-01-18T05:31:24.869ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3462025-01-18T05:31:24.869ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3472025-01-18T05:31:24.869ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482025-01-18T05:31:24.869ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492025-01-18T05:31:24.869ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3502025-01-18T05:31:24.903ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512025-01-18T05:31:24.910ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d55380f8-3d86-4c31-b244-3f6e51844733/crypt/zone file = sled-storage/src/dataset.rs:302
3522025-01-18T05:31:25.046ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d55380f8-3d86-4c31-b244-3f6e51844733 file = sled-storage/src/dataset.rs:388
3532025-01-18T05:31:25.054ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3542025-01-18T05:31:25.054ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3552025-01-18T05:31:25.054ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3562025-01-18T05:31:25.054ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3572025-01-18T05:31:25.054ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3582025-01-18T05:31:25.064ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3592025-01-18T05:31:25.064ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool)
3602025-01-18T05:31:25.158ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }
3612025-01-18T05:31:25.165ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3622025-01-18T05:31:25.165ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3632025-01-18T05:31:25.165ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3642025-01-18T05:31:25.165ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3652025-01-18T05:31:25.165ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662025-01-18T05:31:25.165ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672025-01-18T05:31:25.165ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3682025-01-18T05:31:25.198ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692025-01-18T05:31:25.206ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crypt/zone file = sled-storage/src/dataset.rs:302
3702025-01-18T05:31:25.345ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed file = sled-storage/src/dataset.rs:388
3712025-01-18T05:31:25.353ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3722025-01-18T05:31:25.353ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3732025-01-18T05:31:25.353ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3742025-01-18T05:31:25.353ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3752025-01-18T05:31:25.353ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762025-01-18T05:31:25.363ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3772025-01-18T05:31:25.363ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool)
3782025-01-18T05:31:25.462ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }
3792025-01-18T05:31:25.470ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3802025-01-18T05:31:25.470ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3812025-01-18T05:31:25.470ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3822025-01-18T05:31:25.470ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3832025-01-18T05:31:25.470ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842025-01-18T05:31:25.471ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852025-01-18T05:31:25.471ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3862025-01-18T05:31:25.475ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bcda1f83-6e29-4607-a063-c64866d2cd5c) file = sled-agent/src/probe_manager.rs:231 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
3872025-01-18T05:31:25.507ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3882025-01-18T05:31:25.515ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone file = sled-storage/src/dataset.rs:302
3892025-01-18T05:31:25.657ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26 file = sled-storage/src/dataset.rs:388
3902025-01-18T05:31:25.664ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3912025-01-18T05:31:25.664ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3922025-01-18T05:31:25.664ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3932025-01-18T05:31:25.664ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3942025-01-18T05:31:25.664ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3952025-01-18T05:31:25.675ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3962025-01-18T05:31:25.675ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cb543c1b-d520-4525-93a9-0809c84c04cd (zpool)
3972025-01-18T05:31:25.777ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }
3982025-01-18T05:31:25.786ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3992025-01-18T05:31:25.786ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4002025-01-18T05:31:25.786ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4012025-01-18T05:31:25.786ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4022025-01-18T05:31:25.786ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032025-01-18T05:31:25.786ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042025-01-18T05:31:25.786ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4052025-01-18T05:31:25.824ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4062025-01-18T05:31:25.833ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cb543c1b-d520-4525-93a9-0809c84c04cd/crypt/zone file = sled-storage/src/dataset.rs:302
4072025-01-18T05:31:25.974ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cb543c1b-d520-4525-93a9-0809c84c04cd file = sled-storage/src/dataset.rs:388
4082025-01-18T05:31:25.983ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4092025-01-18T05:31:25.983ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4102025-01-18T05:31:25.983ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4112025-01-18T05:31:25.983ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4122025-01-18T05:31:25.983ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4132025-01-18T05:31:25.995ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4142025-01-18T05:31:25.995ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 719280f2-3e89-4055-a81d-4f9adba21825 (zpool)
4152025-01-18T05:31:26.095ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }
4162025-01-18T05:31:26.103ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4172025-01-18T05:31:26.104ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4182025-01-18T05:31:26.104ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4192025-01-18T05:31:26.104ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4202025-01-18T05:31:26.104ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212025-01-18T05:31:26.104ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222025-01-18T05:31:26.104ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4232025-01-18T05:31:26.139ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4242025-01-18T05:31:26.147ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_719280f2-3e89-4055-a81d-4f9adba21825/crypt/zone file = sled-storage/src/dataset.rs:302
4252025-01-18T05:31:26.290ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_719280f2-3e89-4055-a81d-4f9adba21825 file = sled-storage/src/dataset.rs:388
4262025-01-18T05:31:26.298ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4272025-01-18T05:31:26.298ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4282025-01-18T05:31:26.299ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4292025-01-18T05:31:26.299ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ef62e45-6587-4c56-80fb-d82ceac2b8d7 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e47fb17-0da5-4fab-894c-91c2bd15e95c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4302025-01-18T05:31:26.299ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4312025-01-18T05:31:26.299ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4322025-01-18T05:31:26.299ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332025-01-18T05:31:26.299ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
4342025-01-18T05:31:26.299ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4352025-01-18T05:31:26.299ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
4362025-01-18T05:31:26.299ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
4372025-01-18T05:31:26.299ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
4382025-01-18T05:31:26.299ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
4392025-01-18T05:31:26.299ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
4402025-01-18T05:31:26.299ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4412025-01-18T05:31:26.299ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
4422025-01-18T05:31:26.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3510342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48704 req_id = 61e4c991-4956-410a-9400-f5bfe9f67e48 response_code = 200 uri = /omicron-physical-disks
4432025-01-18T05:31:26.331ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {02962d4d-d01d-4ffa-a1a8-a521c395c656 (dataset): DatasetConfig { id: 02962d4d-d01d-4ffa-a1a8-a521c395c656 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 029cbc30-c109-4500-9b09-268fd43db5fd (dataset): DatasetConfig { id: 029cbc30-c109-4500-9b09-268fd43db5fd (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 065409ae-545a-406f-9802-73af7d7f7b07 (dataset): DatasetConfig { id: 065409ae-545a-406f-9802-73af7d7f7b07 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 067d1fd0-018d-4f03-bd2e-77da13d5e4aa (dataset): DatasetConfig { id: 067d1fd0-018d-4f03-bd2e-77da13d5e4aa (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1dc821d0-95b1-49ab-bdef-066823afbf36 (dataset): DatasetConfig { id: 1dc821d0-95b1-49ab-bdef-066823afbf36 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20bf4d65-c926-4128-8ee2-99cbbb80cad4 (dataset): DatasetConfig { id: 20bf4d65-c926-4128-8ee2-99cbbb80cad4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2109e82d-961c-4a5f-a07e-fd72f72e1a11 (dataset): DatasetConfig { id: 2109e82d-961c-4a5f-a07e-fd72f72e1a11 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22384c05-452b-4b4d-aa84-2a1481643973 (dataset): DatasetConfig { id: 22384c05-452b-4b4d-aa84-2a1481643973 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 22499433-c845-46b4-91f5-05a17ad373d5 (dataset): DatasetConfig { id: 22499433-c845-46b4-91f5-05a17ad373d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ef48d6b-4b47-43d4-b284-1859154004c7 (dataset): DatasetConfig { id: 2ef48d6b-4b47-43d4-b284-1859154004c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30aeb30f-703f-4b96-ba6a-267b0fa3f398 (dataset): DatasetConfig { id: 30aeb30f-703f-4b96-ba6a-267b0fa3f398 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37e3be0d-4b75-4aa8-8a6b-4304b157904f (dataset): DatasetConfig { id: 37e3be0d-4b75-4aa8-8a6b-4304b157904f (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3bb4bdc0-6f3e-4f1b-b4db-d3c178565095 (dataset): DatasetConfig { id: 3bb4bdc0-6f3e-4f1b-b4db-d3c178565095 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c6d3646-9c3a-4539-9e2d-e18cd3e2bccd (dataset): DatasetConfig { id: 3c6d3646-9c3a-4539-9e2d-e18cd3e2bccd (dataset), name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e499bdc-06d9-44e9-b21d-f7e8bd4cf139 (dataset): DatasetConfig { id: 3e499bdc-06d9-44e9-b21d-f7e8bd4cf139 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e680ad4-e5da-480f-bf35-5e971ac7ef48 (dataset): DatasetConfig { id: 3e680ad4-e5da-480f-bf35-5e971ac7ef48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4102c8c2-8e46-46b0-999b-f69e69626106 (dataset): DatasetConfig { id: 4102c8c2-8e46-46b0-999b-f69e69626106 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42642cd3-bae5-4f1b-8d7f-ca8fc2f52c73 (dataset): DatasetConfig { id: 42642cd3-bae5-4f1b-8d7f-ca8fc2f52c73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4536fb0e-fd98-4554-a834-9a3b2a140543 (dataset): DatasetConfig { id: 4536fb0e-fd98-4554-a834-9a3b2a140543 (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4861544a-b8c6-47f3-afe4-1e3562b68875 (dataset): DatasetConfig { id: 4861544a-b8c6-47f3-afe4-1e3562b68875 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49ed8cdf-c446-4faa-ae0a-ac8d720033b2 (dataset): DatasetConfig { id: 49ed8cdf-c446-4faa-ae0a-ac8d720033b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bbd208c-e22f-4246-8102-daf2ba79e102 (dataset): DatasetConfig { id: 4bbd208c-e22f-4246-8102-daf2ba79e102 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c8e245d-cd08-49e3-a549-68bb4d263532 (dataset): DatasetConfig { id: 4c8e245d-cd08-49e3-a549-68bb4d263532 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5218f64d-1883-4f85-83ff-62bf17dbabc1 (dataset): DatasetConfig { id: 5218f64d-1883-4f85-83ff-62bf17dbabc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5abed396-fb97-4473-8512-2a3b1f324b29 (dataset): DatasetConfig { id: 5abed396-fb97-4473-8512-2a3b1f324b29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5e5a5be6-af80-4d08-a530-4963da9bb24a (dataset): DatasetConfig { id: 5e5a5be6-af80-4d08-a530-4963da9bb24a (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f8f9a77-0514-4b73-b27a-a618b316e593 (dataset): DatasetConfig { id: 5f8f9a77-0514-4b73-b27a-a618b316e593 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6103fe1b-5f19-444a-86c2-82a7b80a0a7e (dataset): DatasetConfig { id: 6103fe1b-5f19-444a-86c2-82a7b80a0a7e (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6735bf6e-0e40-4c3e-8895-e70b32c58ff0 (dataset): DatasetConfig { id: 6735bf6e-0e40-4c3e-8895-e70b32c58ff0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 677bed26-8f92-4e5f-bcd3-5925a8f7a3ce (dataset): DatasetConfig { id: 677bed26-8f92-4e5f-bcd3-5925a8f7a3ce (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6aabfd97-f52d-47ae-9ddd-fea0909ffeeb (dataset): DatasetConfig { id: 6aabfd97-f52d-47ae-9ddd-fea0909ffeeb (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c10ace6-7930-4ad3-a851-fd776fb3f292 (dataset): DatasetConfig { id: 6c10ace6-7930-4ad3-a851-fd776fb3f292 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c537898-dcc6-4a4f-9439-dd23e7bcbb40 (dataset): DatasetConfig { id: 6c537898-dcc6-4a4f-9439-dd23e7bcbb40 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 737a7ca4-1610-4430-8bab-8d20ff9d63a7 (dataset): DatasetConfig { id: 737a7ca4-1610-4430-8bab-8d20ff9d63a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 759edbb4-704e-4212-9b7e-e1136afed4a6 (dataset): DatasetConfig { id: 759edbb4-704e-4212-9b7e-e1136afed4a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78a0f66b-5bfb-4b53-a3c9-fe32b94c84e6 (dataset): DatasetConfig { id: 78a0f66b-5bfb-4b53-a3c9-fe32b94c84e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78e5bee7-47a2-40c4-b5cd-75376f036923 (dataset): DatasetConfig { id: 78e5bee7-47a2-40c4-b5cd-75376f036923 (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f9b0daf-ef91-483e-9488-6d023d45899a (dataset): DatasetConfig { id: 7f9b0daf-ef91-483e-9488-6d023d45899a (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 810c8f3b-6b63-4dee-aefd-87ec2dab2012 (dataset): DatasetConfig { id: 810c8f3b-6b63-4dee-aefd-87ec2dab2012 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 817eff47-2804-4dc3-b47e-4fc2d8d27df9 (dataset): DatasetConfig { id: 817eff47-2804-4dc3-b47e-4fc2d8d27df9 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 872a83aa-5b50-44ab-b2e4-d5f5b864a7a0 (dataset): DatasetConfig { id: 872a83aa-5b50-44ab-b2e4-d5f5b864a7a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8883f397-0d7a-43ab-a6ce-3d79ac6721e9 (dataset): DatasetConfig { id: 8883f397-0d7a-43ab-a6ce-3d79ac6721e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89595e2d-e6df-42aa-b069-fd2f7a16a113 (dataset): DatasetConfig { id: 89595e2d-e6df-42aa-b069-fd2f7a16a113 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d36e69f-e3d9-49c0-8bf4-06e3d12a6112 (dataset): DatasetConfig { id: 8d36e69f-e3d9-49c0-8bf4-06e3d12a6112 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f4ec835-d919-4747-8a86-3369cdeece6e (dataset): DatasetConfig { id: 8f4ec835-d919-4747-8a86-3369cdeece6e (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94668448-cdc9-4601-84a3-a7f39b76a95b (dataset): DatasetConfig { id: 94668448-cdc9-4601-84a3-a7f39b76a95b (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b71631c-8529-4f5b-b59b-efb970d3f9ae (dataset): DatasetConfig { id: 9b71631c-8529-4f5b-b59b-efb970d3f9ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2a8953b-bbc4-44d0-8408-8c9aee29164c (dataset): DatasetConfig { id: a2a8953b-bbc4-44d0-8408-8c9aee29164c (dataset), name: DatasetName { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a88e7391-a493-49cb-8ae2-79ef29a5d2f1 (dataset): DatasetConfig { id: a88e7391-a493-49cb-8ae2-79ef29a5d2f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa3fbe4c-676e-450f-bcfc-67cca1f9c1e4 (dataset): DatasetConfig { id: aa3fbe4c-676e-450f-bcfc-67cca1f9c1e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa7799e3-5605-4e90-af9a-f3e646f4ce65 (dataset): DatasetConfig { id: aa7799e3-5605-4e90-af9a-f3e646f4ce65 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac7c0257-a0cd-49e1-96a0-4ada2ddfe138 (dataset): DatasetConfig { id: ac7c0257-a0cd-49e1-96a0-4ada2ddfe138 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb33e8c5-fe91-4297-8e80-22d988ea28d7 (dataset): DatasetConfig { id: bb33e8c5-fe91-4297-8e80-22d988ea28d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be5af921-0355-4475-8792-a368e4764d9b (dataset): DatasetConfig { id: be5af921-0355-4475-8792-a368e4764d9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1b02008-b339-42b7-bdc5-3c349bdd1a7e (dataset): DatasetConfig { id: c1b02008-b339-42b7-bdc5-3c349bdd1a7e (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9acabc3-ede5-4d06-9191-d8d6e9990566 (dataset): DatasetConfig { id: c9acabc3-ede5-4d06-9191-d8d6e9990566 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ce5d37-a40d-4279-b4f5-3dd165efd0e1 (dataset): DatasetConfig { id: e7ce5d37-a40d-4279-b4f5-3dd165efd0e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ebc12531-14a9-4375-abdb-b04034b3ff28 (dataset): DatasetConfig { id: ebc12531-14a9-4375-abdb-b04034b3ff28 (dataset), name: DatasetName { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f24f61da-8fd0-4796-a12b-80ee66dbc19a (dataset): DatasetConfig { id: f24f61da-8fd0-4796-a12b-80ee66dbc19a (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f45f4afd-350c-492d-a889-8fb032c0bee0 (dataset): DatasetConfig { id: f45f4afd-350c-492d-a889-8fb032c0bee0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f521910b-c4a6-41b0-a9af-d770ebda9d99 (dataset): DatasetConfig { id: f521910b-c4a6-41b0-a9af-d770ebda9d99 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6c2042e-8e3c-4b43-b903-0f47b2b4c6fc (dataset): DatasetConfig { id: f6c2042e-8e3c-4b43-b903-0f47b2b4c6fc (dataset), name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f82f07b7-1361-4d10-9783-0e2e761251d5 (dataset): DatasetConfig { id: f82f07b7-1361-4d10-9783-0e2e761251d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9eb9958-5e5e-490d-9852-bfb5365066a2 (dataset): DatasetConfig { id: f9eb9958-5e5e-490d-9852-bfb5365066a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe695980-acd2-4880-bbe7-6f309298012d (dataset): DatasetConfig { id: fe695980-acd2-4880-bbe7-6f309298012d (dataset), name: DatasetName { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff828709-e1a4-4878-8ec6-0d2cc9c2b31d (dataset): DatasetConfig { id: ff828709-e1a4-4878-8ec6-0d2cc9c2b31d (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4442025-01-18T05:31:26.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42781
4452025-01-18T05:31:26.332ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
4462025-01-18T05:31:26.332ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {02962d4d-d01d-4ffa-a1a8-a521c395c656 (dataset): DatasetConfig { id: 02962d4d-d01d-4ffa-a1a8-a521c395c656 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 029cbc30-c109-4500-9b09-268fd43db5fd (dataset): DatasetConfig { id: 029cbc30-c109-4500-9b09-268fd43db5fd (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 065409ae-545a-406f-9802-73af7d7f7b07 (dataset): DatasetConfig { id: 065409ae-545a-406f-9802-73af7d7f7b07 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 067d1fd0-018d-4f03-bd2e-77da13d5e4aa (dataset): DatasetConfig { id: 067d1fd0-018d-4f03-bd2e-77da13d5e4aa (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1dc821d0-95b1-49ab-bdef-066823afbf36 (dataset): DatasetConfig { id: 1dc821d0-95b1-49ab-bdef-066823afbf36 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20bf4d65-c926-4128-8ee2-99cbbb80cad4 (dataset): DatasetConfig { id: 20bf4d65-c926-4128-8ee2-99cbbb80cad4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2109e82d-961c-4a5f-a07e-fd72f72e1a11 (dataset): DatasetConfig { id: 2109e82d-961c-4a5f-a07e-fd72f72e1a11 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22384c05-452b-4b4d-aa84-2a1481643973 (dataset): DatasetConfig { id: 22384c05-452b-4b4d-aa84-2a1481643973 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 22499433-c845-46b4-91f5-05a17ad373d5 (dataset): DatasetConfig { id: 22499433-c845-46b4-91f5-05a17ad373d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ef48d6b-4b47-43d4-b284-1859154004c7 (dataset): DatasetConfig { id: 2ef48d6b-4b47-43d4-b284-1859154004c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30aeb30f-703f-4b96-ba6a-267b0fa3f398 (dataset): DatasetConfig { id: 30aeb30f-703f-4b96-ba6a-267b0fa3f398 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37e3be0d-4b75-4aa8-8a6b-4304b157904f (dataset): DatasetConfig { id: 37e3be0d-4b75-4aa8-8a6b-4304b157904f (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3bb4bdc0-6f3e-4f1b-b4db-d3c178565095 (dataset): DatasetConfig { id: 3bb4bdc0-6f3e-4f1b-b4db-d3c178565095 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c6d3646-9c3a-4539-9e2d-e18cd3e2bccd (dataset): DatasetConfig { id: 3c6d3646-9c3a-4539-9e2d-e18cd3e2bccd (dataset), name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e499bdc-06d9-44e9-b21d-f7e8bd4cf139 (dataset): DatasetConfig { id: 3e499bdc-06d9-44e9-b21d-f7e8bd4cf139 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e680ad4-e5da-480f-bf35-5e971ac7ef48 (dataset): DatasetConfig { id: 3e680ad4-e5da-480f-bf35-5e971ac7ef48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4102c8c2-8e46-46b0-999b-f69e69626106 (dataset): DatasetConfig { id: 4102c8c2-8e46-46b0-999b-f69e69626106 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42642cd3-bae5-4f1b-8d7f-ca8fc2f52c73 (dataset): DatasetConfig { id: 42642cd3-bae5-4f1b-8d7f-ca8fc2f52c73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4536fb0e-fd98-4554-a834-9a3b2a140543 (dataset): DatasetConfig { id: 4536fb0e-fd98-4554-a834-9a3b2a140543 (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4861544a-b8c6-47f3-afe4-1e3562b68875 (dataset): DatasetConfig { id: 4861544a-b8c6-47f3-afe4-1e3562b68875 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49ed8cdf-c446-4faa-ae0a-ac8d720033b2 (dataset): DatasetConfig { id: 49ed8cdf-c446-4faa-ae0a-ac8d720033b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bbd208c-e22f-4246-8102-daf2ba79e102 (dataset): DatasetConfig { id: 4bbd208c-e22f-4246-8102-daf2ba79e102 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c8e245d-cd08-49e3-a549-68bb4d263532 (dataset): DatasetConfig { id: 4c8e245d-cd08-49e3-a549-68bb4d263532 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5218f64d-1883-4f85-83ff-62bf17dbabc1 (dataset): DatasetConfig { id: 5218f64d-1883-4f85-83ff-62bf17dbabc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5abed396-fb97-4473-8512-2a3b1f324b29 (dataset): DatasetConfig { id: 5abed396-fb97-4473-8512-2a3b1f324b29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5e5a5be6-af80-4d08-a530-4963da9bb24a (dataset): DatasetConfig { id: 5e5a5be6-af80-4d08-a530-4963da9bb24a (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f8f9a77-0514-4b73-b27a-a618b316e593 (dataset): DatasetConfig { id: 5f8f9a77-0514-4b73-b27a-a618b316e593 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6103fe1b-5f19-444a-86c2-82a7b80a0a7e (dataset): DatasetConfig { id: 6103fe1b-5f19-444a-86c2-82a7b80a0a7e (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6735bf6e-0e40-4c3e-8895-e70b32c58ff0 (dataset): DatasetConfig { id: 6735bf6e-0e40-4c3e-8895-e70b32c58ff0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 677bed26-8f92-4e5f-bcd3-5925a8f7a3ce (dataset): DatasetConfig { id: 677bed26-8f92-4e5f-bcd3-5925a8f7a3ce (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6aabfd97-f52d-47ae-9ddd-fea0909ffeeb (dataset): DatasetConfig { id: 6aabfd97-f52d-47ae-9ddd-fea0909ffeeb (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c10ace6-7930-4ad3-a851-fd776fb3f292 (dataset): DatasetConfig { id: 6c10ace6-7930-4ad3-a851-fd776fb3f292 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c537898-dcc6-4a4f-9439-dd23e7bcbb40 (dataset): DatasetConfig { id: 6c537898-dcc6-4a4f-9439-dd23e7bcbb40 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 737a7ca4-1610-4430-8bab-8d20ff9d63a7 (dataset): DatasetConfig { id: 737a7ca4-1610-4430-8bab-8d20ff9d63a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 759edbb4-704e-4212-9b7e-e1136afed4a6 (dataset): DatasetConfig { id: 759edbb4-704e-4212-9b7e-e1136afed4a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78a0f66b-5bfb-4b53-a3c9-fe32b94c84e6 (dataset): DatasetConfig { id: 78a0f66b-5bfb-4b53-a3c9-fe32b94c84e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78e5bee7-47a2-40c4-b5cd-75376f036923 (dataset): DatasetConfig { id: 78e5bee7-47a2-40c4-b5cd-75376f036923 (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f9b0daf-ef91-483e-9488-6d023d45899a (dataset): DatasetConfig { id: 7f9b0daf-ef91-483e-9488-6d023d45899a (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 810c8f3b-6b63-4dee-aefd-87ec2dab2012 (dataset): DatasetConfig { id: 810c8f3b-6b63-4dee-aefd-87ec2dab2012 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 817eff47-2804-4dc3-b47e-4fc2d8d27df9 (dataset): DatasetConfig { id: 817eff47-2804-4dc3-b47e-4fc2d8d27df9 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 872a83aa-5b50-44ab-b2e4-d5f5b864a7a0 (dataset): DatasetConfig { id: 872a83aa-5b50-44ab-b2e4-d5f5b864a7a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8883f397-0d7a-43ab-a6ce-3d79ac6721e9 (dataset): DatasetConfig { id: 8883f397-0d7a-43ab-a6ce-3d79ac6721e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89595e2d-e6df-42aa-b069-fd2f7a16a113 (dataset): DatasetConfig { id: 89595e2d-e6df-42aa-b069-fd2f7a16a113 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d36e69f-e3d9-49c0-8bf4-06e3d12a6112 (dataset): DatasetConfig { id: 8d36e69f-e3d9-49c0-8bf4-06e3d12a6112 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f4ec835-d919-4747-8a86-3369cdeece6e (dataset): DatasetConfig { id: 8f4ec835-d919-4747-8a86-3369cdeece6e (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94668448-cdc9-4601-84a3-a7f39b76a95b (dataset): DatasetConfig { id: 94668448-cdc9-4601-84a3-a7f39b76a95b (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b71631c-8529-4f5b-b59b-efb970d3f9ae (dataset): DatasetConfig { id: 9b71631c-8529-4f5b-b59b-efb970d3f9ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2a8953b-bbc4-44d0-8408-8c9aee29164c (dataset): DatasetConfig { id: a2a8953b-bbc4-44d0-8408-8c9aee29164c (dataset), name: DatasetName { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a88e7391-a493-49cb-8ae2-79ef29a5d2f1 (dataset): DatasetConfig { id: a88e7391-a493-49cb-8ae2-79ef29a5d2f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa3fbe4c-676e-450f-bcfc-67cca1f9c1e4 (dataset): DatasetConfig { id: aa3fbe4c-676e-450f-bcfc-67cca1f9c1e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa7799e3-5605-4e90-af9a-f3e646f4ce65 (dataset): DatasetConfig { id: aa7799e3-5605-4e90-af9a-f3e646f4ce65 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac7c0257-a0cd-49e1-96a0-4ada2ddfe138 (dataset): DatasetConfig { id: ac7c0257-a0cd-49e1-96a0-4ada2ddfe138 (dataset), name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb33e8c5-fe91-4297-8e80-22d988ea28d7 (dataset): DatasetConfig { id: bb33e8c5-fe91-4297-8e80-22d988ea28d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be5af921-0355-4475-8792-a368e4764d9b (dataset): DatasetConfig { id: be5af921-0355-4475-8792-a368e4764d9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1b02008-b339-42b7-bdc5-3c349bdd1a7e (dataset): DatasetConfig { id: c1b02008-b339-42b7-bdc5-3c349bdd1a7e (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9acabc3-ede5-4d06-9191-d8d6e9990566 (dataset): DatasetConfig { id: c9acabc3-ede5-4d06-9191-d8d6e9990566 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7ce5d37-a40d-4279-b4f5-3dd165efd0e1 (dataset): DatasetConfig { id: e7ce5d37-a40d-4279-b4f5-3dd165efd0e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ebc12531-14a9-4375-abdb-b04034b3ff28 (dataset): DatasetConfig { id: ebc12531-14a9-4375-abdb-b04034b3ff28 (dataset), name: DatasetName { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f24f61da-8fd0-4796-a12b-80ee66dbc19a (dataset): DatasetConfig { id: f24f61da-8fd0-4796-a12b-80ee66dbc19a (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f45f4afd-350c-492d-a889-8fb032c0bee0 (dataset): DatasetConfig { id: f45f4afd-350c-492d-a889-8fb032c0bee0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f521910b-c4a6-41b0-a9af-d770ebda9d99 (dataset): DatasetConfig { id: f521910b-c4a6-41b0-a9af-d770ebda9d99 (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6c2042e-8e3c-4b43-b903-0f47b2b4c6fc (dataset): DatasetConfig { id: f6c2042e-8e3c-4b43-b903-0f47b2b4c6fc (dataset), name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f82f07b7-1361-4d10-9783-0e2e761251d5 (dataset): DatasetConfig { id: f82f07b7-1361-4d10-9783-0e2e761251d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9eb9958-5e5e-490d-9852-bfb5365066a2 (dataset): DatasetConfig { id: f9eb9958-5e5e-490d-9852-bfb5365066a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe695980-acd2-4880-bbe7-6f309298012d (dataset): DatasetConfig { id: fe695980-acd2-4880-bbe7-6f309298012d (dataset), name: DatasetName { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff828709-e1a4-4878-8ec6-0d2cc9c2b31d (dataset): DatasetConfig { id: ff828709-e1a4-4878-8ec6-0d2cc9c2b31d (dataset), name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4472025-01-18T05:31:26.332ZINFOSledAgent (StorageManager): No ledger in /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482025-01-18T05:31:26.332ZINFOSledAgent (StorageManager): No ledger in /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4492025-01-18T05:31:26.332ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4502025-01-18T05:31:26.348ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4512025-01-18T05:31:26.348ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4522025-01-18T05:31:26.348ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone/oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae"), full_name: "oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone/oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae" } file = sled-storage/src/manager.rs:1431
4532025-01-18T05:31:26.407ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542025-01-18T05:31:26.407ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4552025-01-18T05:31:26.407ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4562025-01-18T05:31:26.454ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572025-01-18T05:31:26.455ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4582025-01-18T05:31:26.455ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4592025-01-18T05:31:26.477ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bcda1f83-6e29-4607-a063-c64866d2cd5c) file = sled-agent/src/probe_manager.rs:231 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
4602025-01-18T05:31:26.501ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612025-01-18T05:31:26.501ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4622025-01-18T05:31:26.501ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crypt/zone"), full_name: "oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crypt/zone" } file = sled-storage/src/manager.rs:1431
4632025-01-18T05:31:26.555ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642025-01-18T05:31:26.555ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652025-01-18T05:31:26.555ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4662025-01-18T05:31:26.606ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672025-01-18T05:31:26.606ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4682025-01-18T05:31:26.606ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d55380f8-3d86-4c31-b244-3f6e51844733/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4692025-01-18T05:31:26.653ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702025-01-18T05:31:26.653ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4712025-01-18T05:31:26.653ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8" } file = sled-storage/src/manager.rs:1431
4722025-01-18T05:31:26.712ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732025-01-18T05:31:26.712ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4742025-01-18T05:31:26.712ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cb543c1b-d520-4525-93a9-0809c84c04cd/crypt/debug"), full_name: "oxp_cb543c1b-d520-4525-93a9-0809c84c04cd/crypt/debug" } file = sled-storage/src/manager.rs:1431
4752025-01-18T05:31:26.739ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4762025-01-18T05:31:26.739ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4772025-01-18T05:31:26.739ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4782025-01-18T05:31:26.787ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4792025-01-18T05:31:26.787ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4802025-01-18T05:31:26.787ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_719280f2-3e89-4055-a81d-4f9adba21825/crucible" } file = sled-storage/src/manager.rs:1431
4812025-01-18T05:31:26.836ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822025-01-18T05:31:26.836ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4832025-01-18T05:31:26.836ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crypt/zone/oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d"), full_name: "oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crypt/zone/oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d" } file = sled-storage/src/manager.rs:1431
4842025-01-18T05:31:26.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852025-01-18T05:31:26.891ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4862025-01-18T05:31:26.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible" } file = sled-storage/src/manager.rs:1431
4872025-01-18T05:31:26.938ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882025-01-18T05:31:26.938ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4892025-01-18T05:31:26.938ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone/oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173"), full_name: "oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone/oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173" } file = sled-storage/src/manager.rs:1431
4902025-01-18T05:31:26.997ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912025-01-18T05:31:26.997ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4922025-01-18T05:31:26.997ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crypt/zone"), full_name: "oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crypt/zone" } file = sled-storage/src/manager.rs:1431
4932025-01-18T05:31:27.027ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942025-01-18T05:31:27.027ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4952025-01-18T05:31:27.027ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crypt/zone/oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607"), full_name: "oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crypt/zone/oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607" } file = sled-storage/src/manager.rs:1431
4962025-01-18T05:31:27.084ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972025-01-18T05:31:27.084ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4982025-01-18T05:31:27.084ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/719280f2-3e89-4055-a81d-4f9adba21825/crypt/zone"), full_name: "oxp_719280f2-3e89-4055-a81d-4f9adba21825/crypt/zone" } file = sled-storage/src/manager.rs:1431
4992025-01-18T05:31:27.112ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002025-01-18T05:31:27.112ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5012025-01-18T05:31:27.112ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crypt/zone/oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2"), full_name: "oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crypt/zone/oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2" } file = sled-storage/src/manager.rs:1431
5022025-01-18T05:31:27.154ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 16.632264419s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
5032025-01-18T05:31:27.169ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-01-18T05:31:27.169ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5052025-01-18T05:31:27.169ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crypt/debug"), full_name: "oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crypt/debug" } file = sled-storage/src/manager.rs:1431
5062025-01-18T05:31:27.196ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-01-18T05:31:27.196ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5082025-01-18T05:31:27.196ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d55380f8-3d86-4c31-b244-3f6e51844733/crypt/debug"), full_name: "oxp_d55380f8-3d86-4c31-b244-3f6e51844733/crypt/debug" } file = sled-storage/src/manager.rs:1431
5092025-01-18T05:31:27.223ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-01-18T05:31:27.223ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112025-01-18T05:31:27.223ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crucible" } file = sled-storage/src/manager.rs:1431
5122025-01-18T05:31:27.271ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-01-18T05:31:27.271ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142025-01-18T05:31:27.271ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018" } file = sled-storage/src/manager.rs:1431
5152025-01-18T05:31:27.331ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-01-18T05:31:27.332ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5172025-01-18T05:31:27.332ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5182025-01-18T05:31:27.380ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-01-18T05:31:27.380ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202025-01-18T05:31:27.380ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cb543c1b-d520-4525-93a9-0809c84c04cd/crucible" } file = sled-storage/src/manager.rs:1431
5212025-01-18T05:31:27.429ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-01-18T05:31:27.429ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5232025-01-18T05:31:27.429ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone"), full_name: "oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone" } file = sled-storage/src/manager.rs:1431
5242025-01-18T05:31:27.458ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-01-18T05:31:27.459ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5262025-01-18T05:31:27.459ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/debug"), full_name: "oxp_18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/debug" } file = sled-storage/src/manager.rs:1431
5272025-01-18T05:31:27.478ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bcda1f83-6e29-4607-a063-c64866d2cd5c) file = sled-agent/src/probe_manager.rs:231 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
5282025-01-18T05:31:27.489ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-01-18T05:31:27.489ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5302025-01-18T05:31:27.489ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone"), full_name: "oxp_18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone" } file = sled-storage/src/manager.rs:1431
5312025-01-18T05:31:27.517ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-01-18T05:31:27.517ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332025-01-18T05:31:27.517ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5342025-01-18T05:31:27.567ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-01-18T05:31:27.567ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362025-01-18T05:31:27.567ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a" } file = sled-storage/src/manager.rs:1431
5372025-01-18T05:31:27.628ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-18T05:31:27.628ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392025-01-18T05:31:27.628ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_18259e54-9e24-4df6-8524-340cf6c3dae0/crucible" } file = sled-storage/src/manager.rs:1431
5402025-01-18T05:31:27.676ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-01-18T05:31:27.676ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-01-18T05:31:27.676ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d55380f8-3d86-4c31-b244-3f6e51844733/crucible" } file = sled-storage/src/manager.rs:1431
5432025-01-18T05:31:27.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-01-18T05:31:27.726ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452025-01-18T05:31:27.726ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone/oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98"), full_name: "oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone/oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98" } file = sled-storage/src/manager.rs:1431
5462025-01-18T05:31:27.783ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-01-18T05:31:27.783ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5482025-01-18T05:31:27.783ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone/oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b"), full_name: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone/oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b" } file = sled-storage/src/manager.rs:1431
5492025-01-18T05:31:27.842ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-01-18T05:31:27.842ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-01-18T05:31:27.842ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5522025-01-18T05:31:27.894ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-01-18T05:31:27.894ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542025-01-18T05:31:27.894ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5552025-01-18T05:31:27.945ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-01-18T05:31:27.945ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5572025-01-18T05:31:27.945ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5582025-01-18T05:31:27.994ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-01-18T05:31:27.994ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602025-01-18T05:31:27.994ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone/oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee"), full_name: "oxp_18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone/oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee" } file = sled-storage/src/manager.rs:1431
5612025-01-18T05:31:28.058ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-01-18T05:31:28.058ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5632025-01-18T05:31:28.058ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d55380f8-3d86-4c31-b244-3f6e51844733/crypt/zone/oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67"), full_name: "oxp_d55380f8-3d86-4c31-b244-3f6e51844733/crypt/zone/oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67" } file = sled-storage/src/manager.rs:1431
5642025-01-18T05:31:28.119ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652025-01-18T05:31:28.119ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662025-01-18T05:31:28.119ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone/oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), full_name: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone/oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc" } file = sled-storage/src/manager.rs:1431
5672025-01-18T05:31:28.181ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682025-01-18T05:31:28.181ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5692025-01-18T05:31:28.181ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/debug"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/debug" } file = sled-storage/src/manager.rs:1431
5702025-01-18T05:31:28.210ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712025-01-18T05:31:28.210ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5722025-01-18T05:31:28.210ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crypt/debug"), full_name: "oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crypt/debug" } file = sled-storage/src/manager.rs:1431
5732025-01-18T05:31:28.240ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-01-18T05:31:28.240ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5752025-01-18T05:31:28.240ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone/oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a"), full_name: "oxp_18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone/oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a" } file = sled-storage/src/manager.rs:1431
5762025-01-18T05:31:28.302ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-01-18T05:31:28.302ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5782025-01-18T05:31:28.302ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone"), full_name: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone" } file = sled-storage/src/manager.rs:1431
5792025-01-18T05:31:28.332ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-01-18T05:31:28.332ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5812025-01-18T05:31:28.332ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5822025-01-18T05:31:28.383ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-01-18T05:31:28.383ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5842025-01-18T05:31:28.383ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de" } file = sled-storage/src/manager.rs:1431
5852025-01-18T05:31:28.443ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-01-18T05:31:28.443ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5872025-01-18T05:31:28.443ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d55380f8-3d86-4c31-b244-3f6e51844733/crypt/zone"), full_name: "oxp_d55380f8-3d86-4c31-b244-3f6e51844733/crypt/zone" } file = sled-storage/src/manager.rs:1431
5882025-01-18T05:31:28.472ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892025-01-18T05:31:28.472ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5902025-01-18T05:31:28.472ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone/oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21"), full_name: "oxp_18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone/oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21" } file = sled-storage/src/manager.rs:1431
5912025-01-18T05:31:28.484ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bcda1f83-6e29-4607-a063-c64866d2cd5c) file = sled-agent/src/probe_manager.rs:231 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
5922025-01-18T05:31:28.534ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-01-18T05:31:28.534ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5942025-01-18T05:31:28.534ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone/oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb"), full_name: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone/oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb" } file = sled-storage/src/manager.rs:1431
5952025-01-18T05:31:28.594ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-01-18T05:31:28.594ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972025-01-18T05:31:28.594ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/719280f2-3e89-4055-a81d-4f9adba21825/crypt/zone/oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e"), full_name: "oxp_719280f2-3e89-4055-a81d-4f9adba21825/crypt/zone/oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e" } file = sled-storage/src/manager.rs:1431
5982025-01-18T05:31:28.653ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-01-18T05:31:28.653ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002025-01-18T05:31:28.653ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crucible" } file = sled-storage/src/manager.rs:1431
6012025-01-18T05:31:28.701ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-01-18T05:31:28.701ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6032025-01-18T05:31:28.701ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116" } file = sled-storage/src/manager.rs:1431
6042025-01-18T05:31:28.762ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-01-18T05:31:28.762ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062025-01-18T05:31:28.762ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d" } file = sled-storage/src/manager.rs:1431
6072025-01-18T05:31:28.822ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-01-18T05:31:28.822ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-01-18T05:31:28.822ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone/oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597"), full_name: "oxp_18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/zone/oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597" } file = sled-storage/src/manager.rs:1431
6102025-01-18T05:31:28.884ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-01-18T05:31:28.884ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-01-18T05:31:28.884ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone/oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584"), full_name: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone/oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584" } file = sled-storage/src/manager.rs:1431
6132025-01-18T05:31:28.944ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-01-18T05:31:28.944ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152025-01-18T05:31:28.944ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crucible" } file = sled-storage/src/manager.rs:1431
6162025-01-18T05:31:28.993ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-01-18T05:31:28.993ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6182025-01-18T05:31:28.993ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone" } file = sled-storage/src/manager.rs:1431
6192025-01-18T05:31:29.023ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-01-18T05:31:29.023ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212025-01-18T05:31:29.023ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/zone/oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4" } file = sled-storage/src/manager.rs:1431
6222025-01-18T05:31:29.086ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-01-18T05:31:29.086ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242025-01-18T05:31:29.086ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cb543c1b-d520-4525-93a9-0809c84c04cd/crypt/zone/oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b"), full_name: "oxp_cb543c1b-d520-4525-93a9-0809c84c04cd/crypt/zone/oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b" } file = sled-storage/src/manager.rs:1431
6252025-01-18T05:31:29.145ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262025-01-18T05:31:29.145ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6272025-01-18T05:31:29.145ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/719280f2-3e89-4055-a81d-4f9adba21825/crypt/debug"), full_name: "oxp_719280f2-3e89-4055-a81d-4f9adba21825/crypt/debug" } file = sled-storage/src/manager.rs:1431
6282025-01-18T05:31:29.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-01-18T05:31:29.175ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6302025-01-18T05:31:29.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/debug"), full_name: "oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/debug" } file = sled-storage/src/manager.rs:1431
6312025-01-18T05:31:29.204ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-01-18T05:31:29.204ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6332025-01-18T05:31:29.204ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d55380f8-3d86-4c31-b244-3f6e51844733/crypt/zone/oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483"), full_name: "oxp_d55380f8-3d86-4c31-b244-3f6e51844733/crypt/zone/oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483" } file = sled-storage/src/manager.rs:1431
6342025-01-18T05:31:29.265ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-01-18T05:31:29.265ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362025-01-18T05:31:29.265ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone/oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd"), full_name: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/zone/oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd" } file = sled-storage/src/manager.rs:1431
6372025-01-18T05:31:29.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-01-18T05:31:29.325ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392025-01-18T05:31:29.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crypt/zone/oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9"), full_name: "oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crypt/zone/oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9" } file = sled-storage/src/manager.rs:1431
6402025-01-18T05:31:29.385ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-01-18T05:31:29.385ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-01-18T05:31:29.385ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone/oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade"), full_name: "oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/zone/oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade" } file = sled-storage/src/manager.rs:1431
6432025-01-18T05:31:29.445ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-01-18T05:31:29.445ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452025-01-18T05:31:29.445ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crucible" } file = sled-storage/src/manager.rs:1431
6462025-01-18T05:31:29.486ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bcda1f83-6e29-4607-a063-c64866d2cd5c) file = sled-agent/src/probe_manager.rs:231 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
6472025-01-18T05:31:29.493ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482025-01-18T05:31:29.493ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6492025-01-18T05:31:29.493ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cb543c1b-d520-4525-93a9-0809c84c04cd/crypt/zone"), full_name: "oxp_cb543c1b-d520-4525-93a9-0809c84c04cd/crypt/zone" } file = sled-storage/src/manager.rs:1431
6502025-01-18T05:31:29.524ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6512025-01-18T05:31:29.524ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6522025-01-18T05:31:29.524ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/debug"), full_name: "oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/debug" } file = sled-storage/src/manager.rs:1431
6532025-01-18T05:31:29.553ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542025-01-18T05:31:29.553ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6552025-01-18T05:31:29.554ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
6562025-01-18T05:31:29.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3222557 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42781 req_id = 955a66ec-03e3-473d-b730-ed7a9067730c response_code = 200 uri = /datasets
6572025-01-18T05:31:29.585ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 826c9d0d-e674-4c46-b1e3-258d45a5c1de (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d9dcabc2-9e0a-4cc2-9796-7545bc4998ae (service), filesystem_pool: Some(ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 125376f0-a418-44ab-88a5-9cefaa3f0c0b (service), filesystem_pool: Some(ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6582025-01-18T05:31:29.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45828
6592025-01-18T05:31:29.586ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-01-18T05:31:29.586ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-01-18T05:31:29.595ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-01-18T05:31:29.595ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-01-18T05:31:29.604ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6642025-01-18T05:31:29.604ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652025-01-18T05:31:29.613ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-01-18T05:31:29.613ZINFOSledAgent (ServiceManager): No ledger in /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-zones.json file = common/src/ledger.rs:188
6672025-01-18T05:31:29.613ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-zones.json file = common/src/ledger.rs:188
6682025-01-18T05:31:29.613ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-01-18T05:31:29.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-01-18T05:31:29.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-01-18T05:31:29.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-01-18T05:31:29.714ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae file = illumos-utils/src/zone.rs:325
6732025-01-18T05:31:29.718ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b file = illumos-utils/src/zone.rs:325
6742025-01-18T05:31:29.722ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de file = illumos-utils/src/zone.rs:325
6752025-01-18T05:31:29.734ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae file = illumos-utils/src/zone.rs:363
6762025-01-18T05:31:29.739ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b file = illumos-utils/src/zone.rs:363
6772025-01-18T05:31:29.743ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de file = illumos-utils/src/zone.rs:363
6782025-01-18T05:31:30.488ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bcda1f83-6e29-4607-a063-c64866d2cd5c) file = sled-agent/src/probe_manager.rs:231 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
6792025-01-18T05:31:31.388ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802025-01-18T05:31:31.388ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6812025-01-18T05:31:31.388ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
6822025-01-18T05:31:31.873ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832025-01-18T05:31:32.220ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11273279781320411627 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
6842025-01-18T05:31:32.221ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16129014751436204083 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
6852025-01-18T05:31:32.353ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6862025-01-18T05:31:32.353ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6872025-01-18T05:31:32.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de") failed: Property not found. retry in 32.150659ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
6882025-01-18T05:31:32.361ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6892025-01-18T05:31:32.361ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
6902025-01-18T05:31:32.365ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b
6912025-01-18T05:31:32.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de") failed: Property not found. retry in 61.396745ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
6922025-01-18T05:31:32.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de") failed: Property not found. retry in 221.970121ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
6932025-01-18T05:31:32.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b") failed: Property not found. retry in 74.531342ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b
6942025-01-18T05:31:32.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae") failed: Property not found. retry in 63.754859ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
6952025-01-18T05:31:32.523ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6962025-01-18T05:31:32.523ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6972025-01-18T05:31:32.529ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6982025-01-18T05:31:32.529ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6992025-01-18T05:31:32.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae") failed: Property not found. retry in 62.142826ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
7002025-01-18T05:31:32.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b") failed: Property not found. retry in 99.982159ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b
7012025-01-18T05:31:32.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae") failed: Property not found. retry in 272.573296ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
7022025-01-18T05:31:32.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de") failed: Property not found. retry in 220.160308ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
7032025-01-18T05:31:32.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b") failed: Property not found. retry in 259.933665ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b
7042025-01-18T05:31:33.082ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
7052025-01-18T05:31:33.082ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
7062025-01-18T05:31:33.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de") failed: Property not found. retry in 568.339153ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
7072025-01-18T05:31:33.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae") failed: Property not found. retry in 250.543987ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
7082025-01-18T05:31:33.137ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
7092025-01-18T05:31:33.137ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
7102025-01-18T05:31:33.203ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
7112025-01-18T05:31:33.203ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
7122025-01-18T05:31:33.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b") failed: Property not found. retry in 289.23058ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b
7132025-01-18T05:31:33.230ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
7142025-01-18T05:31:33.230ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
7152025-01-18T05:31:33.304ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
7162025-01-18T05:31:33.304ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
7172025-01-18T05:31:33.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae") failed: Property not found. retry in 544.452143ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
7182025-01-18T05:31:33.400ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7192025-01-18T05:31:33.400ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7202025-01-18T05:31:33.432ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7212025-01-18T05:31:33.465ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7222025-01-18T05:31:33.465ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7232025-01-18T05:31:33.465ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7242025-01-18T05:31:33.465ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7252025-01-18T05:31:33.502ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7262025-01-18T05:31:33.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b") failed: Property not found. retry in 842.359719ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b
7272025-01-18T05:31:33.556ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7282025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7292025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7302025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7312025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7322025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7332025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7342025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7352025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7362025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7372025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7382025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7392025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7402025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7412025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7422025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7432025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7442025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7452025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7462025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7472025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7482025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7492025-01-18T05:31:33.556ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7502025-01-18T05:31:33.607ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5664636444645776685 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
7512025-01-18T05:31:33.607ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11988985600415669928 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
7522025-01-18T05:31:33.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de") failed: Property not found. retry in 844.375724ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
7532025-01-18T05:31:33.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae") failed: Property not found. retry in 664.736246ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
7542025-01-18T05:31:34.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b") failed: Property not found. retry in 1.380969682s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b
7552025-01-18T05:31:34.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de") failed: Property not found. retry in 868.002308ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
7562025-01-18T05:31:34.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae") failed: Property not found. retry in 1.42177465s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
7572025-01-18T05:31:35.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de") failed: Property not found. retry in 512.008472ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
7582025-01-18T05:31:35.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b") failed: Property not found. retry in 1.475253953s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b
7592025-01-18T05:31:35.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de") failed: Property not found. retry in 1.420865287s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
7602025-01-18T05:31:36.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae") failed: Property not found. retry in 1.294204971s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
7612025-01-18T05:31:37.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b") failed: Property not found. retry in 1.076086029s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b
7622025-01-18T05:31:37.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae") failed: Property not found. retry in 1.226609344s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
7632025-01-18T05:31:38.434ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/bcda1f83-6e29-4607-a063-c64866d2cd5c) file = sled-agent/src/nexus.rs:527 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
7642025-01-18T05:31:38.605ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_d9dcabc2-9e0a-4cc2-9796-7545bc4998ae
7652025-01-18T05:31:38.605ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_125376f0-a418-44ab-88a5-9cefaa3f0c0b
7662025-01-18T05:31:38.605ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_826c9d0d-e674-4c46-b1e3-258d45a5c1de
7672025-01-18T05:31:38.605ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682025-01-18T05:31:38.605ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692025-01-18T05:31:38.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9020114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45828 req_id = 2caa8b50-7d56-4735-bac7-34bc054871b5 response_code = 204 uri = /omicron-zones
7702025-01-18T05:31:38.608ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7712025-01-18T05:31:38.661ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722025-01-18T05:31:38.707ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732025-01-18T05:31:38.753ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7742025-01-18T05:31:38.753ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7752025-01-18T05:31:38.785ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7762025-01-18T05:31:38.785ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7772025-01-18T05:31:38.785ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7782025-01-18T05:31:38.815ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 826c9d0d-e674-4c46-b1e3-258d45a5c1de (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d9dcabc2-9e0a-4cc2-9796-7545bc4998ae (service), filesystem_pool: Some(ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 125376f0-a418-44ab-88a5-9cefaa3f0c0b (service), filesystem_pool: Some(ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6fd22947-e367-4a00-b996-0ed694539d7a (service), filesystem_pool: Some(ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8744265e-f4ff-47b7-857d-cd5e341df030, kind: Service { id: 6fd22947-e367-4a00-b996-0ed694539d7a }, name: Name("ntp-6fd22947-e367-4a00-b996-0ed694539d7a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 120])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7792025-01-18T05:31:38.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57683
7802025-01-18T05:31:38.815ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812025-01-18T05:31:38.815ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822025-01-18T05:31:38.826ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-01-18T05:31:38.826ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-01-18T05:31:38.837ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-01-18T05:31:38.837ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-01-18T05:31:38.847ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872025-01-18T05:31:38.847ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-zones.json file = common/src/ledger.rs:177
7882025-01-18T05:31:38.847ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-zones.json file = common/src/ledger.rs:177
7892025-01-18T05:31:38.847ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7902025-01-18T05:31:38.859ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7912025-01-18T05:31:38.891ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7922025-01-18T05:31:38.891ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7932025-01-18T05:31:38.891ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7942025-01-18T05:31:38.921ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 212, 120]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7952025-01-18T05:31:38.921ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7962025-01-18T05:31:38.921ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7972025-01-18T05:31:38.921ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7982025-01-18T05:31:38.922ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7992025-01-18T05:31:38.922ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8002025-01-18T05:31:38.947ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a file = illumos-utils/src/zone.rs:325
8012025-01-18T05:31:38.965ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a file = illumos-utils/src/zone.rs:363
8022025-01-18T05:31:39.559ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8032025-01-18T05:31:39.559ZINFOSledAgent (ServiceManager): Booting oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8042025-01-18T05:31:39.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a") failed: Property not found. retry in 73.736745ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8052025-01-18T05:31:39.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a") failed: Property not found. retry in 50.375615ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8062025-01-18T05:31:39.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a") failed: Property not found. retry in 110.982242ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8072025-01-18T05:31:39.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a") failed: Property not found. retry in 393.080916ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8082025-01-18T05:31:40.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a") failed: Property not found. retry in 1.112237203s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8092025-01-18T05:31:41.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a") failed: Property not found. retry in 995.354423ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8102025-01-18T05:31:42.223ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11273279781320411627 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8112025-01-18T05:31:42.223ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16129014751436204083 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8122025-01-18T05:31:42.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a") failed: Property not found. retry in 954.967974ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8132025-01-18T05:31:43.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a") failed: Property not found. retry in 821.92658ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8142025-01-18T05:31:43.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5664636444645776685 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8152025-01-18T05:31:43.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11988985600415669928 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8162025-01-18T05:31:44.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a") failed: Property not found. retry in 897.227912ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8172025-01-18T05:31:45.208ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a
8182025-01-18T05:31:45.208ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8192025-01-18T05:31:45.208ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8202025-01-18T05:31:45.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6393715 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57683 req_id = 6ef42747-7805-4a21-a71c-0109b417ecdc response_code = 204 uri = /omicron-zones
8212025-01-18T05:31:45.211ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8222025-01-18T05:31:45.241ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8232025-01-18T05:31:45.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45415
8242025-01-18T05:31:45.249ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8252025-01-18T05:31:45.249ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 7912 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45415 req_id = b6a0ff05-f4a9-4410-9439-71feee8107fa response_code = 500 uri = /timesync
8262025-01-18T05:31:45.251ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8272025-01-18T05:31:45.376ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8282025-01-18T05:31:45.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43847
8292025-01-18T05:31:49.385ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8302025-01-18T05:31:49.385ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008892 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43847 req_id = 41ef23d5-2997-4279-84de-720ede341202 response_code = 500 uri = /timesync
8312025-01-18T05:31:49.387ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11186850401607651100 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8322025-01-18T05:31:49.387ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2637101639402896036 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8332025-01-18T05:31:49.388ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15207085928472908281 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8342025-01-18T05:31:49.388ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8352025-01-18T05:31:49.523ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8362025-01-18T05:31:49.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42032
8372025-01-18T05:31:49.532ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8382025-01-18T05:31:49.532ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8693 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42032 req_id = 0065bdd8-4765-444e-b81c-a7c4dafc27d7 response_code = 500 uri = /timesync
8392025-01-18T05:31:49.535ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8402025-01-18T05:31:49.695ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8412025-01-18T05:31:49.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35627
8422025-01-18T05:31:54.616ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6fd22947-e367-4a00-b996-0ed694539d7a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8432025-01-18T05:31:54.616ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008798 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35627 req_id = f0ec98f6-313e-4b24-b460-0c3e9d201df3 response_code = 500 uri = /timesync
8442025-01-18T05:31:54.618ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11273279781320411627 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8452025-01-18T05:31:54.618ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16129014751436204083 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8462025-01-18T05:31:54.618ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5664636444645776685 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8472025-01-18T05:31:54.618ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11988985600415669928 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8482025-01-18T05:31:54.619ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8492025-01-18T05:31:54.759ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8502025-01-18T05:31:54.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58951
8512025-01-18T05:31:54.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8973 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58951 req_id = 90924532-79a3-4aaf-9b4c-ef762fdeca4b response_code = 200 uri = /timesync
8522025-01-18T05:31:54.771ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.061819904 } file = sled-agent/src/rack_setup/service.rs:743
8532025-01-18T05:31:54.771ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8542025-01-18T05:31:55.107ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8552025-01-18T05:31:55.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57190
8562025-01-18T05:31:55.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8587 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57190 req_id = 7058bcfb-55de-4c18-9d5f-6f63a72dcf9f response_code = 200 uri = /timesync
8572025-01-18T05:31:55.119ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.060873922 } file = sled-agent/src/rack_setup/service.rs:743
8582025-01-18T05:31:55.119ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8592025-01-18T05:31:55.486ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8602025-01-18T05:31:55.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42981
8612025-01-18T05:31:55.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8541 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42981 req_id = 9f6dc472-a834-48ec-959e-6bbd51d0c4a6 response_code = 200 uri = /timesync
8622025-01-18T05:31:55.497ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.062245209 } file = sled-agent/src/rack_setup/service.rs:743
8632025-01-18T05:31:55.497ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8642025-01-18T05:31:55.698ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8652025-01-18T05:31:55.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62146
8662025-01-18T05:31:55.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7810 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62146 req_id = 68f74ddd-ac7b-419c-9dfd-3e8083b256a2 response_code = 200 uri = /timesync
8672025-01-18T05:31:55.708ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.061670776 } file = sled-agent/src/rack_setup/service.rs:743
8682025-01-18T05:31:55.708ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8692025-01-18T05:31:56.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6317757927835362305 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8702025-01-18T05:31:56.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5477129576554869332 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
8712025-01-18T05:31:56.174ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8722025-01-18T05:31:56.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55806
8732025-01-18T05:31:56.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7884 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55806 req_id = ebf2edfe-c5fa-4a3f-8b77-8a63c65e82d1 response_code = 200 uri = /timesync
8742025-01-18T05:31:56.185ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.060376696 } file = sled-agent/src/rack_setup/service.rs:743
8752025-01-18T05:31:56.185ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8762025-01-18T05:31:56.774ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8772025-01-18T05:31:56.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39985
8782025-01-18T05:31:56.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39985 req_id = 30dca7ad-0c34-4142-b961-bfe7e5823498 response_code = 200 uri = /timesync
8792025-01-18T05:31:56.785ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2919222938, ip_addr: 173.255.206.154, stratum: 3, ref_time: 1737178315.4271295, correction: -0.053308189 } file = sled-agent/src/rack_setup/service.rs:743
8802025-01-18T05:31:56.785ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8812025-01-18T05:31:57.437ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8822025-01-18T05:31:57.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45762
8832025-01-18T05:31:57.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 19942 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45762 req_id = cdd94d0c-0548-402f-84be-a9a98857c9dc response_code = 200 uri = /timesync
8842025-01-18T05:31:57.461ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2919222938, ip_addr: 173.255.206.154, stratum: 3, ref_time: 1737178316.8258488, correction: -0.048240457 } file = sled-agent/src/rack_setup/service.rs:743
8852025-01-18T05:31:57.461ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8862025-01-18T05:31:57.491ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 826c9d0d-e674-4c46-b1e3-258d45a5c1de (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d9dcabc2-9e0a-4cc2-9796-7545bc4998ae (service), filesystem_pool: Some(ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 125376f0-a418-44ab-88a5-9cefaa3f0c0b (service), filesystem_pool: Some(ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6fd22947-e367-4a00-b996-0ed694539d7a (service), filesystem_pool: Some(ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8744265e-f4ff-47b7-857d-cd5e341df030, kind: Service { id: 6fd22947-e367-4a00-b996-0ed694539d7a }, name: Name("ntp-6fd22947-e367-4a00-b996-0ed694539d7a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 120])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: b13e9c2a-a286-4f1e-a49e-a8eb1acba96d (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External } } } }, OmicronZoneConfig { id: 168600b0-5561-4df0-a7cf-76b932b96ade (service), filesystem_pool: Some(ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 36848c7f-4709-4834-9a5b-ace69293c584 (service), filesystem_pool: Some(ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External } } } }, OmicronZoneConfig { id: 261418de-aa04-47e4-98ee-8e93aa814483 (service), filesystem_pool: Some(ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External } } } }, OmicronZoneConfig { id: 15c0dc91-7797-486c-a0a3-161411822597 (service), filesystem_pool: Some(ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8872025-01-18T05:31:57.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62968
8882025-01-18T05:31:57.492ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8892025-01-18T05:31:57.492ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8902025-01-18T05:31:57.502ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8912025-01-18T05:31:57.502ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8922025-01-18T05:31:57.511ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8932025-01-18T05:31:57.511ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8942025-01-18T05:31:57.521ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8952025-01-18T05:31:57.521ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8962025-01-18T05:31:57.530ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8972025-01-18T05:31:57.530ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8982025-01-18T05:31:57.539ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8992025-01-18T05:31:57.539ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9002025-01-18T05:31:57.547ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9012025-01-18T05:31:57.548ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9022025-01-18T05:31:57.557ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9032025-01-18T05:31:57.557ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9042025-01-18T05:31:57.566ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9052025-01-18T05:31:57.566ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-zones.json file = common/src/ledger.rs:177
9062025-01-18T05:31:57.566ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-zones.json file = common/src/ledger.rs:177
9072025-01-18T05:31:57.566ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9082025-01-18T05:31:57.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9092025-01-18T05:31:57.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9102025-01-18T05:31:57.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9112025-01-18T05:31:57.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9122025-01-18T05:31:57.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9132025-01-18T05:31:57.737ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade file = illumos-utils/src/zone.rs:325
9142025-01-18T05:31:57.740ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483 file = illumos-utils/src/zone.rs:325
9152025-01-18T05:31:57.744ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597 file = illumos-utils/src/zone.rs:325
9162025-01-18T05:31:57.748ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584 file = illumos-utils/src/zone.rs:325
9172025-01-18T05:31:57.753ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d file = illumos-utils/src/zone.rs:325
9182025-01-18T05:31:57.758ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade file = illumos-utils/src/zone.rs:363
9192025-01-18T05:31:57.762ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483 file = illumos-utils/src/zone.rs:363
9202025-01-18T05:31:57.767ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597 file = illumos-utils/src/zone.rs:363
9212025-01-18T05:31:57.771ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584 file = illumos-utils/src/zone.rs:363
9222025-01-18T05:31:57.775ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d file = illumos-utils/src/zone.rs:363
9232025-01-18T05:31:59.722ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 331.707497ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
9242025-01-18T05:32:01.740ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='15c0dc91-7797-486c-a0a3-161411822597'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9252025-01-18T05:32:01.740ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9262025-01-18T05:32:01.760ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='261418de-aa04-47e4-98ee-8e93aa814483'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9272025-01-18T05:32:01.760ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9282025-01-18T05:32:01.791ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='36848c7f-4709-4834-9a5b-ace69293c584'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9292025-01-18T05:32:01.792ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9302025-01-18T05:32:01.798ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b13e9c2a-a286-4f1e-a49e-a8eb1acba96d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9312025-01-18T05:32:01.798ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9322025-01-18T05:32:01.896ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='168600b0-5561-4df0-a7cf-76b932b96ade'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9332025-01-18T05:32:01.897ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9342025-01-18T05:32:01.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 36.339841ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9352025-01-18T05:32:01.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 31.19218ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9362025-01-18T05:32:01.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 60.177755ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9372025-01-18T05:32:01.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 132.129222ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9382025-01-18T05:32:01.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 26.887986ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9392025-01-18T05:32:01.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 129.096084ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9402025-01-18T05:32:02.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 81.601089ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9412025-01-18T05:32:02.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 102.448509ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9422025-01-18T05:32:02.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 42.430532ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9432025-01-18T05:32:02.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 261.594306ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9442025-01-18T05:32:02.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 283.736091ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9452025-01-18T05:32:02.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 55.381198ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9462025-01-18T05:32:02.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 218.507744ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9472025-01-18T05:32:02.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 208.828356ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9482025-01-18T05:32:02.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 184.258464ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9492025-01-18T05:32:02.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 540.950732ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9502025-01-18T05:32:02.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 473.474223ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9512025-01-18T05:32:02.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 337.481165ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9522025-01-18T05:32:02.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 533.755253ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9532025-01-18T05:32:02.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 595.923836ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9542025-01-18T05:32:02.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 1.119653974s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9552025-01-18T05:32:02.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 696.98052ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9562025-01-18T05:32:02.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 1.047361244s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9572025-01-18T05:32:02.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 667.83069ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9582025-01-18T05:32:03.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 1.123898047s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9592025-01-18T05:32:03.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 1.340147134s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9602025-01-18T05:32:03.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 1.073797112s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9612025-01-18T05:32:03.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 584.919652ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9622025-01-18T05:32:03.947ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40400
9632025-01-18T05:32:03.947ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40400 req_id = 55920841-ef92-43b1-b408-6265a17c418b response_code = 200 uri = /baseboard
9642025-01-18T05:32:03.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 1.064289307s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9652025-01-18T05:32:04.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 1.049206847s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9662025-01-18T05:32:04.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 1.330377007s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9672025-01-18T05:32:04.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 1.478400203s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9682025-01-18T05:32:05.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 1.06370804s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9692025-01-18T05:32:05.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 836.64167ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9702025-01-18T05:32:05.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 917.256384ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9712025-01-18T05:32:05.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 1.120075827s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9722025-01-18T05:32:05.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 663.466364ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9732025-01-18T05:32:06.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 636.881894ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9742025-01-18T05:32:06.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 579.888848ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9752025-01-18T05:32:06.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 838.033039ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9762025-01-18T05:32:06.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 552.618847ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9772025-01-18T05:32:06.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 787.559089ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9782025-01-18T05:32:06.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 810.41191ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9792025-01-18T05:32:06.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 780.895137ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9802025-01-18T05:32:07.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 841.053926ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9812025-01-18T05:32:07.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 1.321799427s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9822025-01-18T05:32:07.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 926.506556ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9832025-01-18T05:32:07.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 690.361156ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9842025-01-18T05:32:07.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 612.422577ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9852025-01-18T05:32:07.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 1.220725712s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9862025-01-18T05:32:08.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 1.173430684s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9872025-01-18T05:32:08.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 1.350368125s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9882025-01-18T05:32:08.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 506.178745ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9892025-01-18T05:32:08.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 1.316751112s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9902025-01-18T05:32:08.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 754.481944ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9912025-01-18T05:32:09.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 653.309888ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9922025-01-18T05:32:09.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 1.455272812s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
9932025-01-18T05:32:09.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 1.045009508s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9942025-01-18T05:32:09.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 518.494308ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9952025-01-18T05:32:09.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 1.327793605s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
9962025-01-18T05:32:09.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 1.373153281s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
9972025-01-18T05:32:10.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 1.277157164s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
9982025-01-18T05:32:10.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 778.320909ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
9992025-01-18T05:32:10.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 1.214136817s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
10002025-01-18T05:32:11.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 629.275046ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
10012025-01-18T05:32:11.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 888.537688ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
10022025-01-18T05:32:11.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 983.921802ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
10032025-01-18T05:32:11.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 693.435513ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
10042025-01-18T05:32:11.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 1.412914588s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
10052025-01-18T05:32:12.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 1.206805343s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
10062025-01-18T05:32:12.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 1.187087261s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
10072025-01-18T05:32:12.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 561.911286ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
10082025-01-18T05:32:12.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 1.212059973s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
10092025-01-18T05:32:12.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 1.201785453s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
10102025-01-18T05:32:13.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 503.274968ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
10112025-01-18T05:32:13.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 981.857266ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
10122025-01-18T05:32:13.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 1.306589915s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
10132025-01-18T05:32:13.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 1.158015045s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
10142025-01-18T05:32:13.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584") failed: Property not found. retry in 1.389688907s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
10152025-01-18T05:32:14.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 752.663825ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
10162025-01-18T05:32:14.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483") failed: Property not found. retry in 1.307796724s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
10172025-01-18T05:32:14.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade") failed: Property not found. retry in 1.375376186s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
10182025-01-18T05:32:14.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d") failed: Property not found. retry in 908.985313ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
10192025-01-18T05:32:14.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597") failed: Property not found. retry in 1.284050244s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
10202025-01-18T05:32:15.081ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 563.680896ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
10212025-01-18T05:32:16.226ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_168600b0-5561-4df0-a7cf-76b932b96ade
10222025-01-18T05:32:16.226ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_261418de-aa04-47e4-98ee-8e93aa814483
10232025-01-18T05:32:16.226ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597
10242025-01-18T05:32:16.226ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_36848c7f-4709-4834-9a5b-ace69293c584
10252025-01-18T05:32:16.226ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_b13e9c2a-a286-4f1e-a49e-a8eb1acba96d
10262025-01-18T05:32:16.226ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10272025-01-18T05:32:16.226ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10282025-01-18T05:32:16.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 18782647 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62968 req_id = d2658142-1242-4dd5-b79d-33b2efd13c59 response_code = 204 uri = /omicron-zones
10292025-01-18T05:32:16.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57921
10302025-01-18T05:32:16.286ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26448 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57921 req_id = ee6c5c5b-4b43-4ab3-8712-3b100f029b9b response_code = 500 uri = /cockroachdb
10312025-01-18T05:32:16.287ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ee6c5c5b-4b43-4ab3-8712-3b100f029b9b", "content-length": "124", "date": "Sat, 18 Jan 2025 05:32:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ee6c5c5b-4b43-4ab3-8712-3b100f029b9b" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 128.566651ms
10322025-01-18T05:32:16.440ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 24364 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57921 req_id = a3ceb082-4a6f-4481-b440-fc981c3fa603 response_code = 500 uri = /cockroachdb
10332025-01-18T05:32:16.440ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a3ceb082-4a6f-4481-b440-fc981c3fa603", "content-length": "124", "date": "Sat, 18 Jan 2025 05:32:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a3ceb082-4a6f-4481-b440-fc981c3fa603" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 93.728098ms
10342025-01-18T05:32:16.563ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57921 req_id = 1034207c-596e-422b-ab20-2627a3dae08c response_code = 500 uri = /cockroachdb
10352025-01-18T05:32:16.563ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1034207c-596e-422b-ab20-2627a3dae08c", "content-length": "124", "date": "Sat, 18 Jan 2025 05:32:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1034207c-596e-422b-ab20-2627a3dae08c" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 75.973441ms
10362025-01-18T05:32:16.667ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27084 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57921 req_id = 19eee5b6-cde4-4e8c-95db-7eae631db033 response_code = 500 uri = /cockroachdb
10372025-01-18T05:32:16.668ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "19eee5b6-cde4-4e8c-95db-7eae631db033", "content-length": "124", "date": "Sat, 18 Jan 2025 05:32:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "19eee5b6-cde4-4e8c-95db-7eae631db033" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 169.19356ms
10382025-01-18T05:32:16.865ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26759 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57921 req_id = 486b3fca-3178-4f17-bafe-9172673562e5 response_code = 500 uri = /cockroachdb
10392025-01-18T05:32:16.865ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "486b3fca-3178-4f17-bafe-9172673562e5", "content-length": "124", "date": "Sat, 18 Jan 2025 05:32:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "486b3fca-3178-4f17-bafe-9172673562e5" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 231.25021ms
10402025-01-18T05:32:17.124ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_15c0dc91-7797-486c-a0a3-161411822597 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27144 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57921 req_id = 9dac5956-6565-4614-b484-cbce0634240a response_code = 500 uri = /cockroachdb
10412025-01-18T05:32:17.125ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9dac5956-6565-4614-b484-cbce0634240a", "content-length": "124", "date": "Sat, 18 Jan 2025 05:32:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9dac5956-6565-4614-b484-cbce0634240a" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 368.021393ms
10422025-01-18T05:32:17.533ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3752
10432025-01-18T05:32:39.326ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
10442025-01-18T05:32:43.713ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
10452025-01-18T05:32:43.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 26218965 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57921 req_id = 05a76589-923d-4c55-8c1e-a281e5e4224b response_code = 204 uri = /cockroachdb
10462025-01-18T05:32:43.716ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45039
10472025-01-18T05:32:43.717ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 379 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45039 req_id = dd551bb3-b7c2-4ced-b749-e79a959a4b29 response_code = 200 uri = /baseboard
10482025-01-18T05:32:43.730ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 540.437132ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
10492025-01-18T05:32:43.759ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 826c9d0d-e674-4c46-b1e3-258d45a5c1de (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d9dcabc2-9e0a-4cc2-9796-7545bc4998ae (service), filesystem_pool: Some(ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 125376f0-a418-44ab-88a5-9cefaa3f0c0b (service), filesystem_pool: Some(ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6fd22947-e367-4a00-b996-0ed694539d7a (service), filesystem_pool: Some(ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 8744265e-f4ff-47b7-857d-cd5e341df030, kind: Service { id: 6fd22947-e367-4a00-b996-0ed694539d7a }, name: Name("ntp-6fd22947-e367-4a00-b996-0ed694539d7a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 120])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: b13e9c2a-a286-4f1e-a49e-a8eb1acba96d (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External } } } }, OmicronZoneConfig { id: 168600b0-5561-4df0-a7cf-76b932b96ade (service), filesystem_pool: Some(ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 36848c7f-4709-4834-9a5b-ace69293c584 (service), filesystem_pool: Some(ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External } } } }, OmicronZoneConfig { id: 261418de-aa04-47e4-98ee-8e93aa814483 (service), filesystem_pool: Some(ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External } } } }, OmicronZoneConfig { id: 15c0dc91-7797-486c-a0a3-161411822597 (service), filesystem_pool: Some(ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 (service), filesystem_pool: Some(ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc (service), filesystem_pool: Some(ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a030d6fe-5525-4fd9-b798-deef6a379607 (service), filesystem_pool: Some(ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: dc75c5f5-6608-453d-8b53-d1945633bfdb (service), filesystem_pool: Some(ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8a8f878d-1d64-4f27-bb7c-6a7428882116 (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: a94d6306-8e13-46d8-ac5c-3a6c8f361018 (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External } } } }, OmicronZoneConfig { id: a1595fda-fe38-4a77-ba44-643c7d59caa4 (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: d3557906-e137-4aa1-b963-a4db57d1f0ee (service), filesystem_pool: Some(ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: db9937b6-5687-4e75-a845-adcd315b6ac9 (service), filesystem_pool: Some(ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 39c565ae-135a-47ee-a066-91784d50b5e8 (service), filesystem_pool: Some(ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9be5863d-e269-40d5-bfc1-948d2bed0173 (service), filesystem_pool: Some(ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External } } } }, OmicronZoneConfig { id: f0ab8838-1fca-48d0-8066-01e038a185fd (service), filesystem_pool: Some(ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External } } } }, OmicronZoneConfig { id: 388351c9-9262-4acc-99df-c9a606149f67 (service), filesystem_pool: Some(ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7e217192-8c56-455b-9e82-8cb54dcbfe21 (service), filesystem_pool: Some(ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1b27ab95-76bc-4957-8576-19c8066a590b (service), filesystem_pool: Some(ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External } } } }, OmicronZoneConfig { id: ceb2a600-a841-4f52-af35-982e475f940e (service), filesystem_pool: Some(ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External } } } }, OmicronZoneConfig { id: 01a4829a-1f64-47ac-a2b0-622ca42defd2 (service), filesystem_pool: Some(ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External } } } }, OmicronZoneConfig { id: a8059edc-a66f-4331-ac61-34d8c71f6a8d (service), filesystem_pool: Some(ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10502025-01-18T05:32:43.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33326
10512025-01-18T05:32:43.761ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10522025-01-18T05:32:43.761ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10532025-01-18T05:32:43.778ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10542025-01-18T05:32:43.778ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10552025-01-18T05:32:43.788ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10562025-01-18T05:32:43.788ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10572025-01-18T05:32:43.801ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10582025-01-18T05:32:43.801ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10592025-01-18T05:32:43.812ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10602025-01-18T05:32:43.812ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10612025-01-18T05:32:43.824ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10622025-01-18T05:32:43.824ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10632025-01-18T05:32:43.834ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10642025-01-18T05:32:43.834ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10652025-01-18T05:32:43.843ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10662025-01-18T05:32:43.843ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10672025-01-18T05:32:43.854ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10682025-01-18T05:32:43.854ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10692025-01-18T05:32:43.865ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10702025-01-18T05:32:43.865ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10712025-01-18T05:32:43.886ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10722025-01-18T05:32:43.887ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10732025-01-18T05:32:43.897ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10742025-01-18T05:32:43.897ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, kind: Crucible }, responder: ... }
10752025-01-18T05:32:43.906ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10762025-01-18T05:32:43.906ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10772025-01-18T05:32:43.919ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10782025-01-18T05:32:43.919ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, kind: Crucible }, responder: ... }
10792025-01-18T05:32:43.931ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10802025-01-18T05:32:43.931ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, kind: Crucible }, responder: ... }
10812025-01-18T05:32:43.942ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10822025-01-18T05:32:43.942ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, kind: Crucible }, responder: ... }
10832025-01-18T05:32:43.954ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10842025-01-18T05:32:43.954ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, kind: Crucible }, responder: ... }
10852025-01-18T05:32:43.966ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10862025-01-18T05:32:43.966ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, kind: Crucible }, responder: ... }
10872025-01-18T05:32:43.977ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10882025-01-18T05:32:43.977ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, kind: Crucible }, responder: ... }
10892025-01-18T05:32:43.990ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10902025-01-18T05:32:43.990ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, kind: Crucible }, responder: ... }
10912025-01-18T05:32:44.004ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10922025-01-18T05:32:44.004ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-zones.json file = common/src/ledger.rs:177
10932025-01-18T05:32:44.005ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-zones.json file = common/src/ledger.rs:177
10942025-01-18T05:32:44.005ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10952025-01-18T05:32:44.143ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10962025-01-18T05:32:44.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10972025-01-18T05:32:44.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10982025-01-18T05:32:44.145ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10992025-01-18T05:32:44.201ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11002025-01-18T05:32:44.201ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11012025-01-18T05:32:44.201ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11022025-01-18T05:32:44.201ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11032025-01-18T05:32:44.201ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11042025-01-18T05:32:44.204ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11052025-01-18T05:32:44.372ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11062025-01-18T05:32:44.398ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11072025-01-18T05:32:44.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11082025-01-18T05:32:44.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11092025-01-18T05:32:44.447ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11102025-01-18T05:32:44.447ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11112025-01-18T05:32:44.447ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11122025-01-18T05:32:44.447ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11132025-01-18T05:32:44.447ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11142025-01-18T05:32:44.447ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9 file = illumos-utils/src/zone.rs:325
11152025-01-18T05:32:44.452ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67 file = illumos-utils/src/zone.rs:325
11162025-01-18T05:32:44.458ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116 file = illumos-utils/src/zone.rs:325
11172025-01-18T05:32:44.463ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee file = illumos-utils/src/zone.rs:325
11182025-01-18T05:32:44.469ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b file = illumos-utils/src/zone.rs:325
11192025-01-18T05:32:44.474ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e file = illumos-utils/src/zone.rs:325
11202025-01-18T05:32:44.479ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2 file = illumos-utils/src/zone.rs:325
11212025-01-18T05:32:44.483ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d file = illumos-utils/src/zone.rs:325
11222025-01-18T05:32:44.603ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9 file = illumos-utils/src/zone.rs:363
11232025-01-18T05:32:44.607ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67 file = illumos-utils/src/zone.rs:363
11242025-01-18T05:32:44.612ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116 file = illumos-utils/src/zone.rs:363
11252025-01-18T05:32:44.616ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee file = illumos-utils/src/zone.rs:363
11262025-01-18T05:32:44.621ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b file = illumos-utils/src/zone.rs:363
11272025-01-18T05:32:44.626ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e file = illumos-utils/src/zone.rs:363
11282025-01-18T05:32:44.631ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2 file = illumos-utils/src/zone.rs:363
11292025-01-18T05:32:44.636ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d file = illumos-utils/src/zone.rs:363
11302025-01-18T05:32:44.641ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd file = illumos-utils/src/zone.rs:325
11312025-01-18T05:32:44.647ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018 file = illumos-utils/src/zone.rs:325
11322025-01-18T05:32:44.652ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4 file = illumos-utils/src/zone.rs:325
11332025-01-18T05:32:44.657ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8 file = illumos-utils/src/zone.rs:325
11342025-01-18T05:32:44.662ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21 file = illumos-utils/src/zone.rs:325
11352025-01-18T05:32:44.668ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173 file = illumos-utils/src/zone.rs:325
11362025-01-18T05:32:44.675ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd file = illumos-utils/src/zone.rs:363
11372025-01-18T05:32:44.683ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018 file = illumos-utils/src/zone.rs:363
11382025-01-18T05:32:44.692ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4 file = illumos-utils/src/zone.rs:363
11392025-01-18T05:32:44.701ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8 file = illumos-utils/src/zone.rs:363
11402025-01-18T05:32:44.713ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21 file = illumos-utils/src/zone.rs:363
11412025-01-18T05:32:44.728ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173 file = illumos-utils/src/zone.rs:363
11422025-01-18T05:32:44.841ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11432025-01-18T05:32:44.922ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11442025-01-18T05:32:45.091ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11452025-01-18T05:32:45.218ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11462025-01-18T05:32:45.469ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11472025-01-18T05:32:45.472ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11482025-01-18T05:32:45.472ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11492025-01-18T05:32:45.571ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 198, 63]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11502025-01-18T05:32:45.571ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11512025-01-18T05:32:45.573ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11522025-01-18T05:32:45.573ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11532025-01-18T05:32:45.630ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 190, 171]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11542025-01-18T05:32:45.630ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11552025-01-18T05:32:45.632ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11562025-01-18T05:32:45.632ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11572025-01-18T05:32:45.691ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 249, 201]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11582025-01-18T05:32:45.691ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11592025-01-18T05:32:45.691ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11602025-01-18T05:32:45.691ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11612025-01-18T05:32:45.691ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11622025-01-18T05:32:45.691ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11632025-01-18T05:32:45.693ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11642025-01-18T05:32:45.693ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11652025-01-18T05:32:45.751ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 130, 3]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11662025-01-18T05:32:45.751ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11672025-01-18T05:32:45.752ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11682025-01-18T05:32:45.752ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11692025-01-18T05:32:45.810ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 207, 13]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11702025-01-18T05:32:45.810ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11712025-01-18T05:32:45.811ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11722025-01-18T05:32:45.812ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11732025-01-18T05:32:45.814ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11742025-01-18T05:32:45.814ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11752025-01-18T05:32:45.890ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11762025-01-18T05:32:45.890ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11772025-01-18T05:32:45.890ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a file = illumos-utils/src/zone.rs:325
11782025-01-18T05:32:45.898ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11792025-01-18T05:32:45.898ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11802025-01-18T05:32:45.899ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11812025-01-18T05:32:45.899ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11822025-01-18T05:32:45.899ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11832025-01-18T05:32:45.902ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11842025-01-18T05:32:45.902ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11852025-01-18T05:32:45.905ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11862025-01-18T05:32:45.908ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11872025-01-18T05:32:45.952ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11882025-01-18T05:32:45.952ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a file = illumos-utils/src/zone.rs:363
11892025-01-18T05:32:45.965ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607 file = illumos-utils/src/zone.rs:325
11902025-01-18T05:32:46.086ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98 file = illumos-utils/src/zone.rs:325
11912025-01-18T05:32:46.135ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607 file = illumos-utils/src/zone.rs:363
11922025-01-18T05:32:46.155ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb file = illumos-utils/src/zone.rs:325
11932025-01-18T05:32:46.188ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc file = illumos-utils/src/zone.rs:325
11942025-01-18T05:32:46.214ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98 file = illumos-utils/src/zone.rs:363
11952025-01-18T05:32:46.245ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb file = illumos-utils/src/zone.rs:363
11962025-01-18T05:32:46.270ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc file = illumos-utils/src/zone.rs:363
11972025-01-18T05:32:55.041ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982025-01-18T05:32:55.051ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11992025-01-18T05:32:55.064ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
12002025-01-18T05:32:55.104ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
12012025-01-18T05:32:55.127ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d55380f8-3d86-4c31-b244-3f6e51844733/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cb26e60a-fab3-4586-8f4e-b39fcdadb66d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12022025-01-18T05:32:55.128ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_719280f2-3e89-4055-a81d-4f9adba21825/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e74d0cf0-b0bc-4c06-8d4c-a4a8fcd222e8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12032025-01-18T05:32:55.128ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='36a7684f-8299-4614-8429-32c108fb7dad'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12042025-01-18T05:32:55.128ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2f80e4ea-2dce-4f75-98fa-c0ab984b2267'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12052025-01-18T05:32:55.128ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5880f45f-35de-41ab-b126-dd90b99bfadf'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12062025-01-18T05:32:55.128ZINFOSledAgent (ServiceManager): Booting oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
12072025-01-18T05:32:55.131ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cb543c1b-d520-4525-93a9-0809c84c04cd/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='123223dd-a960-49a4-8110-4b0b132f5e45'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12082025-01-18T05:32:55.131ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
12092025-01-18T05:32:55.137ZINFOSledAgent (ServiceManager): Booting oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
12102025-01-18T05:32:55.144ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
12112025-01-18T05:32:55.150ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_18259e54-9e24-4df6-8524-340cf6c3dae0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8c79cd24-77fd-449e-b9e0-4c01ab5f7ee0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12122025-01-18T05:32:55.150ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
12132025-01-18T05:32:55.157ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
12142025-01-18T05:32:55.164ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
12152025-01-18T05:32:55.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 58.54838ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
12162025-01-18T05:32:55.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 53.896773ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
12172025-01-18T05:32:55.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 52.992228ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
12182025-01-18T05:32:55.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 31.98902ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
12192025-01-18T05:32:55.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 39.422543ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
12202025-01-18T05:32:55.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 53.39589ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
12212025-01-18T05:32:55.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 67.96373ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
12222025-01-18T05:32:55.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 67.286094ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
12232025-01-18T05:32:55.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 107.814534ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
12242025-01-18T05:32:55.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 135.167038ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
12252025-01-18T05:32:55.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 36.826736ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
12262025-01-18T05:32:55.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 135.408368ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
12272025-01-18T05:32:55.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 90.426292ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
12282025-01-18T05:32:55.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 103.718648ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
12292025-01-18T05:32:55.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 95.681569ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
12302025-01-18T05:32:55.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 63.998773ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
12312025-01-18T05:32:55.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 111.728853ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
12322025-01-18T05:32:55.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 119.488401ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
12332025-01-18T05:32:55.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 268.664914ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
12342025-01-18T05:32:55.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 158.083032ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
12352025-01-18T05:32:55.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 122.831163ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
12362025-01-18T05:32:55.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 240.914472ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
12372025-01-18T05:32:55.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 273.992093ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
12382025-01-18T05:32:55.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 154.573298ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
12392025-01-18T05:32:55.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 105.231234ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
12402025-01-18T05:32:55.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 161.816895ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
12412025-01-18T05:32:55.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 192.777699ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
12422025-01-18T05:32:55.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 537.250796ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
12432025-01-18T05:32:56.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 389.805049ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
12442025-01-18T05:32:56.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 272.749234ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
12452025-01-18T05:32:56.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 436.034342ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
12462025-01-18T05:33:00.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 356.503122ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
12472025-01-18T05:33:01.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 552.620813ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
12482025-01-18T05:33:01.372ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.379439851s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
12492025-01-18T05:33:01.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 235.277037ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
12502025-01-18T05:33:01.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 664.613306ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
12512025-01-18T05:33:01.468ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c21cd893-327a-4753-8679-0acb3c938801'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12522025-01-18T05:33:01.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 493.526967ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
12532025-01-18T05:33:01.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 533.551454ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
12542025-01-18T05:33:01.503ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12552025-01-18T05:33:01.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 422.072208ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
12562025-01-18T05:33:01.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 735.038583ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
12572025-01-18T05:33:01.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 1.156901019s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
12582025-01-18T05:33:01.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 601.798988ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
12592025-01-18T05:33:01.578ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
12602025-01-18T05:33:01.587ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
12612025-01-18T05:33:01.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 531.365855ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
12622025-01-18T05:33:01.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 438.32832ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
12632025-01-18T05:33:01.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 617.116187ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
12642025-01-18T05:33:02.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 464.841172ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
12652025-01-18T05:33:02.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 882.240145ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
12662025-01-18T05:33:02.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 59.862691ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
12672025-01-18T05:33:02.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 25.398425ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
12682025-01-18T05:33:02.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 758.212277ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
12692025-01-18T05:33:02.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 139.270722ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
12702025-01-18T05:33:02.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 133.329299ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
12712025-01-18T05:33:02.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 589.849603ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
12722025-01-18T05:33:02.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 965.635985ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
12732025-01-18T05:33:02.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 800.611846ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
12742025-01-18T05:33:02.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 1.347713299s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
12752025-01-18T05:33:02.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 148.864774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
12762025-01-18T05:33:02.343ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12772025-01-18T05:33:02.345ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
12782025-01-18T05:33:02.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 110.574102ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
12792025-01-18T05:33:02.425ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d841ded1-e9f5-4cd1-90ff-c82c88ff7173'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12802025-01-18T05:33:02.425ZINFOSledAgent (ServiceManager): Booting oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
12812025-01-18T05:33:02.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 719.502593ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
12822025-01-18T05:33:02.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 218.462624ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
12832025-01-18T05:33:02.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 216.338689ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
12842025-01-18T05:33:02.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 1.213294625s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
12852025-01-18T05:33:02.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 31.407549ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
12862025-01-18T05:33:02.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 108.198545ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
12872025-01-18T05:33:02.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 73.265862ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
12882025-01-18T05:33:02.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 1.490933132s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
12892025-01-18T05:33:02.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 844.626018ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
12902025-01-18T05:33:02.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 292.09449ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
12912025-01-18T05:33:02.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 104.051797ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
12922025-01-18T05:33:02.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 485.608776ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
12932025-01-18T05:33:02.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 565.459712ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
12942025-01-18T05:33:03.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 971.291217ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
12952025-01-18T05:33:03.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 132.178442ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
12962025-01-18T05:33:03.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 1.133999188s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
12972025-01-18T05:33:03.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 1.109668117s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
12982025-01-18T05:33:03.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 561.086839ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
12992025-01-18T05:33:03.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 324.218623ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
13002025-01-18T05:33:03.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 1.30320846s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
13012025-01-18T05:33:03.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 890.582524ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
13022025-01-18T05:33:03.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 1.145954189s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
13032025-01-18T05:33:03.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 987.005956ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
13042025-01-18T05:33:03.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 1.101489537s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
13052025-01-18T05:33:03.626ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13062025-01-18T05:33:03.628ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13072025-01-18T05:33:03.628ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
13082025-01-18T05:33:03.636ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092025-01-18T05:33:03.637ZINFOSledAgent (ServiceManager): Booting oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
13102025-01-18T05:33:03.644ZINFOSledAgent (ServiceManager): Booting oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
13112025-01-18T05:33:03.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 856.13151ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
13122025-01-18T05:33:03.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 1.164141489s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
13132025-01-18T05:33:03.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 509.206681ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
13142025-01-18T05:33:03.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 1.063446729s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
13152025-01-18T05:33:03.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 27.360526ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
13162025-01-18T05:33:03.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 47.435514ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
13172025-01-18T05:33:03.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 26.944246ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
13182025-01-18T05:33:04.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 111.87819ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
13192025-01-18T05:33:04.163ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='8a8f878d-1d64-4f27-bb7c-6a7428882116'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13202025-01-18T05:33:04.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 852.877806ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
13212025-01-18T05:33:04.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 144.723715ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
13222025-01-18T05:33:04.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 96.291007ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
13232025-01-18T05:33:04.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 526.369726ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
13242025-01-18T05:33:04.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 251.537955ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
13252025-01-18T05:33:04.260ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
13262025-01-18T05:33:04.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 521.013968ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
13272025-01-18T05:33:04.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 518.434421ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
13282025-01-18T05:33:04.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 1.182661061s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
13292025-01-18T05:33:04.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 1.170109692s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
13302025-01-18T05:33:04.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 205.107656ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
13312025-01-18T05:33:04.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 104.037055ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
13322025-01-18T05:33:04.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 323.977043ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
13332025-01-18T05:33:04.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 66.332036ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
13342025-01-18T05:33:04.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 383.160394ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
13352025-01-18T05:33:04.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 823.446636ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
13362025-01-18T05:33:04.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 738.320773ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
13372025-01-18T05:33:04.550ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13382025-01-18T05:33:04.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 733.870358ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
13392025-01-18T05:33:04.560ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
13402025-01-18T05:33:04.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 287.063245ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
13412025-01-18T05:33:04.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 674.100503ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
13422025-01-18T05:33:04.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 61.713705ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
13432025-01-18T05:33:04.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 743.093292ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
13442025-01-18T05:33:04.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 286.279238ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
13452025-01-18T05:33:04.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 629.124711ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
13462025-01-18T05:33:04.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 1.458281829s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
13472025-01-18T05:33:04.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 784.667009ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
13482025-01-18T05:33:04.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 557.403132ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
13492025-01-18T05:33:04.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 1.425983222s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
13502025-01-18T05:33:04.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 947.756159ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
13512025-01-18T05:33:04.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 35.859879ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
13522025-01-18T05:33:04.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 583.490694ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
13532025-01-18T05:33:04.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 600.705592ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
13542025-01-18T05:33:05.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 135.830207ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
13552025-01-18T05:33:05.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 505.248986ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
13562025-01-18T05:33:05.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 1.167120716s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
13572025-01-18T05:33:05.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 101.069157ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
13582025-01-18T05:33:05.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 860.496501ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
13592025-01-18T05:33:05.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 410.540957ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
13602025-01-18T05:33:05.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 1.379543606s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
13612025-01-18T05:33:05.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 1.392144166s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
13622025-01-18T05:33:05.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 1.025106871s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
13632025-01-18T05:33:05.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 1.224131945s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
13642025-01-18T05:33:05.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 1.462497373s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
13652025-01-18T05:33:05.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 500.340754ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
13662025-01-18T05:33:05.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 803.679464ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
13672025-01-18T05:33:05.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 1.366535198s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
13682025-01-18T05:33:05.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 1.367560908s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
13692025-01-18T05:33:05.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 737.396299ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
13702025-01-18T05:33:05.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 1.272576595s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
13712025-01-18T05:33:05.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 1.441002131s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
13722025-01-18T05:33:05.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 646.148554ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
13732025-01-18T05:33:05.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 504.172413ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
13742025-01-18T05:33:05.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 1.383453254s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
13752025-01-18T05:33:06.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 1.25987692s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
13762025-01-18T05:33:06.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 932.667405ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
13772025-01-18T05:33:06.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 1.112252025s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
13782025-01-18T05:33:06.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 1.240032822s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
13792025-01-18T05:33:06.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 604.351193ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
13802025-01-18T05:33:06.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 763.914911ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
13812025-01-18T05:33:06.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 1.305107739s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
13822025-01-18T05:33:06.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 1.188780202s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
13832025-01-18T05:33:06.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 821.490032ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
13842025-01-18T05:33:06.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 1.200628348s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
13852025-01-18T05:33:06.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 856.256966ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
13862025-01-18T05:33:06.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 505.277753ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
13872025-01-18T05:33:06.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 806.110302ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
13882025-01-18T05:33:06.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 1.308863963s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
13892025-01-18T05:33:06.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 798.917633ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
13902025-01-18T05:33:06.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 550.044163ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
13912025-01-18T05:33:06.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 1.461170355s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
13922025-01-18T05:33:07.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 621.857656ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
13932025-01-18T05:33:07.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 612.833473ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
13942025-01-18T05:33:07.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 1.085036295s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
13952025-01-18T05:33:07.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 515.459885ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
13962025-01-18T05:33:07.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 737.784539ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
13972025-01-18T05:33:07.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 1.485209894s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
13982025-01-18T05:33:07.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 1.117903701s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
13992025-01-18T05:33:07.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 542.086441ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
14002025-01-18T05:33:07.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 1.109126812s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
14012025-01-18T05:33:07.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 1.224034167s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
14022025-01-18T05:33:07.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 1.165828183s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
14032025-01-18T05:33:07.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 1.067128899s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
14042025-01-18T05:33:07.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 872.748241ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
14052025-01-18T05:33:07.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 1.387963089s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
14062025-01-18T05:33:07.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 1.133923191s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
14072025-01-18T05:33:07.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 1.430500927s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
14082025-01-18T05:33:07.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 1.479642658s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
14092025-01-18T05:33:07.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 704.81301ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
14102025-01-18T05:33:07.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 1.048468821s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
14112025-01-18T05:33:08.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 705.591231ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
14122025-01-18T05:33:08.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 773.137157ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
14132025-01-18T05:33:08.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 572.063909ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
14142025-01-18T05:33:08.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 901.140432ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
14152025-01-18T05:33:08.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 997.536372ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
14162025-01-18T05:33:08.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 1.3176253s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
14172025-01-18T05:33:08.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 1.14676773s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
14182025-01-18T05:33:08.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 1.407578226s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
14192025-01-18T05:33:08.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 1.494564512s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
14202025-01-18T05:33:08.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 676.190027ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
14212025-01-18T05:33:08.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 970.647537ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
14222025-01-18T05:33:08.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 566.299035ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
14232025-01-18T05:33:08.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 917.594188ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
14242025-01-18T05:33:08.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 1.285597479s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
14252025-01-18T05:33:08.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 523.132231ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
14262025-01-18T05:33:08.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 776.846944ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
14272025-01-18T05:33:08.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 1.478840446s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
14282025-01-18T05:33:08.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 551.242008ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
14292025-01-18T05:33:09.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 984.782704ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
14302025-01-18T05:33:09.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 793.051121ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
14312025-01-18T05:33:09.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 897.984398ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
14322025-01-18T05:33:09.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 840.290579ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
14332025-01-18T05:33:09.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 854.384141ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
14342025-01-18T05:33:09.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 814.49448ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
14352025-01-18T05:33:09.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 542.622043ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
14362025-01-18T05:33:09.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 1.270094831s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
14372025-01-18T05:33:09.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 1.497354044s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
14382025-01-18T05:33:09.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 1.281347559s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
14392025-01-18T05:33:09.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 1.235653037s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
14402025-01-18T05:33:09.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 1.33106663s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
14412025-01-18T05:33:09.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 981.503698ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
14422025-01-18T05:33:09.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 805.947893ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
14432025-01-18T05:33:09.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 824.986261ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
14442025-01-18T05:33:10.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 1.223380474s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
14452025-01-18T05:33:10.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 1.328349362s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
14462025-01-18T05:33:10.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 1.126711113s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
14472025-01-18T05:33:10.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 1.023140097s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
14482025-01-18T05:33:10.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 1.189869566s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
14492025-01-18T05:33:10.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 1.399655455s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
14502025-01-18T05:33:10.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 1.03435952s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
14512025-01-18T05:33:10.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 1.168331155s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
14522025-01-18T05:33:10.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 1.309430089s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
14532025-01-18T05:33:10.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 1.192712489s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
14542025-01-18T05:33:10.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 822.823651ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
14552025-01-18T05:33:10.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 1.385798003s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
14562025-01-18T05:33:10.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 583.087661ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
14572025-01-18T05:33:10.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 1.461892157s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
14582025-01-18T05:33:10.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 616.003922ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
14592025-01-18T05:33:10.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 1.302316081s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
14602025-01-18T05:33:11.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 965.721895ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
14612025-01-18T05:33:11.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 1.37317872s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
14622025-01-18T05:33:11.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 540.663665ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
14632025-01-18T05:33:11.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 622.287933ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
14642025-01-18T05:33:11.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 723.094617ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
14652025-01-18T05:33:11.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 850.190148ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
14662025-01-18T05:33:11.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 1.430580405s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
14672025-01-18T05:33:11.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 1.310273716s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
14682025-01-18T05:33:11.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 522.01678ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
14692025-01-18T05:33:11.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 1.387820615s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
14702025-01-18T05:33:11.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 614.270578ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
14712025-01-18T05:33:11.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 1.066457571s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
14722025-01-18T05:33:11.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 1.033297128s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
14732025-01-18T05:33:11.630ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14742025-01-18T05:33:11.630ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
14752025-01-18T05:33:11.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 545.46864ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
14762025-01-18T05:33:11.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 947.824027ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
14772025-01-18T05:33:11.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 637.143951ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
14782025-01-18T05:33:11.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 58.685657ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
14792025-01-18T05:33:11.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 656.306955ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
14802025-01-18T05:33:11.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 139.046934ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
14812025-01-18T05:33:11.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 1.122997215s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
14822025-01-18T05:33:12.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 513.311521ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
14832025-01-18T05:33:12.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 553.524341ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
14842025-01-18T05:33:12.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 261.894382ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
14852025-01-18T05:33:12.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 965.86954ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
14862025-01-18T05:33:12.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 671.650863ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
14872025-01-18T05:33:12.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 823.47812ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
14882025-01-18T05:33:12.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 787.477326ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
14892025-01-18T05:33:12.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 1.480434321s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
14902025-01-18T05:33:12.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 1.090152663s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
14912025-01-18T05:33:12.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 408.891405ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
14922025-01-18T05:33:12.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 1.328328296s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
14932025-01-18T05:33:12.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 575.678769ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
14942025-01-18T05:33:12.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 1.280259858s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
14952025-01-18T05:33:12.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 1.308293857s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
14962025-01-18T05:33:12.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 1.493560755s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
14972025-01-18T05:33:12.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 972.852976ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
14982025-01-18T05:33:12.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 1.015929415s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
14992025-01-18T05:33:12.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 1.420399659s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
15002025-01-18T05:33:12.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 511.415212ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
15012025-01-18T05:33:12.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 424.524876ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15022025-01-18T05:33:12.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 914.308113ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
15032025-01-18T05:33:12.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 1.457649487s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
15042025-01-18T05:33:12.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 1.411086791s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
15052025-01-18T05:33:13.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 1.28411124s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
15062025-01-18T05:33:13.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 817.968026ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
15072025-01-18T05:33:13.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 800.675542ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
15082025-01-18T05:33:13.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 579.292169ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
15092025-01-18T05:33:13.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 727.061415ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
15102025-01-18T05:33:13.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 1.440893542s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15112025-01-18T05:33:13.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 556.878056ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
15122025-01-18T05:33:13.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 810.02761ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
15132025-01-18T05:33:13.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 1.214812088s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
15142025-01-18T05:33:13.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 1.2209932s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
15152025-01-18T05:33:13.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 1.204913517s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
15162025-01-18T05:33:13.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 1.305640523s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
15172025-01-18T05:33:13.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 1.48318522s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
15182025-01-18T05:33:13.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 965.895818ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
15192025-01-18T05:33:13.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 730.092886ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
15202025-01-18T05:33:13.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 1.065248027s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
15212025-01-18T05:33:13.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 819.411754ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
15222025-01-18T05:33:13.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 846.521218ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
15232025-01-18T05:33:13.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 887.565774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
15242025-01-18T05:33:13.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 1.332731612s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
15252025-01-18T05:33:14.020ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45698
15262025-01-18T05:33:14.082ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50236 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45698 req_id = 646be5fb-111e-48e8-897b-33dbf0591c51 response_code = 200 uri = /baseboard
15272025-01-18T05:33:14.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 1.490660434s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
15282025-01-18T05:33:14.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 679.278516ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
15292025-01-18T05:33:14.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 1.193967825s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
15302025-01-18T05:33:14.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 1.035012877s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
15312025-01-18T05:33:14.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 657.72984ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
15322025-01-18T05:33:14.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 736.725465ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
15332025-01-18T05:33:14.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 1.305273917s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
15342025-01-18T05:33:14.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 575.791783ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15352025-01-18T05:33:14.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 638.367554ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
15362025-01-18T05:33:14.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 535.104656ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
15372025-01-18T05:33:14.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 842.645722ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
15382025-01-18T05:33:14.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 504.42029ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
15392025-01-18T05:33:14.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 508.348951ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
15402025-01-18T05:33:14.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b") failed: Property not found. retry in 1.358872212s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
15412025-01-18T05:33:14.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 1.11020257s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
15422025-01-18T05:33:14.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 511.063919ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
15432025-01-18T05:33:14.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 507.054695ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
15442025-01-18T05:33:14.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 592.149081ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
15452025-01-18T05:33:15.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 868.03689ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
15462025-01-18T05:33:15.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 893.833925ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
15472025-01-18T05:33:15.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 1.115237749s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15482025-01-18T05:33:15.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 1.348478456s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
15492025-01-18T05:33:15.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 1.085316649s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
15502025-01-18T05:33:15.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 579.882524ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
15512025-01-18T05:33:15.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 578.740902ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
15522025-01-18T05:33:15.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 1.102807872s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
15532025-01-18T05:33:15.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67") failed: Property not found. retry in 1.302605252s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
15542025-01-18T05:33:15.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 671.614026ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
15552025-01-18T05:33:15.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 1.123047614s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
15562025-01-18T05:33:15.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d") failed: Property not found. retry in 1.338397135s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
15572025-01-18T05:33:15.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 884.976615ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
15582025-01-18T05:33:15.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 580.172388ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
15592025-01-18T05:33:15.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 653.773967ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
15602025-01-18T05:33:15.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9") failed: Property not found. retry in 1.439342789s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
15612025-01-18T05:33:15.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98") failed: Property not found. retry in 1.053795973s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
15622025-01-18T05:33:15.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee") failed: Property not found. retry in 1.214922341s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
15632025-01-18T05:33:15.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e") failed: Property not found. retry in 1.282199759s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
15642025-01-18T05:33:15.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2") failed: Property not found. retry in 1.243266809s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
15652025-01-18T05:33:15.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd") failed: Property not found. retry in 1.252487697s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
15662025-01-18T05:33:16.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173") failed: Property not found. retry in 1.392354838s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
15672025-01-18T05:33:16.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8") failed: Property not found. retry in 649.407439ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
15682025-01-18T05:33:16.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21") failed: Property not found. retry in 947.131101ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
15692025-01-18T05:33:16.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 1.147509746s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
15702025-01-18T05:33:16.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 549.844211ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
15712025-01-18T05:33:16.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4") failed: Property not found. retry in 842.098281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
15722025-01-18T05:33:16.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 1.099874953s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15732025-01-18T05:33:16.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 1.159391786s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
15742025-01-18T05:33:16.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 1.481204077s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
15752025-01-18T05:33:16.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 879.000539ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
15762025-01-18T05:33:16.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607") failed: Property not found. retry in 1.171237195s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
15772025-01-18T05:33:17.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116") failed: Property not found. retry in 1.004312945s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
15782025-01-18T05:33:17.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 1.475568986s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15792025-01-18T05:33:17.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb") failed: Property not found. retry in 1.104891061s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
15802025-01-18T05:33:17.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 605.931815ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
15812025-01-18T05:33:18.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc") failed: Property not found. retry in 1.093775961s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
15822025-01-18T05:33:18.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a") failed: Property not found. retry in 797.974287ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
15832025-01-18T05:33:18.246ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.413844396s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
15842025-01-18T05:33:18.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 632.567855ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15852025-01-18T05:33:19.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 1.102081409s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15862025-01-18T05:33:20.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 1.323866474s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15872025-01-18T05:33:22.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 824.231331ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15882025-01-18T05:33:22.181ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.948542497s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
15892025-01-18T05:33:22.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018") failed: Property not found. retry in 948.562033ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
15902025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_db9937b6-5687-4e75-a845-adcd315b6ac9
15912025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_388351c9-9262-4acc-99df-c9a606149f67
15922025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a
15932025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_a030d6fe-5525-4fd9-b798-deef6a379607
15942025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_8a8f878d-1d64-4f27-bb7c-6a7428882116
15952025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_d3557906-e137-4aa1-b963-a4db57d1f0ee
15962025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_1b27ab95-76bc-4957-8576-19c8066a590b
15972025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_ceb2a600-a841-4f52-af35-982e475f940e
15982025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_01a4829a-1f64-47ac-a2b0-622ca42defd2
15992025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_a8059edc-a66f-4331-ac61-34d8c71f6a8d
16002025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_dc75c5f5-6608-453d-8b53-d1945633bfdb
16012025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_f0ab8838-1fca-48d0-8066-01e038a185fd
16022025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_a94d6306-8e13-46d8-ac5c-3a6c8f361018
16032025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_cfc229a4-62cc-4318-9a2b-bd982a26b2cc
16042025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_a1595fda-fe38-4a77-ba44-643c7d59caa4
16052025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_39c565ae-135a-47ee-a066-91784d50b5e8
16062025-01-18T05:33:23.886ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_7e217192-8c56-455b-9e82-8cb54dcbfe21
16072025-01-18T05:33:23.887ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_9be5863d-e269-40d5-bfc1-948d2bed0173
16082025-01-18T05:33:23.887ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_1aa463d5-7355-427d-b304-9ceac16b2a98
16092025-01-18T05:33:23.890ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16102025-01-18T05:33:23.902ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16112025-01-18T05:33:23.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40140287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33326 req_id = 57924bf2-6d7c-4933-9305-d55ed8385ffd response_code = 204 uri = /omicron-zones
16122025-01-18T05:33:23.923ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
16132025-01-18T05:33:23.950ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16142025-01-18T05:33:23.954ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:803
16152025-01-18T05:33:23.993ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
16162025-01-18T05:33:24.008ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e5888020-2e37-4225-aaee-782292a70375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16172025-01-18T05:33:24.155ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e5888020-2e37-4225-aaee-782292a70375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16182025-01-18T05:33:24.285ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e5888020-2e37-4225-aaee-782292a70375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16192025-01-18T05:33:24.465ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e5888020-2e37-4225-aaee-782292a70375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16202025-01-18T05:33:24.672ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e5888020-2e37-4225-aaee-782292a70375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16212025-01-18T05:33:24.977ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e5888020-2e37-4225-aaee-782292a70375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16222025-01-18T05:33:25.346ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e5888020-2e37-4225-aaee-782292a70375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16232025-01-18T05:33:25.523ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e5888020-2e37-4225-aaee-782292a70375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16242025-01-18T05:33:25.791ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e5888020-2e37-4225-aaee-782292a70375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16252025-01-18T05:33:26.199ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e5888020-2e37-4225-aaee-782292a70375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16262025-01-18T05:33:28.876ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b9f99189-e629-4399-b3ac-7befa597914c", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e5888020-2e37-4225-aaee-782292a70375\"", request_id: "b9f99189-e629-4399-b3ac-7befa597914c" } file = sled-agent/src/rack_setup/service.rs:1079
16272025-01-18T05:33:30.978ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "710931f8-0076-432f-9aa9-b266aa76650e", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e5888020-2e37-4225-aaee-782292a70375\"", request_id: "710931f8-0076-432f-9aa9-b266aa76650e" } file = sled-agent/src/rack_setup/service.rs:1079
16282025-01-18T05:33:31.657ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8a1fdd23-c67e-4f83-a635-b0b94e229ce6", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:31 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e5888020-2e37-4225-aaee-782292a70375\"", request_id: "8a1fdd23-c67e-4f83-a635-b0b94e229ce6" } file = sled-agent/src/rack_setup/service.rs:1079
16292025-01-18T05:33:34.344ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "97dfa138-9ea0-462c-a79f-2fa7e07b68e0", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:34 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bcda1f83-6e29-4607-a063-c64866d2cd5c\"", request_id: "97dfa138-9ea0-462c-a79f-2fa7e07b68e0" } file = sled-agent/src/rack_setup/service.rs:1079
16302025-01-18T05:33:36.126ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "008c9ad7-8312-4a27-bcdf-11d93a216a46", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bcda1f83-6e29-4607-a063-c64866d2cd5c\"", request_id: "008c9ad7-8312-4a27-bcdf-11d93a216a46" } file = sled-agent/src/rack_setup/service.rs:1079
16312025-01-18T05:33:38.212ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "160c7020-53ab-4a78-a135-160290492123", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bcda1f83-6e29-4607-a063-c64866d2cd5c\"", request_id: "160c7020-53ab-4a78-a135-160290492123" } file = sled-agent/src/rack_setup/service.rs:1079
16322025-01-18T05:33:40.298ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a8027382-904a-40ee-897c-624b72e37abe", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:39 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bcda1f83-6e29-4607-a063-c64866d2cd5c\"", request_id: "a8027382-904a-40ee-897c-624b72e37abe" } file = sled-agent/src/rack_setup/service.rs:1079
16332025-01-18T05:33:42.723ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7e00fcaf-0a75-47b5-80ef-c858620a41ee", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bcda1f83-6e29-4607-a063-c64866d2cd5c\"", request_id: "7e00fcaf-0a75-47b5-80ef-c858620a41ee" } file = sled-agent/src/rack_setup/service.rs:1079
16342025-01-18T05:33:44.120ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43163
16352025-01-18T05:33:44.121ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43163 req_id = 6694ef70-c074-4bc0-99c0-42c3b96c8414 response_code = 200 uri = /baseboard
16362025-01-18T05:33:45.275ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "619c339b-c3b0-4704-92ad-a5b95b4b3052", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bcda1f83-6e29-4607-a063-c64866d2cd5c\"", request_id: "619c339b-c3b0-4704-92ad-a5b95b4b3052" } file = sled-agent/src/rack_setup/service.rs:1079
16372025-01-18T05:33:48.529ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d22ccc3c-e0d4-4159-8bb1-c14813c099df", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bcda1f83-6e29-4607-a063-c64866d2cd5c\"", request_id: "d22ccc3c-e0d4-4159-8bb1-c14813c099df" } file = sled-agent/src/rack_setup/service.rs:1079
16382025-01-18T05:33:51.326ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f3eded29-9772-4195-a1e2-e2c8a6611f51", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bcda1f83-6e29-4607-a063-c64866d2cd5c\"", request_id: "f3eded29-9772-4195-a1e2-e2c8a6611f51" } file = sled-agent/src/rack_setup/service.rs:1079
16392025-01-18T05:33:56.799ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3b38fe02-0883-4f67-9c3b-c67eaa96c92a", "content-length": "173", "date": "Sat, 18 Jan 2025 05:33:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bcda1f83-6e29-4607-a063-c64866d2cd5c\"", request_id: "3b38fe02-0883-4f67-9c3b-c67eaa96c92a" } file = sled-agent/src/rack_setup/service.rs:1079
16402025-01-18T05:33:56.937ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
16412025-01-18T05:33:57.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62217
16422025-01-18T05:33:57.030ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16432025-01-18T05:33:57.031ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16442025-01-18T05:33:57.031ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-zones.json file = common/src/ledger.rs:177
16452025-01-18T05:33:57.038ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-zones.json file = common/src/ledger.rs:177
16462025-01-18T05:33:57.051ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16472025-01-18T05:33:57.052ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417
16482025-01-18T05:33:57.075ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16492025-01-18T05:33:57.075ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3
16502025-01-18T05:33:57.101ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16512025-01-18T05:33:57.101ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175
16522025-01-18T05:33:57.127ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16532025-01-18T05:33:57.127ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_18259e54-9e24-4df6-8524-340cf6c3dae0
16542025-01-18T05:33:57.150ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16552025-01-18T05:33:57.150ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d55380f8-3d86-4c31-b244-3f6e51844733
16562025-01-18T05:33:57.171ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16572025-01-18T05:33:57.171ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed
16582025-01-18T05:33:57.192ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16592025-01-18T05:33:57.192ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26
16602025-01-18T05:33:57.214ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16612025-01-18T05:33:57.214ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cb543c1b-d520-4525-93a9-0809c84c04cd
16622025-01-18T05:33:57.233ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16632025-01-18T05:33:57.233ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_719280f2-3e89-4055-a81d-4f9adba21825
16642025-01-18T05:33:57.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62217 req_id = aead0c03-55b0-46d8-9ed5-f1346fcf7fbf response_code = 200 uri = /inventory
16652025-01-18T05:34:02.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60361
16662025-01-18T05:34:02.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60361 req_id = fdd1f3e1-a19e-41f4-aad5-d0082819e762 response_code = 200 uri = /vpc-routes
16672025-01-18T05:34:02.467ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
16682025-01-18T05:34:02.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60361 req_id = 93bcf3e3-fa4a-4895-b101-0539f53429c8 response_code = 204 uri = /eip-gateways
16692025-01-18T05:34:02.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57922
16702025-01-18T05:34:02.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57922 req_id = 4b4d8315-ca99-4474-87b6-391ad6875d10 response_code = 200 uri = /vpc-routes
16712025-01-18T05:34:02.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62665
16722025-01-18T05:34:02.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62665 req_id = 40d7d479-fc88-4518-85b3-7faf48f50369 response_code = 200 uri = /v2p
16732025-01-18T05:34:02.537ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
16742025-01-18T05:34:02.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57922 req_id = 078dc9f3-c1dd-465b-86a9-11fe98f38888 response_code = 204 uri = /eip-gateways
16752025-01-18T05:34:02.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60361 req_id = c2472f56-d7b1-4bdb-a319-698f386f2b78 response_code = 204 uri = /vpc-routes
16762025-01-18T05:34:02.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35342
16772025-01-18T05:34:02.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35342 req_id = 3df5a2db-cb9c-4e8f-9710-13f9c0b10786 response_code = 200 uri = /v2p
16782025-01-18T05:34:02.743ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
16792025-01-18T05:34:02.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1011 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57922 req_id = 3c71c23f-5172-4e98-bdf6-0b042c74465b response_code = 204 uri = /vpc-routes
16802025-01-18T05:34:02.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32886
16812025-01-18T05:34:02.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32886 req_id = cb4bf958-a6d8-46ba-bf63-7f4e249f7d07 response_code = 200 uri = /vpc-routes
16822025-01-18T05:34:02.910ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
16832025-01-18T05:34:02.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32886 req_id = b9d8c45b-f3c3-4a19-9974-43088a6ac8be response_code = 204 uri = /eip-gateways
16842025-01-18T05:34:02.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32840
16852025-01-18T05:34:02.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32840 req_id = 02a66cd1-7106-4233-a9c5-f1966b6323b8 response_code = 200 uri = /v2p
16862025-01-18T05:34:03.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32886 req_id = 859d68a8-1451-431f-b602-38004edd6a13 response_code = 204 uri = /vpc-routes
16872025-01-18T05:34:03.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46568
16882025-01-18T05:34:03.799ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16892025-01-18T05:34:03.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16902025-01-18T05:34:03.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16912025-01-18T05:34:03.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16922025-01-18T05:34:03.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16932025-01-18T05:34:03.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16942025-01-18T05:34:03.799ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16952025-01-18T05:34:03.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46568 req_id = 2b2bc3a7-1fb7-43ee-a0b4-531b4bf4155b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16962025-01-18T05:34:03.801ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
16972025-01-18T05:34:03.805ZINFOSledAgent (RSS): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16982025-01-18T05:34:03.805ZINFOSledAgent (RSS): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16992025-01-18T05:34:04.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54464
17002025-01-18T05:34:04.053ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17012025-01-18T05:34:04.053ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17022025-01-18T05:34:04.053ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-zones.json file = common/src/ledger.rs:177
17032025-01-18T05:34:04.053ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-zones.json file = common/src/ledger.rs:177
17042025-01-18T05:34:04.067ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17052025-01-18T05:34:04.067ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417
17062025-01-18T05:34:04.090ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17072025-01-18T05:34:04.090ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3
17082025-01-18T05:34:04.112ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17092025-01-18T05:34:04.112ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175
17102025-01-18T05:34:04.136ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17112025-01-18T05:34:04.136ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_18259e54-9e24-4df6-8524-340cf6c3dae0
17122025-01-18T05:34:04.161ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17132025-01-18T05:34:04.161ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d55380f8-3d86-4c31-b244-3f6e51844733
17142025-01-18T05:34:04.183ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17152025-01-18T05:34:04.183ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed
17162025-01-18T05:34:04.203ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17172025-01-18T05:34:04.203ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26
17182025-01-18T05:34:04.225ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17192025-01-18T05:34:04.225ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cb543c1b-d520-4525-93a9-0809c84c04cd
17202025-01-18T05:34:04.246ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17212025-01-18T05:34:04.246ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_719280f2-3e89-4055-a81d-4f9adba21825
17222025-01-18T05:34:04.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202983 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54464 req_id = befab0a7-5f9a-45f4-9822-1902b946da1c response_code = 200 uri = /inventory
17232025-01-18T05:34:04.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35586
17242025-01-18T05:34:04.537ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17252025-01-18T05:34:04.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17262025-01-18T05:34:04.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17272025-01-18T05:34:04.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17282025-01-18T05:34:04.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17292025-01-18T05:34:04.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17302025-01-18T05:34:04.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17312025-01-18T05:34:04.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35586 req_id = 388179ca-7201-4ed2-92a1-276279075f49 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17322025-01-18T05:34:04.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42832
17332025-01-18T05:34:04.887ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17342025-01-18T05:34:04.887ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17352025-01-18T05:34:04.887ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17362025-01-18T05:34:04.887ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17372025-01-18T05:34:04.887ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17382025-01-18T05:34:04.887ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17392025-01-18T05:34:04.887ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17402025-01-18T05:34:04.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42832 req_id = c3440d2e-6e0e-4a16-8a8d-9065c2cc5d18 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17412025-01-18T05:34:04.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47694
17422025-01-18T05:34:04.953ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17432025-01-18T05:34:04.953ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17442025-01-18T05:34:04.954ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17452025-01-18T05:34:04.954ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17462025-01-18T05:34:04.954ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17472025-01-18T05:34:04.954ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17482025-01-18T05:34:04.954ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17492025-01-18T05:34:04.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47694 req_id = 932e7218-c1b1-4f2c-9f46-7a60b0f95daa response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17502025-01-18T05:34:09.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63050
17512025-01-18T05:34:09.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63050 req_id = 06fa3a05-45e2-43c6-bd0d-e6b095b6dd13 response_code = 200 uri = /vpc-routes
17522025-01-18T05:34:09.060ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
17532025-01-18T05:34:09.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63050 req_id = ff27f7e4-4b51-4316-845b-9689d89716b8 response_code = 204 uri = /eip-gateways
17542025-01-18T05:34:09.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63050 req_id = a9d48bcb-8316-4157-bad3-2019500c5b28 response_code = 204 uri = /vpc-routes
17552025-01-18T05:34:12.645ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:64085 remote_addr = [fd00:1122:3344:101::d]:50288 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
17562025-01-18T05:34:12.673ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27138 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 932278e2-0138-4d53-90d4-9e06e7f25356 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
17572025-01-18T05:34:14.169ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54766
17582025-01-18T05:34:14.169ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54766 req_id = 6d4cc86d-edc4-49f4-be43-b58fdccc66ef response_code = 200 uri = /baseboard
17592025-01-18T05:34:32.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37714
17602025-01-18T05:34:32.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37714 req_id = 920fb65f-6b15-40bc-bc19-381dc1ef7320 response_code = 200 uri = /v2p
17612025-01-18T05:34:32.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41734
17622025-01-18T05:34:32.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41734 req_id = 39a557f8-c486-4369-b85d-0de8f763778b response_code = 200 uri = /vpc-routes
17632025-01-18T05:34:32.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49947
17642025-01-18T05:34:32.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49947 req_id = 3f26b0da-b610-48eb-a147-48b1f894b746 response_code = 200 uri = /vpc-routes
17652025-01-18T05:34:32.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38006
17662025-01-18T05:34:32.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38006 req_id = b921e19f-fdb2-49a5-8ebb-f3c74080ee61 response_code = 200 uri = /v2p
17672025-01-18T05:34:32.778ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
17682025-01-18T05:34:32.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41734 req_id = a7645ed7-02ad-487d-a16b-7fb7ccf4e480 response_code = 204 uri = /eip-gateways
17692025-01-18T05:34:32.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41734 req_id = e4805880-b43e-4c47-8811-90a0c20a3ab2 response_code = 204 uri = /vpc-routes
17702025-01-18T05:34:32.798ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
17712025-01-18T05:34:32.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49947 req_id = 3ba4c10b-7d24-4c95-97c2-8b1990c74387 response_code = 204 uri = /eip-gateways
17722025-01-18T05:34:32.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49947 req_id = 256d1687-e044-451e-a56f-daf8ef35797c response_code = 204 uri = /vpc-routes
17732025-01-18T05:34:32.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37467
17742025-01-18T05:34:32.994ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17752025-01-18T05:34:33.070ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17762025-01-18T05:34:33.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143798 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37467 req_id = 765c811e-b2ee-479e-a4c3-f78ba3fc9ad5 response_code = 204 uri = /switch-ports
17772025-01-18T05:34:33.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35501
17782025-01-18T05:34:33.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17792025-01-18T05:34:33.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6963 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37467 req_id = 94279697-ad48-4c46-a6e8-7a850592d8f7 response_code = 200 uri = /network-bootstore-config
17802025-01-18T05:34:33.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39176
17812025-01-18T05:34:33.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39176 req_id = d0c003da-8623-4744-a59c-df69bf4b698e response_code = 200 uri = /vpc-routes
17822025-01-18T05:34:33.194ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17832025-01-18T05:34:33.217ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
17842025-01-18T05:34:33.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 789 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39176 req_id = 30fb9698-d228-45c6-954b-c224df351ee5 response_code = 204 uri = /eip-gateways
17852025-01-18T05:34:33.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39176 req_id = d622db9b-12e5-460d-b44e-84d8532ca015 response_code = 204 uri = /vpc-routes
17862025-01-18T05:34:33.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133787 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35501 req_id = 6f2b7d72-eb59-49a6-ac1d-1702415e21b1 response_code = 204 uri = /switch-ports
17872025-01-18T05:34:33.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35501 req_id = 1f2847d9-a77e-4b70-a6c6-128a1f9c9107 response_code = 200 uri = /network-bootstore-config
17882025-01-18T05:34:33.304ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17892025-01-18T05:34:33.304ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17902025-01-18T05:34:33.306ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17912025-01-18T05:34:33.306ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17922025-01-18T05:34:33.306ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17932025-01-18T05:34:33.306ZINFOSledAgent (bootstore): Writing ledger to /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17942025-01-18T05:34:33.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35501 req_id = 1004df4e-cc33-4c43-bb6a-b6b29e66c264 response_code = 204 uri = /network-bootstore-config
17952025-01-18T05:34:33.306ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17962025-01-18T05:34:33.307ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17972025-01-18T05:34:33.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1651 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37467 req_id = 27968825-5913-4646-a916-eb56b3f116bd response_code = 204 uri = /network-bootstore-config
17982025-01-18T05:34:33.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41787
17992025-01-18T05:34:33.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41787 req_id = 00664df4-273e-4807-a649-e9aa034cd7c5 response_code = 200 uri = /v2p
18002025-01-18T05:34:33.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45138
18012025-01-18T05:34:33.516ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18022025-01-18T05:34:33.557ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18032025-01-18T05:34:33.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101991 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45138 req_id = e9122e2b-d45d-4430-ab12-fac67b38de23 response_code = 204 uri = /switch-ports
18042025-01-18T05:34:33.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45138 req_id = 5f16a5aa-145f-457e-a781-291787b292aa response_code = 200 uri = /network-bootstore-config
18052025-01-18T05:34:42.653ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7655 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 7adec79b-b7bc-458d-b942-a6b7a5a870eb response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
18062025-01-18T05:34:44.205ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45795
18072025-01-18T05:34:44.205ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45795 req_id = ff298365-5577-4f09-9191-2b4968dfeb27 response_code = 200 uri = /baseboard
18082025-01-18T05:35:02.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47565
18092025-01-18T05:35:02.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47565 req_id = 2c8c9ad7-d7b8-4066-922c-0fea841c7459 response_code = 200 uri = /vpc-routes
18102025-01-18T05:35:02.457ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
18112025-01-18T05:35:02.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47565 req_id = 8ca50a10-6849-40bf-a7cb-f21cca31a7df response_code = 204 uri = /eip-gateways
18122025-01-18T05:35:02.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45827
18132025-01-18T05:35:02.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45827 req_id = 0383f046-78e7-4474-9e54-612230e0eb05 response_code = 200 uri = /vpc-routes
18142025-01-18T05:35:02.530ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
18152025-01-18T05:35:02.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45827 req_id = 64b0360b-0b1e-46d6-820a-5acc07c52c5e response_code = 204 uri = /eip-gateways
18162025-01-18T05:35:02.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45827 req_id = a9a3e3f9-65e8-4189-875e-c22c027773de response_code = 204 uri = /vpc-routes
18172025-01-18T05:35:02.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51209
18182025-01-18T05:35:02.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51209 req_id = 3b6253c8-89ef-4bb5-b8aa-131f10aea0db response_code = 200 uri = /v2p
18192025-01-18T05:35:02.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49123
18202025-01-18T05:35:02.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49123 req_id = 6aecfc97-0d80-42a9-abfb-b4efb71ca929 response_code = 200 uri = /v2p
18212025-01-18T05:35:02.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47565 req_id = dfd99850-6198-4b57-aef9-4cb4e0dfcbf3 response_code = 204 uri = /vpc-routes
18222025-01-18T05:35:02.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41871
18232025-01-18T05:35:02.720ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18242025-01-18T05:35:02.765ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18252025-01-18T05:35:02.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109343 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41871 req_id = 5669fe97-410c-42c3-b7a5-b4b26b4f7da9 response_code = 204 uri = /switch-ports
18262025-01-18T05:35:02.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41869
18272025-01-18T05:35:02.830ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18282025-01-18T05:35:02.863ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18292025-01-18T05:35:02.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87569 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41869 req_id = 724dfe23-5c2b-4b9e-9671-ecf312871dec response_code = 204 uri = /switch-ports
18302025-01-18T05:35:02.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41871 req_id = f8f6aa10-9f55-45b6-972d-70e87c67d96f response_code = 200 uri = /network-bootstore-config
18312025-01-18T05:35:02.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41869 req_id = 870edbe6-5672-4d25-abca-5e69090ce603 response_code = 200 uri = /network-bootstore-config
18322025-01-18T05:35:02.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44375
18332025-01-18T05:35:02.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44375 req_id = 933f50e8-4aea-43a9-89d9-202613fbc01b response_code = 200 uri = /vpc-routes
18342025-01-18T05:35:03.011ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
18352025-01-18T05:35:03.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44375 req_id = 26976c5d-4dad-4874-88d5-f7b196b97d54 response_code = 204 uri = /eip-gateways
18362025-01-18T05:35:03.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44375 req_id = 2edc0747-39bb-4dd6-b668-59fb016251f6 response_code = 204 uri = /vpc-routes
18372025-01-18T05:35:03.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44989
18382025-01-18T05:35:03.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44989 req_id = d90109f6-6b20-42a6-aa5e-81a8c2d5b7c7 response_code = 200 uri = /v2p
18392025-01-18T05:35:03.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36829
18402025-01-18T05:35:03.249ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18412025-01-18T05:35:03.288ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18422025-01-18T05:35:03.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36829 req_id = 611f44a5-be25-4ae0-8aff-6331f89ae25c response_code = 204 uri = /switch-ports
18432025-01-18T05:35:03.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36829 req_id = 2bae1dcc-3e8c-4bea-810d-5806de2c2d59 response_code = 200 uri = /network-bootstore-config
18442025-01-18T05:35:12.655ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8819 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 99cbe74a-52ff-4568-9c34-1a4378c592b6 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
18452025-01-18T05:35:14.239ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52374
18462025-01-18T05:35:14.239ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52374 req_id = 79db5254-4b14-415a-bee6-855fb44a4896 response_code = 200 uri = /baseboard
18472025-01-18T05:35:32.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51494
18482025-01-18T05:35:32.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51494 req_id = 796bdf62-ae4f-4579-89a0-65358e7b9043 response_code = 200 uri = /vpc-routes
18492025-01-18T05:35:32.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54941
18502025-01-18T05:35:32.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54941 req_id = a4b53c77-ba23-4092-aa04-71f62b948c7c response_code = 200 uri = /vpc-routes
18512025-01-18T05:35:32.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59080
18522025-01-18T05:35:32.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59080 req_id = a60aa74a-5aac-46c5-8413-f685b3edc616 response_code = 200 uri = /vpc-routes
18532025-01-18T05:35:32.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42754
18542025-01-18T05:35:32.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42754 req_id = 1b7fb9de-63a2-4780-80b6-9e5ba912012b response_code = 200 uri = /v2p
18552025-01-18T05:35:32.904ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
18562025-01-18T05:35:32.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54941 req_id = 4010aa10-2bf9-4806-8510-a6be3b4de7fc response_code = 204 uri = /eip-gateways
18572025-01-18T05:35:32.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45538
18582025-01-18T05:35:32.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45538 req_id = e43868a8-2a4d-4178-a260-7f5b4746781e response_code = 200 uri = /v2p
18592025-01-18T05:35:32.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54941 req_id = ab03139a-dfa1-4b6e-884e-15d66dee2c46 response_code = 204 uri = /vpc-routes
18602025-01-18T05:35:32.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35060
18612025-01-18T05:35:32.949ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18622025-01-18T05:35:32.994ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18632025-01-18T05:35:33.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109589 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35060 req_id = 0ef22702-d67e-4ebf-b138-593475298203 response_code = 204 uri = /switch-ports
18642025-01-18T05:35:33.059ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
18652025-01-18T05:35:33.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40514
18662025-01-18T05:35:33.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59080 req_id = 9ea0a3b5-baab-4162-a04f-8d3ec561a5e1 response_code = 204 uri = /eip-gateways
18672025-01-18T05:35:33.059ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
18682025-01-18T05:35:33.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51494 req_id = 88f7b1a8-3f03-4100-993f-e9fa56309fe2 response_code = 204 uri = /eip-gateways
18692025-01-18T05:35:33.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18702025-01-18T05:35:33.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35060 req_id = 95d7ed75-6e51-43c5-8f3f-642187d6c830 response_code = 200 uri = /network-bootstore-config
18712025-01-18T05:35:33.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59080 req_id = b177f153-6a9c-4748-911b-573ddbee25e5 response_code = 204 uri = /vpc-routes
18722025-01-18T05:35:33.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 527 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51494 req_id = 3d56a77d-3766-40e6-97b4-830bcaaa78be response_code = 204 uri = /vpc-routes
18732025-01-18T05:35:33.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56523
18742025-01-18T05:35:33.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56523 req_id = 9a552000-bb59-4044-bf60-3e786c1b045d response_code = 200 uri = /v2p
18752025-01-18T05:35:33.101ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18762025-01-18T05:35:33.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100750 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40514 req_id = f16ea23c-f0f9-4e2e-af0e-6e014bcca7db response_code = 204 uri = /switch-ports
18772025-01-18T05:35:33.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40514 req_id = 29215c17-b781-4a4f-b26d-4e274a7f2bb5 response_code = 200 uri = /network-bootstore-config
18782025-01-18T05:35:33.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64463
18792025-01-18T05:35:33.249ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18802025-01-18T05:35:33.286ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18812025-01-18T05:35:33.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90240 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64463 req_id = c32cf386-4ffd-4539-ad35-9ceb999469a6 response_code = 204 uri = /switch-ports
18822025-01-18T05:35:33.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64463 req_id = 3941396b-a36e-4b29-bd63-7878af511a96 response_code = 200 uri = /network-bootstore-config
18832025-01-18T05:35:42.654ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7954 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 46b9e873-a897-4dc1-8ffd-1619a9afe289 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
18842025-01-18T05:35:44.273ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34743
18852025-01-18T05:35:44.273ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34743 req_id = 8c66085f-27d8-465d-a916-6b818e7a834d response_code = 200 uri = /baseboard
18862025-01-18T05:36:02.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52298
18872025-01-18T05:36:02.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52298 req_id = 8cfd5210-a65f-4299-afda-1cddbb8fdc4f response_code = 200 uri = /vpc-routes
18882025-01-18T05:36:02.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47551
18892025-01-18T05:36:02.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47551 req_id = 43255dbd-2109-4f8a-b01f-112e6fdd2ef6 response_code = 200 uri = /vpc-routes
18902025-01-18T05:36:02.517ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
18912025-01-18T05:36:02.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47551 req_id = 4a52b661-b186-4eb7-9358-0b7e1324ffc2 response_code = 204 uri = /eip-gateways
18922025-01-18T05:36:02.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47551 req_id = 361be464-b563-436d-b97c-f4607762b0ff response_code = 204 uri = /vpc-routes
18932025-01-18T05:36:02.572ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
18942025-01-18T05:36:02.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52298 req_id = 2302ddb9-4ac3-4c07-b68a-4a4a725f82b7 response_code = 204 uri = /eip-gateways
18952025-01-18T05:36:02.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53136
18962025-01-18T05:36:02.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53136 req_id = 0798472e-98e3-4d0e-a7b8-6ac19724f790 response_code = 200 uri = /v2p
18972025-01-18T05:36:02.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52298 req_id = 5a5c2903-22f4-4f06-90f2-68d0113bead9 response_code = 204 uri = /vpc-routes
18982025-01-18T05:36:02.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64969
18992025-01-18T05:36:02.629ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19002025-01-18T05:36:02.676ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19012025-01-18T05:36:02.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114983 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64969 req_id = d49a30dc-b2a1-48dc-bee3-d6cc184a4a16 response_code = 204 uri = /switch-ports
19022025-01-18T05:36:02.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32870
19032025-01-18T05:36:02.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43443
19042025-01-18T05:36:02.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43443 req_id = ae6ad0a6-0f97-4008-ae46-05e087f9ff4c response_code = 200 uri = /v2p
19052025-01-18T05:36:02.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19062025-01-18T05:36:02.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4541 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64969 req_id = 377c8faa-e855-45fc-a542-605bee8fd466 response_code = 200 uri = /network-bootstore-config
19072025-01-18T05:36:02.783ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19082025-01-18T05:36:02.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64207
19092025-01-18T05:36:02.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64207 req_id = f1d649eb-7c14-465a-a951-69e521aae04d response_code = 200 uri = /vpc-routes
19102025-01-18T05:36:02.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32870 req_id = 449d3795-bad3-4ff1-a40d-da0ad976656d response_code = 204 uri = /switch-ports
19112025-01-18T05:36:02.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32870 req_id = e065c9ba-fe97-4f64-91a2-1da67bf57193 response_code = 200 uri = /network-bootstore-config
19122025-01-18T05:36:02.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
19132025-01-18T05:36:02.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64207 req_id = 650340c4-1c63-44cf-bfc4-5623514e5d97 response_code = 204 uri = /eip-gateways
19142025-01-18T05:36:02.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64207 req_id = dba46227-79a9-459e-a3b7-bdb2e9359a1d response_code = 204 uri = /vpc-routes
19152025-01-18T05:36:02.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59810
19162025-01-18T05:36:02.942ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19172025-01-18T05:36:02.985ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19182025-01-18T05:36:03.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103522 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59810 req_id = 32656492-dc3a-4030-9ad3-494f4fe51e9f response_code = 204 uri = /switch-ports
19192025-01-18T05:36:03.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59810 req_id = b42cf02d-a8c7-4b0e-885c-0560cf1570bd response_code = 200 uri = /network-bootstore-config
19202025-01-18T05:36:03.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56714
19212025-01-18T05:36:03.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56714 req_id = 61fca57b-80f1-4559-bdef-dc5ce25dc6e2 response_code = 200 uri = /v2p
19222025-01-18T05:36:12.654ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7503 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 9c7f1c8d-3f6a-4bb0-a1b0-811db8df435d response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
19232025-01-18T05:36:14.307ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43177
19242025-01-18T05:36:14.308ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43177 req_id = 9758dc6d-5d7e-4859-ad47-f5b968408537 response_code = 200 uri = /baseboard
19252025-01-18T05:36:27.164ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19262025-01-18T05:36:32.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46166
19272025-01-18T05:36:32.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46166 req_id = 66cd188b-f7cc-4c66-ae70-b9cdfbef2a97 response_code = 200 uri = /vpc-routes
19282025-01-18T05:36:32.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56314
19292025-01-18T05:36:32.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56314 req_id = 501d310d-3703-43c7-9b19-025222ed3c69 response_code = 200 uri = /vpc-routes
19302025-01-18T05:36:32.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53382
19312025-01-18T05:36:32.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53382 req_id = 6d72e6aa-f43f-43ce-886d-c26c05e47317 response_code = 200 uri = /v2p
19322025-01-18T05:36:32.816ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
19332025-01-18T05:36:32.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46166 req_id = 1675e48e-3b57-42a4-8e1c-9379f5a36dfb response_code = 204 uri = /eip-gateways
19342025-01-18T05:36:32.824ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
19352025-01-18T05:36:32.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56314 req_id = c094fc2e-cd52-4ea5-8150-052f10d38a89 response_code = 204 uri = /eip-gateways
19362025-01-18T05:36:32.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46166 req_id = 9ae1f8ed-6692-4e01-bb77-b3a9e8cf3d84 response_code = 204 uri = /vpc-routes
19372025-01-18T05:36:32.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56314 req_id = 0e658a62-cf40-4eb6-9f80-6510924ff8b3 response_code = 204 uri = /vpc-routes
19382025-01-18T05:36:32.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63186
19392025-01-18T05:36:32.847ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19402025-01-18T05:36:32.886ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19412025-01-18T05:36:32.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91413 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63186 req_id = 140b165a-4509-4ef8-b785-c3d02e4533d4 response_code = 204 uri = /switch-ports
19422025-01-18T05:36:32.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35323
19432025-01-18T05:36:32.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57142
19442025-01-18T05:36:32.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57442
19452025-01-18T05:36:32.939ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19462025-01-18T05:36:32.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3709 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57142 req_id = 3a636c6c-6129-4ff2-aaa6-0a413906d2dd response_code = 200 uri = /vpc-routes
19472025-01-18T05:36:32.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3994 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63186 req_id = 5f7dc4e9-6a95-4d21-8537-086e465b7216 response_code = 200 uri = /network-bootstore-config
19482025-01-18T05:36:32.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4015 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35323 req_id = 143ac927-1504-4528-a2c1-8e41ac6173ed response_code = 200 uri = /v2p
19492025-01-18T05:36:32.975ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19502025-01-18T05:36:33.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63432
19512025-01-18T05:36:33.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63432 req_id = 752ad9ad-4b99-424f-8717-b1dbc0bdf090 response_code = 200 uri = /v2p
19522025-01-18T05:36:33.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89272 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57442 req_id = 3d6d73a6-c9da-496f-b8ba-e943d1fb3fec response_code = 204 uri = /switch-ports
19532025-01-18T05:36:33.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57442 req_id = 172da01d-c4f4-4a33-b36a-430da268ed67 response_code = 200 uri = /network-bootstore-config
19542025-01-18T05:36:33.043ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
19552025-01-18T05:36:33.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57142 req_id = 554a60a8-82cf-4fe3-86d8-8c93d30fb075 response_code = 204 uri = /eip-gateways
19562025-01-18T05:36:33.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57142 req_id = 23ec2d3c-6c30-4236-bda9-17ecab5dc91c response_code = 204 uri = /vpc-routes
19572025-01-18T05:36:33.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60238
19582025-01-18T05:36:33.156ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19592025-01-18T05:36:33.194ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19602025-01-18T05:36:33.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102429 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60238 req_id = 3e99a1f0-056f-4c4d-92de-ccdab6677785 response_code = 204 uri = /switch-ports
19612025-01-18T05:36:33.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60238 req_id = 24d12342-c1dd-40e7-b029-e7383bf48ed3 response_code = 200 uri = /network-bootstore-config
19622025-01-18T05:36:42.655ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8271 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 1d0f68a4-5c3b-4eb9-b7b6-0bb1e1f5e14c response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
19632025-01-18T05:36:44.340ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38947
19642025-01-18T05:36:44.340ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38947 req_id = ea86be0c-9f52-4d9e-a042-48aebb7533fb response_code = 200 uri = /baseboard
19652025-01-18T05:37:02.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46931
19662025-01-18T05:37:02.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46931 req_id = 6d82e0d2-e349-44d7-a101-5d70ea6b2e25 response_code = 200 uri = /vpc-routes
19672025-01-18T05:37:02.501ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
19682025-01-18T05:37:02.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46931 req_id = 733d27a3-0911-4f5b-83ea-d18bcb29de54 response_code = 204 uri = /eip-gateways
19692025-01-18T05:37:02.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46931 req_id = 8d301791-e44a-4954-87a0-eb29fef581d2 response_code = 204 uri = /vpc-routes
19702025-01-18T05:37:02.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37644
19712025-01-18T05:37:02.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37644 req_id = d385cab1-93ef-4994-bb8f-228437b268d0 response_code = 200 uri = /vpc-routes
19722025-01-18T05:37:02.641ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
19732025-01-18T05:37:02.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37644 req_id = 6b784572-bfac-4137-a7e1-ed577ea3c46c response_code = 204 uri = /eip-gateways
19742025-01-18T05:37:02.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33997
19752025-01-18T05:37:02.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33997 req_id = ad266fd7-2001-49b4-8481-a99aca891a63 response_code = 200 uri = /v2p
19762025-01-18T05:37:02.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37644 req_id = 64f9543d-5d85-4355-892e-f18382caea23 response_code = 204 uri = /vpc-routes
19772025-01-18T05:37:02.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44991
19782025-01-18T05:37:02.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44991 req_id = 6c4103b1-0d87-46a6-bcea-92cf68111d4c response_code = 200 uri = /v2p
19792025-01-18T05:37:02.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60333
19802025-01-18T05:37:02.795ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19812025-01-18T05:37:02.832ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19822025-01-18T05:37:02.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94164 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60333 req_id = 40e1df2e-b2b5-4a31-b553-92e552fb21e4 response_code = 204 uri = /switch-ports
19832025-01-18T05:37:02.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56997
19842025-01-18T05:37:02.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56997 req_id = 7371b817-4147-4943-b49c-85c42ffbb81d response_code = 200 uri = /vpc-routes
19852025-01-18T05:37:02.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60333 req_id = d1ea8d50-7181-46f1-9b32-dbb9ed5f41ce response_code = 200 uri = /network-bootstore-config
19862025-01-18T05:37:02.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51906
19872025-01-18T05:37:02.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51906 req_id = db85e228-0030-4c6e-9847-91f42dd080ab response_code = 200 uri = /v2p
19882025-01-18T05:37:02.929ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
19892025-01-18T05:37:02.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56997 req_id = 4de5cef8-719f-4207-a87e-4b792f174b67 response_code = 204 uri = /eip-gateways
19902025-01-18T05:37:02.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56997 req_id = d017e4cd-d442-4624-9b7b-35fec9c3aa1f response_code = 204 uri = /vpc-routes
19912025-01-18T05:37:02.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48525
19922025-01-18T05:37:02.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19932025-01-18T05:37:03.007ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19942025-01-18T05:37:03.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99118 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48525 req_id = 89c2d5b0-b8a4-49b1-9c2e-749260e2a92c response_code = 204 uri = /switch-ports
19952025-01-18T05:37:03.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34594
19962025-01-18T05:37:03.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48525 req_id = f2832f3c-5923-431d-8830-0b05211b6a20 response_code = 200 uri = /network-bootstore-config
19972025-01-18T05:37:03.066ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19982025-01-18T05:37:03.104ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19992025-01-18T05:37:03.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90875 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34594 req_id = e4e07f64-231a-484c-a4cc-1619530bd69f response_code = 204 uri = /switch-ports
20002025-01-18T05:37:03.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34594 req_id = 54644c9f-23e1-4f9c-8b14-7c924956e865 response_code = 200 uri = /network-bootstore-config
20012025-01-18T05:37:12.655ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7718 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 923eff57-8c7a-4fae-9851-a15ff8d65123 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
20022025-01-18T05:37:14.377ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46188
20032025-01-18T05:37:14.377ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46188 req_id = f77fb7cc-9857-4869-a17d-57d69798fbe1 response_code = 200 uri = /baseboard
20042025-01-18T05:37:32.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34742
20052025-01-18T05:37:32.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34742 req_id = d2cbf8d2-13eb-4012-9a8e-56e0b8ce55d0 response_code = 200 uri = /vpc-routes
20062025-01-18T05:37:32.559ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
20072025-01-18T05:37:32.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34742 req_id = 3e93ee42-aca0-4250-b9c1-fd024ecd7cf2 response_code = 204 uri = /eip-gateways
20082025-01-18T05:37:32.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34439
20092025-01-18T05:37:32.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34439 req_id = 02f07816-f5f7-4716-a3c6-c186a1fae0f5 response_code = 200 uri = /vpc-routes
20102025-01-18T05:37:32.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57532
20112025-01-18T05:37:32.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57532 req_id = 04a74a69-3d00-4af6-bf0e-3aceaf1db5c1 response_code = 200 uri = /v2p
20122025-01-18T05:37:32.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34742 req_id = 910b4426-4ae7-4955-abce-df596e1b0a77 response_code = 204 uri = /vpc-routes
20132025-01-18T05:37:32.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59017
20142025-01-18T05:37:32.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59017 req_id = 449a9544-0e7a-4e46-904c-dc6d36aff140 response_code = 200 uri = /v2p
20152025-01-18T05:37:32.870ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
20162025-01-18T05:37:32.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34439 req_id = da78bbb9-c2e4-4e03-a60c-fc2b64a14f08 response_code = 204 uri = /eip-gateways
20172025-01-18T05:37:32.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34439 req_id = 80d7049f-a906-496f-b893-576d8768c325 response_code = 204 uri = /vpc-routes
20182025-01-18T05:37:32.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38613
20192025-01-18T05:37:32.932ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20202025-01-18T05:37:32.975ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20212025-01-18T05:37:33.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111765 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38613 req_id = 3130cf60-0cde-4b51-bf49-c0c6926a2d76 response_code = 204 uri = /switch-ports
20222025-01-18T05:37:33.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42190
20232025-01-18T05:37:33.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47582
20242025-01-18T05:37:33.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47582 req_id = e88d7c1d-28c5-410b-a201-2df3a4e11c79 response_code = 200 uri = /vpc-routes
20252025-01-18T05:37:33.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38613 req_id = 90e0fb9a-caee-4f95-be50-11b5915f01f9 response_code = 200 uri = /network-bootstore-config
20262025-01-18T05:37:33.044ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20272025-01-18T05:37:33.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20282025-01-18T05:37:33.093ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
20292025-01-18T05:37:33.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47582 req_id = 2064527a-855d-4562-bf2a-364196cb601d response_code = 204 uri = /eip-gateways
20302025-01-18T05:37:33.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1094 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47582 req_id = 94646eed-af6d-4737-bc79-edc177fab7d5 response_code = 204 uri = /vpc-routes
20312025-01-18T05:37:33.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42190 req_id = 0fa7d982-36f1-4ab7-884f-aa0bdae2fdfd response_code = 204 uri = /switch-ports
20322025-01-18T05:37:33.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42190 req_id = 300ae895-85bf-4b1b-9f81-d36cf9cbdc14 response_code = 200 uri = /network-bootstore-config
20332025-01-18T05:37:33.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40394
20342025-01-18T05:37:33.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40394 req_id = 75877259-9e97-40cb-afc5-1556577099f9 response_code = 200 uri = /v2p
20352025-01-18T05:37:33.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58679
20362025-01-18T05:37:33.184ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20372025-01-18T05:37:33.219ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20382025-01-18T05:37:33.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91474 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58679 req_id = 035f0b75-4c38-40f6-82fa-6040f2d8b1cf response_code = 204 uri = /switch-ports
20392025-01-18T05:37:33.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58679 req_id = 7ce390e8-a8f9-4ac4-a772-016f0b96f992 response_code = 200 uri = /network-bootstore-config
20402025-01-18T05:37:42.656ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7464 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 7ee7c431-4245-40ff-ac2f-051301eac071 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
20412025-01-18T05:37:44.423ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58913
20422025-01-18T05:37:44.423ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58913 req_id = 0ab099bf-af52-4b0f-a496-95d492cfb336 response_code = 200 uri = /baseboard
20432025-01-18T05:38:02.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37005
20442025-01-18T05:38:02.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37005 req_id = 756e6ac4-98de-448b-988d-5c5465e44858 response_code = 200 uri = /vpc-routes
20452025-01-18T05:38:02.519ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
20462025-01-18T05:38:02.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37005 req_id = 83e3d85d-c792-4c24-b6d8-941056fe136b response_code = 204 uri = /eip-gateways
20472025-01-18T05:38:02.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38732
20482025-01-18T05:38:02.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38732 req_id = cbfef6ae-916a-490f-9d59-b3e050449795 response_code = 200 uri = /vpc-routes
20492025-01-18T05:38:02.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37005 req_id = 52fd264d-9a57-4447-aca4-dcf34f58e16f response_code = 204 uri = /vpc-routes
20502025-01-18T05:38:02.561ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
20512025-01-18T05:38:02.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38732 req_id = 30774ccd-3a3c-4a7a-8980-0444497b7bf6 response_code = 204 uri = /eip-gateways
20522025-01-18T05:38:02.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38732 req_id = 83bc0973-096b-44ba-9fb0-e154a538f0bd response_code = 204 uri = /vpc-routes
20532025-01-18T05:38:02.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49445
20542025-01-18T05:38:02.592ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20552025-01-18T05:38:02.631ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20562025-01-18T05:38:02.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115041 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49445 req_id = 2e484daf-da5e-4857-9413-ab1a3d84e895 response_code = 204 uri = /switch-ports
20572025-01-18T05:38:02.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47797
20582025-01-18T05:38:02.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35340
20592025-01-18T05:38:02.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49445 req_id = 64ce4e5d-dba5-4f56-be3f-d037dd9a88ae response_code = 200 uri = /network-bootstore-config
20602025-01-18T05:38:02.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47797 req_id = cea73028-41aa-45ca-a89b-d08a1411eecc response_code = 200 uri = /v2p
20612025-01-18T05:38:02.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35340 req_id = 0799bd31-5ba3-433f-a41f-e75fc2b02b58 response_code = 200 uri = /v2p
20622025-01-18T05:38:02.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50337
20632025-01-18T05:38:02.721ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20642025-01-18T05:38:02.768ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20652025-01-18T05:38:02.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107443 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50337 req_id = 870724cb-c391-4f06-939f-f4ca3e7f511f response_code = 204 uri = /switch-ports
20662025-01-18T05:38:02.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50337 req_id = b710cc4e-49e0-4250-9107-f30e13994d08 response_code = 200 uri = /network-bootstore-config
20672025-01-18T05:38:02.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35490
20682025-01-18T05:38:02.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35490 req_id = a345a1b8-2678-4558-a416-90df2a0d7240 response_code = 200 uri = /vpc-routes
20692025-01-18T05:38:02.882ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
20702025-01-18T05:38:02.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35490 req_id = 1d6872cd-b1c3-4700-a815-8ff63995ec16 response_code = 204 uri = /eip-gateways
20712025-01-18T05:38:02.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55169
20722025-01-18T05:38:02.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55169 req_id = 1d1cee60-0be7-484e-b605-6d0f0aeacf03 response_code = 200 uri = /v2p
20732025-01-18T05:38:02.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35490 req_id = 3252877e-ac76-4baa-9c2c-bf9cd6a1e10c response_code = 204 uri = /vpc-routes
20742025-01-18T05:38:02.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52669
20752025-01-18T05:38:02.997ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20762025-01-18T05:38:03.036ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20772025-01-18T05:38:03.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94040 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52669 req_id = c9e8a46f-5972-4b23-ab9d-79b27a1550e9 response_code = 204 uri = /switch-ports
20782025-01-18T05:38:03.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52669 req_id = b7138743-b5c2-4869-ba12-48a0b62134c2 response_code = 200 uri = /network-bootstore-config
20792025-01-18T05:38:12.655ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6923 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 2ee90b97-9c8e-46ea-9089-e55666ed5358 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
20802025-01-18T05:38:14.456ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52039
20812025-01-18T05:38:14.456ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52039 req_id = 2f16cfe3-1c61-4ba4-94f2-4ef58942addd response_code = 200 uri = /baseboard
20822025-01-18T05:38:32.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65066
20832025-01-18T05:38:32.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65066 req_id = ccaa915c-a985-4a47-bc71-89475265086d response_code = 200 uri = /vpc-routes
20842025-01-18T05:38:32.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42114
20852025-01-18T05:38:32.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42114 req_id = 5f2bfe59-e224-4d70-8daa-dbd3111bfaf8 response_code = 200 uri = /vpc-routes
20862025-01-18T05:38:32.746ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
20872025-01-18T05:38:32.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65066 req_id = 1006e508-9d1d-4148-84c5-9e79ea5ffedc response_code = 204 uri = /eip-gateways
20882025-01-18T05:38:32.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65066 req_id = da0a82aa-0431-45eb-b7f2-32a325b08830 response_code = 204 uri = /vpc-routes
20892025-01-18T05:38:32.824ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
20902025-01-18T05:38:32.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42114 req_id = b96827d7-a7ea-4f30-a0ad-3807eb4bc40c response_code = 204 uri = /eip-gateways
20912025-01-18T05:38:32.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42114 req_id = a54aba82-a964-42af-aa6d-48d602cd253e response_code = 204 uri = /vpc-routes
20922025-01-18T05:38:32.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59220
20932025-01-18T05:38:32.869ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20942025-01-18T05:38:32.909ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20952025-01-18T05:38:32.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105846 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59220 req_id = 540b9377-5c1d-4fbb-9c71-dcfdfe681b30 response_code = 204 uri = /switch-ports
20962025-01-18T05:38:32.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59220 req_id = 158d86b2-55f9-4991-9e6f-809f6bb81f66 response_code = 200 uri = /network-bootstore-config
20972025-01-18T05:38:33.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49516
20982025-01-18T05:38:33.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49516 req_id = 82b35e7e-f503-4637-aa59-67b8eac631cf response_code = 200 uri = /v2p
20992025-01-18T05:38:33.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50677
21002025-01-18T05:38:33.024ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21012025-01-18T05:38:33.071ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21022025-01-18T05:38:33.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109144 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50677 req_id = de4c3e60-bc91-4412-a66f-caf0172c7845 response_code = 204 uri = /switch-ports
21032025-01-18T05:38:33.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56024
21042025-01-18T05:38:33.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54143
21052025-01-18T05:38:33.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 375 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50677 req_id = 2154c686-d966-46d3-b39d-d7a86a813191 response_code = 200 uri = /network-bootstore-config
21062025-01-18T05:38:33.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56024 req_id = 4569226e-c835-44ab-a499-e29de45035d1 response_code = 200 uri = /v2p
21072025-01-18T05:38:33.133ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21082025-01-18T05:38:33.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21092025-01-18T05:38:33.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21102025-01-18T05:38:33.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21112025-01-18T05:38:33.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21122025-01-18T05:38:33.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21132025-01-18T05:38:33.134ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21142025-01-18T05:38:33.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 545 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54143 req_id = 1ad8a784-d9f0-42ee-8808-b72f24b3ba23 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21152025-01-18T05:38:33.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47723
21162025-01-18T05:38:33.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47723 req_id = 02b64e5c-27bd-4405-82a5-982443c4be7b response_code = 200 uri = /vpc-routes
21172025-01-18T05:38:33.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47849
21182025-01-18T05:38:33.170ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21192025-01-18T05:38:33.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21202025-01-18T05:38:33.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21212025-01-18T05:38:33.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21222025-01-18T05:38:33.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21232025-01-18T05:38:33.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21242025-01-18T05:38:33.170ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21252025-01-18T05:38:33.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47849 req_id = e870b659-ed95-4d9c-8c11-4f6e8fb46af4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21262025-01-18T05:38:33.202ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
21272025-01-18T05:38:33.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47723 req_id = 2ebd1b23-d115-4e74-b3bb-590f3f554726 response_code = 204 uri = /eip-gateways
21282025-01-18T05:38:33.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47723 req_id = 11c0fa16-fe0d-4594-9971-191ca4aefd7a response_code = 204 uri = /vpc-routes
21292025-01-18T05:38:33.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57410
21302025-01-18T05:38:33.245ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21312025-01-18T05:38:33.284ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21322025-01-18T05:38:33.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57410 req_id = c52d18c9-c043-40c0-9096-4c730eed4f1a response_code = 204 uri = /switch-ports
21332025-01-18T05:38:33.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57410 req_id = 019c9eed-aa3f-4fe5-96e7-45a9345b8248 response_code = 200 uri = /network-bootstore-config
21342025-01-18T05:38:33.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54617
21352025-01-18T05:38:33.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54617 req_id = f1b87459-07ce-4213-aa4a-e8ea427549d9 response_code = 200 uri = /v2p
21362025-01-18T05:38:33.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34701
21372025-01-18T05:38:33.416ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21382025-01-18T05:38:33.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21392025-01-18T05:38:33.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21402025-01-18T05:38:33.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21412025-01-18T05:38:33.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21422025-01-18T05:38:33.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21432025-01-18T05:38:33.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21442025-01-18T05:38:33.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34701 req_id = 841d70f9-848a-4057-8f17-0b894d1bb745 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21452025-01-18T05:38:42.658ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8838 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 0af1f17e-e4d6-4acd-bf55-b689bec84bf9 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
21462025-01-18T05:38:44.490ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59069
21472025-01-18T05:38:44.490ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59069 req_id = 95608e23-dbda-4381-817a-ea42771d5c79 response_code = 200 uri = /baseboard
21482025-01-18T05:39:02.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34835
21492025-01-18T05:39:02.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34835 req_id = 4198f42d-8d25-4d33-9a56-3bb39124b167 response_code = 200 uri = /vpc-routes
21502025-01-18T05:39:02.489ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
21512025-01-18T05:39:02.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34835 req_id = 448cb924-328c-4f6b-8d3f-e19b70ffbc26 response_code = 204 uri = /eip-gateways
21522025-01-18T05:39:02.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34835 req_id = efa0ef78-4be3-488f-9031-0c84533ec332 response_code = 204 uri = /vpc-routes
21532025-01-18T05:39:02.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39580
21542025-01-18T05:39:02.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39580 req_id = 671ff90d-a17f-4e3b-ba4a-2e388a275945 response_code = 200 uri = /vpc-routes
21552025-01-18T05:39:02.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
21562025-01-18T05:39:02.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39580 req_id = 1b240d9b-eedf-4280-a7d7-6f62680fefe6 response_code = 204 uri = /eip-gateways
21572025-01-18T05:39:02.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39580 req_id = acc09be7-4255-4c99-8513-e67dae4d3585 response_code = 204 uri = /vpc-routes
21582025-01-18T05:39:02.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42066
21592025-01-18T05:39:02.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42066 req_id = 5d061042-1195-472e-89eb-246fd12aff10 response_code = 200 uri = /v2p
21602025-01-18T05:39:02.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32929
21612025-01-18T05:39:02.593ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21622025-01-18T05:39:02.632ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21632025-01-18T05:39:02.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122305 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32929 req_id = 3645b0bd-cde8-4f22-a823-06b437214836 response_code = 204 uri = /switch-ports
21642025-01-18T05:39:02.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46221
21652025-01-18T05:39:02.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44577
21662025-01-18T05:39:02.716ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21672025-01-18T05:39:02.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32929 req_id = 284fbfa0-278c-4fd1-88a1-a1810354db8d response_code = 200 uri = /network-bootstore-config
21682025-01-18T05:39:02.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46221 req_id = b496d38c-110a-4847-9fd0-3d0ca71605c6 response_code = 200 uri = /v2p
21692025-01-18T05:39:02.769ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21702025-01-18T05:39:02.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114309 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44577 req_id = 9ef0cd39-4af3-468f-b8f9-3d6206a37bba response_code = 204 uri = /switch-ports
21712025-01-18T05:39:02.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44577 req_id = 843b9bc7-73f1-4f80-8ff9-e8ea7cf39029 response_code = 200 uri = /network-bootstore-config
21722025-01-18T05:39:02.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35513
21732025-01-18T05:39:02.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35513 req_id = 96576f37-9754-4a7c-a9c9-0e5225108a79 response_code = 200 uri = /vpc-routes
21742025-01-18T05:39:02.988ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
21752025-01-18T05:39:02.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35513 req_id = f8e353c9-9133-484a-9a1a-ce77e5900e00 response_code = 204 uri = /eip-gateways
21762025-01-18T05:39:03.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37298
21772025-01-18T05:39:03.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37298 req_id = 6249e3f9-6bff-4215-93ac-5d57dcbfe0e9 response_code = 200 uri = /v2p
21782025-01-18T05:39:03.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35513 req_id = 43cf42c5-4605-4b94-ab7a-a143d7ca11a5 response_code = 204 uri = /vpc-routes
21792025-01-18T05:39:03.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50247
21802025-01-18T05:39:03.025ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21812025-01-18T05:39:03.062ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21822025-01-18T05:39:03.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92405 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50247 req_id = 5d476feb-dd75-4746-94b5-6699d5b64f28 response_code = 204 uri = /switch-ports
21832025-01-18T05:39:03.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50247 req_id = b35ec527-4947-411d-8f2a-e2b7c5f69cd0 response_code = 200 uri = /network-bootstore-config
21842025-01-18T05:39:12.657ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7773 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = b5d4beaf-3fcc-43da-9b5a-d37386c6f92f response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
21852025-01-18T05:39:14.525ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35219
21862025-01-18T05:39:14.525ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35219 req_id = 93922baa-2f97-42c8-9f46-c329a19e16ab response_code = 200 uri = /baseboard
21872025-01-18T05:39:32.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46372
21882025-01-18T05:39:32.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46372 req_id = 02613607-2201-4cc0-b31d-2c610bebde73 response_code = 200 uri = /vpc-routes
21892025-01-18T05:39:32.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58727
21902025-01-18T05:39:32.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58727 req_id = 3d3497e9-afde-4da5-bdcc-51f113c3cc31 response_code = 200 uri = /v2p
21912025-01-18T05:39:32.711ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
21922025-01-18T05:39:32.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46372 req_id = 90e638fb-bb8b-40b3-9c00-2b0df3bb6256 response_code = 204 uri = /eip-gateways
21932025-01-18T05:39:32.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46372 req_id = 20a05593-9f4a-40c8-af6a-616ff93936c1 response_code = 204 uri = /vpc-routes
21942025-01-18T05:39:32.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61021
21952025-01-18T05:39:32.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61021 req_id = 6d182388-9d85-4e10-8dec-ca0513bbcd0b response_code = 200 uri = /vpc-routes
21962025-01-18T05:39:32.799ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
21972025-01-18T05:39:32.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61021 req_id = d369676d-6c46-4a3b-afdb-96f1193cfa23 response_code = 204 uri = /eip-gateways
21982025-01-18T05:39:32.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61965
21992025-01-18T05:39:32.817ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22002025-01-18T05:39:32.863ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22012025-01-18T05:39:32.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107010 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61965 req_id = 4e6c481f-2f3a-4f49-9cd1-3539741d5669 response_code = 204 uri = /switch-ports
22022025-01-18T05:39:32.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61965 req_id = 7106f91e-9ead-40c4-81f4-a01b496385e4 response_code = 200 uri = /network-bootstore-config
22032025-01-18T05:39:32.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33950
22042025-01-18T05:39:32.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33950 req_id = 447ed683-19f2-452d-92f3-c21c35917752 response_code = 200 uri = /v2p
22052025-01-18T05:39:32.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61021 req_id = 3223fbb7-d1b2-4fb0-a6a6-590f7582036d response_code = 204 uri = /vpc-routes
22062025-01-18T05:39:32.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34552
22072025-01-18T05:39:32.969ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22082025-01-18T05:39:33.008ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22092025-01-18T05:39:33.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95696 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34552 req_id = 7864c8b6-6df4-4449-9490-1752932c9c8c response_code = 204 uri = /switch-ports
22102025-01-18T05:39:33.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36223
22112025-01-18T05:39:33.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54124
22122025-01-18T05:39:33.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36223 req_id = 6073158a-5ca7-40c3-939e-a81b94176757 response_code = 200 uri = /vpc-routes
22132025-01-18T05:39:33.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34552 req_id = f8a33e8a-c1b8-442a-be93-7cd63967c1ff response_code = 200 uri = /network-bootstore-config
22142025-01-18T05:39:33.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54124 req_id = 33d951d2-a5e9-443e-8a66-92d01c376b1e response_code = 200 uri = /v2p
22152025-01-18T05:39:33.109ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
22162025-01-18T05:39:33.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36223 req_id = 8632fed4-220c-4b58-8b9b-e66b5a664f81 response_code = 204 uri = /eip-gateways
22172025-01-18T05:39:33.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36223 req_id = c5a93550-6fe9-48e3-963e-9d76685c9987 response_code = 204 uri = /vpc-routes
22182025-01-18T05:39:33.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56761
22192025-01-18T05:39:33.179ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22202025-01-18T05:39:33.217ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22212025-01-18T05:39:33.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91853 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56761 req_id = 4f5cbe16-d8e8-4313-98d4-d6dfac4f5be4 response_code = 204 uri = /switch-ports
22222025-01-18T05:39:33.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56761 req_id = 25cf3b3c-8029-4a48-820f-d93f33182ad6 response_code = 200 uri = /network-bootstore-config
22232025-01-18T05:39:42.657ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7181 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = e89c3afd-b523-43e0-a23c-da6f0f4658c8 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
22242025-01-18T05:39:44.558ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62723
22252025-01-18T05:39:44.558ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62723 req_id = de1fff4b-96ba-4c83-82f4-05f27415f9b9 response_code = 200 uri = /baseboard
22262025-01-18T05:40:02.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51832
22272025-01-18T05:40:02.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51832 req_id = 531501be-8b21-4d51-9bce-b2b66df71d78 response_code = 200 uri = /v2p
22282025-01-18T05:40:02.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41263
22292025-01-18T05:40:02.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41263 req_id = df104c72-ac58-4cba-886e-baa1881229fe response_code = 200 uri = /vpc-routes
22302025-01-18T05:40:02.547ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
22312025-01-18T05:40:02.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41263 req_id = 939e21b0-58b4-43a2-886d-1c0277dad208 response_code = 204 uri = /eip-gateways
22322025-01-18T05:40:02.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41263 req_id = ed32a46c-dbf7-49c6-8545-dd88f6438ffd response_code = 204 uri = /vpc-routes
22332025-01-18T05:40:02.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63601
22342025-01-18T05:40:02.593ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22352025-01-18T05:40:02.630ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22362025-01-18T05:40:02.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109370 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63601 req_id = 9ac71d8e-3d90-4b8f-aa9c-a32b47f63495 response_code = 204 uri = /switch-ports
22372025-01-18T05:40:02.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45954
22382025-01-18T05:40:02.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57145
22392025-01-18T05:40:02.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51829
22402025-01-18T05:40:02.703ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22412025-01-18T05:40:02.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63601 req_id = d7515590-1932-4113-8828-b0d685aab21d response_code = 200 uri = /network-bootstore-config
22422025-01-18T05:40:02.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45954 req_id = 7397f986-34dc-41b5-a5df-0e0dd0cc101c response_code = 200 uri = /vpc-routes
22432025-01-18T05:40:02.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5422 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57145 req_id = eb3bdf56-204b-4dac-894f-45de0ee10ce7 response_code = 200 uri = /v2p
22442025-01-18T05:40:02.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
22452025-01-18T05:40:02.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45954 req_id = c5223b8b-987f-445b-9d21-b78daca3c5fe response_code = 204 uri = /eip-gateways
22462025-01-18T05:40:02.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1016 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45954 req_id = 920698fb-d650-44cb-875b-277187bf8847 response_code = 204 uri = /vpc-routes
22472025-01-18T05:40:02.746ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22482025-01-18T05:40:02.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50978
22492025-01-18T05:40:02.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50978 req_id = 8ebc1d70-777b-4930-a9ec-ff0bcdc7e4cc response_code = 200 uri = /vpc-routes
22502025-01-18T05:40:02.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111277 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51829 req_id = d6b54dbe-c927-42fa-9e19-64a986d4a395 response_code = 204 uri = /switch-ports
22512025-01-18T05:40:02.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51829 req_id = 24309433-0251-4d30-a243-899fd4820a8e response_code = 200 uri = /network-bootstore-config
22522025-01-18T05:40:02.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
22532025-01-18T05:40:02.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50978 req_id = e42e84c7-c5ef-4fb0-bb1c-0ef248a02065 response_code = 204 uri = /eip-gateways
22542025-01-18T05:40:02.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50978 req_id = acbe0026-5b54-4bf9-a630-ac2cadac242d response_code = 204 uri = /vpc-routes
22552025-01-18T05:40:02.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49948
22562025-01-18T05:40:02.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49948 req_id = 349364cb-575a-4850-8f9e-222a6e9e6742 response_code = 200 uri = /v2p
22572025-01-18T05:40:03.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61722
22582025-01-18T05:40:03.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22592025-01-18T05:40:03.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22602025-01-18T05:40:03.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92081 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61722 req_id = 213ba6c9-fa5c-4bbd-bee3-29063477dab8 response_code = 204 uri = /switch-ports
22612025-01-18T05:40:03.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61722 req_id = 5e0f24e1-8000-457a-9c31-36a351f0965f response_code = 200 uri = /network-bootstore-config
22622025-01-18T05:40:12.657ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7375 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 803a8624-e767-46d6-b3a9-d17c9e13024e response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
22632025-01-18T05:40:14.591ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46431
22642025-01-18T05:40:14.591ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46431 req_id = 3e567767-694e-46ae-89f2-1066b106aff4 response_code = 200 uri = /baseboard
22652025-01-18T05:40:32.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57268
22662025-01-18T05:40:32.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57268 req_id = 2cad19dd-c247-41d7-879a-72d9c39309c3 response_code = 200 uri = /vpc-routes
22672025-01-18T05:40:32.713ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
22682025-01-18T05:40:32.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57268 req_id = bdda65f0-a8e3-4b30-9a6e-242bebc7c95b response_code = 204 uri = /eip-gateways
22692025-01-18T05:40:32.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57268 req_id = 242790fe-df6d-4f8b-aa5b-18dc330855e3 response_code = 204 uri = /vpc-routes
22702025-01-18T05:40:32.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51152
22712025-01-18T05:40:32.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51152 req_id = 86d18cba-0573-47f1-a833-7b910f2d8838 response_code = 200 uri = /vpc-routes
22722025-01-18T05:40:32.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
22732025-01-18T05:40:32.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51152 req_id = 91a4fa58-af7f-4de2-99b9-292c27cce3fb response_code = 204 uri = /eip-gateways
22742025-01-18T05:40:32.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 408 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51152 req_id = 7d73e573-7000-4c36-9050-f9394bf9ad88 response_code = 204 uri = /vpc-routes
22752025-01-18T05:40:32.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55529
22762025-01-18T05:40:32.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55529 req_id = 27d345f0-83fe-401b-bb21-de13933ca690 response_code = 200 uri = /v2p
22772025-01-18T05:40:32.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35991
22782025-01-18T05:40:32.866ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22792025-01-18T05:40:32.906ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22802025-01-18T05:40:32.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98560 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35991 req_id = 2d076429-90d4-4074-aebd-6348014fc23e response_code = 204 uri = /switch-ports
22812025-01-18T05:40:32.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56097
22822025-01-18T05:40:32.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41550
22832025-01-18T05:40:32.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56097 req_id = 2ebe3eaf-0efc-466a-b814-c1070eb46414 response_code = 200 uri = /v2p
22842025-01-18T05:40:32.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35991 req_id = 3bf898fb-3f3c-4c9a-98b6-eb6f91196401 response_code = 200 uri = /network-bootstore-config
22852025-01-18T05:40:32.965ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22862025-01-18T05:40:32.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59128
22872025-01-18T05:40:32.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59128 req_id = 248d29d3-6aae-42d1-b974-30ab1b690ecd response_code = 200 uri = /vpc-routes
22882025-01-18T05:40:32.988ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
22892025-01-18T05:40:32.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59128 req_id = bec1a0db-8398-4a51-b25a-6bf98e3bb2c3 response_code = 204 uri = /eip-gateways
22902025-01-18T05:40:33.007ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22912025-01-18T05:40:33.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63495
22922025-01-18T05:40:33.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63495 req_id = 1d3ae122-a1e1-4085-b33c-bf4a09860a7d response_code = 200 uri = /v2p
22932025-01-18T05:40:33.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99463 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41550 req_id = dfb594b8-e4f6-4d6c-b923-bbcc2a0183ab response_code = 204 uri = /switch-ports
22942025-01-18T05:40:33.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41550 req_id = 28d2b1fc-5c1f-472f-a9a1-a49dfb1750e4 response_code = 200 uri = /network-bootstore-config
22952025-01-18T05:40:33.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59128 req_id = 1989cef6-c898-4987-820f-94dcf46198cf response_code = 204 uri = /vpc-routes
22962025-01-18T05:40:33.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38701
22972025-01-18T05:40:33.204ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22982025-01-18T05:40:33.241ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22992025-01-18T05:40:33.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92406 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38701 req_id = 101f3af0-c390-4a5c-ae56-7358e54a7099 response_code = 204 uri = /switch-ports
23002025-01-18T05:40:33.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38701 req_id = 599fcc74-fb57-44bb-83e3-8b902927bd90 response_code = 200 uri = /network-bootstore-config
23012025-01-18T05:40:42.658ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7705 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = f46f64a4-a87d-4dd6-86d4-52730672378b response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
23022025-01-18T05:40:44.623ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37383
23032025-01-18T05:40:44.623ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37383 req_id = afce6f42-32b6-4b22-8575-cd67ba3411bf response_code = 200 uri = /baseboard
23042025-01-18T05:41:02.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48769
23052025-01-18T05:41:02.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48769 req_id = 5ae37e18-97b7-4c54-987a-ce7a6d6702dc response_code = 200 uri = /vpc-routes
23062025-01-18T05:41:02.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
23072025-01-18T05:41:02.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48769 req_id = 5831e9b7-226c-49b0-80d8-229f00c4fa6c response_code = 204 uri = /eip-gateways
23082025-01-18T05:41:02.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48769 req_id = 540990a3-5fb9-4e31-a29a-9903905cd789 response_code = 204 uri = /vpc-routes
23092025-01-18T05:41:02.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65502
23102025-01-18T05:41:02.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65502 req_id = 089556e7-7f22-46e2-a3df-8286be212afb response_code = 200 uri = /vpc-routes
23112025-01-18T05:41:02.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55132
23122025-01-18T05:41:02.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55132 req_id = e4bd45e2-4874-4644-9933-828c94739a79 response_code = 200 uri = /v2p
23132025-01-18T05:41:02.554ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
23142025-01-18T05:41:02.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65502 req_id = f2d58018-852f-40dc-a8fc-61848cc35f18 response_code = 204 uri = /eip-gateways
23152025-01-18T05:41:02.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65502 req_id = 27d3f321-54ea-42a9-b12d-372c9f7a059d response_code = 204 uri = /vpc-routes
23162025-01-18T05:41:02.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41380
23172025-01-18T05:41:02.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41380 req_id = d199fa91-7ead-48be-bb42-b9647dc35222 response_code = 200 uri = /v2p
23182025-01-18T05:41:02.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44590
23192025-01-18T05:41:02.600ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23202025-01-18T05:41:02.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23212025-01-18T05:41:02.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127743 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44590 req_id = 59cdd4eb-ee94-4efe-b427-a93212dfd336 response_code = 204 uri = /switch-ports
23222025-01-18T05:41:02.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63648
23232025-01-18T05:41:02.728ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23242025-01-18T05:41:02.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44590 req_id = e93a5b09-6e6c-4999-9247-8eb7f231898b response_code = 200 uri = /network-bootstore-config
23252025-01-18T05:41:02.787ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23262025-01-18T05:41:02.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138900 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63648 req_id = 62f21854-02b8-45ee-977a-4fe357b860cf response_code = 204 uri = /switch-ports
23272025-01-18T05:41:02.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63648 req_id = 302be234-fda8-4b57-9465-6e0471a625d2 response_code = 200 uri = /network-bootstore-config
23282025-01-18T05:41:02.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41531
23292025-01-18T05:41:02.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41531 req_id = 30ec56be-7f74-40f7-9ec3-1dc9b569582e response_code = 200 uri = /vpc-routes
23302025-01-18T05:41:02.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33811
23312025-01-18T05:41:02.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33811 req_id = d741a8d6-e1ac-476a-afe7-e9038a0a39cb response_code = 200 uri = /v2p
23322025-01-18T05:41:02.991ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
23332025-01-18T05:41:02.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41531 req_id = 28260279-e337-439c-99df-16b20098988f response_code = 204 uri = /eip-gateways
23342025-01-18T05:41:03.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41531 req_id = 5bd0d3e5-b74d-4a8d-8091-209e9b3e9910 response_code = 204 uri = /vpc-routes
23352025-01-18T05:41:03.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50051
23362025-01-18T05:41:03.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23372025-01-18T05:41:03.061ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23382025-01-18T05:41:03.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50051 req_id = a8d2ccc2-9d76-4aad-bf91-898c5907a13e response_code = 204 uri = /switch-ports
23392025-01-18T05:41:03.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50051 req_id = e4bc70ff-719c-4455-b937-f0f01d795d54 response_code = 200 uri = /network-bootstore-config
23402025-01-18T05:41:12.658ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8092 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = cd4fa945-bbd8-4138-b04d-db4a13ceab4a response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
23412025-01-18T05:41:13.293ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23422025-01-18T05:41:13.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23432025-01-18T05:41:13.323ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1714, tv_nsec: 336359159 } time_to_next_cleanup = 599.999997199s
23442025-01-18T05:41:14.658ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57297
23452025-01-18T05:41:14.658ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57297 req_id = f6a925e9-736b-47da-a890-ab8c2ee3172e response_code = 200 uri = /baseboard
23462025-01-18T05:41:27.169ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23472025-01-18T05:41:32.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59910
23482025-01-18T05:41:32.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59910 req_id = 5a425cfd-344a-40a5-8004-c148980883ac response_code = 200 uri = /vpc-routes
23492025-01-18T05:41:32.541ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
23502025-01-18T05:41:32.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59910 req_id = 947b9fbf-9107-4f2e-9aa0-b1eb6197f873 response_code = 204 uri = /eip-gateways
23512025-01-18T05:41:32.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59910 req_id = 8fc9d4c7-8d2a-42c2-a2b7-b78fb6d181b3 response_code = 204 uri = /vpc-routes
23522025-01-18T05:41:32.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41305
23532025-01-18T05:41:32.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41305 req_id = 1002171a-8f41-4246-82a4-a085ef7eaa0f response_code = 200 uri = /v2p
23542025-01-18T05:41:32.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59548
23552025-01-18T05:41:32.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59548 req_id = e910286f-f291-4a62-a69d-81759befaaec response_code = 200 uri = /vpc-routes
23562025-01-18T05:41:32.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42077
23572025-01-18T05:41:32.799ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23582025-01-18T05:41:32.855ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23592025-01-18T05:41:32.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119599 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42077 req_id = f26d2f6e-a712-4536-9f09-1016dfd99dd1 response_code = 204 uri = /switch-ports
23602025-01-18T05:41:32.919ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
23612025-01-18T05:41:32.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59548 req_id = 305c672c-8ae0-4e79-89e2-2fc89fdb551f response_code = 204 uri = /eip-gateways
23622025-01-18T05:41:32.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42077 req_id = 643cf636-54c7-4efc-a81d-60b2d63f1975 response_code = 200 uri = /network-bootstore-config
23632025-01-18T05:41:32.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59548 req_id = a004a88a-117f-493f-8c91-59f5768559ff response_code = 204 uri = /vpc-routes
23642025-01-18T05:41:32.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50000
23652025-01-18T05:41:32.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50000 req_id = 6044f756-d7ca-457d-a095-86c1c1d32c78 response_code = 200 uri = /v2p
23662025-01-18T05:41:33.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61784
23672025-01-18T05:41:33.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61784 req_id = 22c2822a-a2d1-40fe-9a67-bf42febdc467 response_code = 200 uri = /v2p
23682025-01-18T05:41:33.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38463
23692025-01-18T05:41:33.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38463 req_id = 43023dda-d65f-481b-9b69-7e40dfdcd6bf response_code = 200 uri = /vpc-routes
23702025-01-18T05:41:33.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55307
23712025-01-18T05:41:33.047ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23722025-01-18T05:41:33.090ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23732025-01-18T05:41:33.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97130 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55307 req_id = b40daf15-3ad5-47e5-a6a1-d20399309076 response_code = 204 uri = /switch-ports
23742025-01-18T05:41:33.145ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
23752025-01-18T05:41:33.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38463 req_id = cda493d6-6fd0-4801-bcda-fc666d3c6da3 response_code = 204 uri = /eip-gateways
23762025-01-18T05:41:33.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55307 req_id = 27c69ca2-2a76-4418-9a12-34db14d321a2 response_code = 200 uri = /network-bootstore-config
23772025-01-18T05:41:33.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38463 req_id = edd5c4d7-af96-4433-af62-ea2d9fe1817f response_code = 204 uri = /vpc-routes
23782025-01-18T05:41:33.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44997
23792025-01-18T05:41:33.272ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23802025-01-18T05:41:33.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23812025-01-18T05:41:33.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94609 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44997 req_id = 54dfdbe3-4c28-4a86-96f3-4f1cdd75fd3d response_code = 204 uri = /switch-ports
23822025-01-18T05:41:33.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44997 req_id = ca1dc80d-dfdb-49be-8886-77414becb3a2 response_code = 200 uri = /network-bootstore-config
23832025-01-18T05:41:42.659ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8136 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = f4379118-d4d1-406d-9942-cf07101b2ee9 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
23842025-01-18T05:41:44.690ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53915
23852025-01-18T05:41:44.690ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53915 req_id = 6a96e343-83b4-4513-b327-96831460d738 response_code = 200 uri = /baseboard
23862025-01-18T05:42:02.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59128
23872025-01-18T05:42:02.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59128 req_id = 01379662-9915-405c-9f00-d121c43eb678 response_code = 200 uri = /vpc-routes
23882025-01-18T05:42:02.565ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
23892025-01-18T05:42:02.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59128 req_id = a4d2af63-54ed-4c84-a55f-930b89bc96a8 response_code = 204 uri = /eip-gateways
23902025-01-18T05:42:02.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40516
23912025-01-18T05:42:02.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40516 req_id = 0a1c868e-e2e6-43a2-a44b-b79b8e962767 response_code = 200 uri = /vpc-routes
23922025-01-18T05:42:02.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59128 req_id = 561c13d8-da7c-4bac-ad13-6f5e7139416b response_code = 204 uri = /vpc-routes
23932025-01-18T05:42:02.628ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
23942025-01-18T05:42:02.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40516 req_id = af388568-a5a3-40f0-a058-62399512395b response_code = 204 uri = /eip-gateways
23952025-01-18T05:42:02.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40516 req_id = 52a5197b-b5ae-4c1b-882f-381005596122 response_code = 204 uri = /vpc-routes
23962025-01-18T05:42:02.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35600
23972025-01-18T05:42:02.639ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23982025-01-18T05:42:02.684ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23992025-01-18T05:42:02.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127173 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35600 req_id = 63871528-6d0c-4a78-8584-562c94743190 response_code = 204 uri = /switch-ports
24002025-01-18T05:42:02.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54775
24012025-01-18T05:42:02.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53560
24022025-01-18T05:42:02.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34064
24032025-01-18T05:42:02.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34064 req_id = d1683471-a7b8-428e-a69f-4d2e57d68358 response_code = 200 uri = /v2p
24042025-01-18T05:42:02.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35600 req_id = ef0d88a2-8721-49c1-8960-0c704c6d3f40 response_code = 200 uri = /network-bootstore-config
24052025-01-18T05:42:02.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24062025-01-18T05:42:02.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54775 req_id = 7f396618-e505-4f7c-8033-95e964b8859a response_code = 200 uri = /v2p
24072025-01-18T05:42:02.811ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24082025-01-18T05:42:02.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109887 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53560 req_id = 1618933e-bb11-47dc-bdf5-e456b7113395 response_code = 204 uri = /switch-ports
24092025-01-18T05:42:02.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53560 req_id = e3b90282-0fd3-48ec-9b56-46653a1b7fa5 response_code = 200 uri = /network-bootstore-config
24102025-01-18T05:42:02.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59855
24112025-01-18T05:42:02.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59855 req_id = 561f43a0-ca30-4ff6-b1cf-79d00d814015 response_code = 200 uri = /vpc-routes
24122025-01-18T05:42:02.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
24132025-01-18T05:42:02.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59855 req_id = df918d71-3bb5-46e6-933c-a2108cfd2f5d response_code = 204 uri = /eip-gateways
24142025-01-18T05:42:03.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64410
24152025-01-18T05:42:03.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64410 req_id = cefd7677-2b5f-41a1-b7af-ed7c10678b3d response_code = 200 uri = /v2p
24162025-01-18T05:42:03.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59855 req_id = 826d9d4a-7c72-47d2-9215-121c56948f5e response_code = 204 uri = /vpc-routes
24172025-01-18T05:42:03.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57000
24182025-01-18T05:42:03.084ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24192025-01-18T05:42:03.123ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24202025-01-18T05:42:03.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57000 req_id = f8f2603c-d45b-4a31-ae6d-80b55b085685 response_code = 204 uri = /switch-ports
24212025-01-18T05:42:03.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57000 req_id = 9ac37412-afd0-4d66-8774-e727a4a7f839 response_code = 200 uri = /network-bootstore-config
24222025-01-18T05:42:12.659ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7307 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = d4978b12-4e4a-4733-9e48-0532e4e03e67 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
24232025-01-18T05:42:14.723ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52923
24242025-01-18T05:42:14.723ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52923 req_id = 1bc5f07c-5da6-4dcc-b44a-802ad89fda20 response_code = 200 uri = /baseboard
24252025-01-18T05:42:32.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51130
24262025-01-18T05:42:32.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51130 req_id = b8f54ee7-d4d8-4a6e-892f-3a24639b9662 response_code = 200 uri = /vpc-routes
24272025-01-18T05:42:32.700ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
24282025-01-18T05:42:32.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51130 req_id = f2baf67c-b13a-4de2-958c-fc8e4f832084 response_code = 204 uri = /eip-gateways
24292025-01-18T05:42:32.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51130 req_id = 85df65ea-3f65-4b57-ae2d-0ad3c921c9b7 response_code = 204 uri = /vpc-routes
24302025-01-18T05:42:32.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35244
24312025-01-18T05:42:32.849ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24322025-01-18T05:42:32.901ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24332025-01-18T05:42:32.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141621 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35244 req_id = 81736d59-b2b6-44c2-87d5-b6ac7ccddb26 response_code = 204 uri = /switch-ports
24342025-01-18T05:42:32.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48966
24352025-01-18T05:42:32.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60369
24362025-01-18T05:42:32.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34687
24372025-01-18T05:42:32.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34687 req_id = d6885453-ae00-4b02-917c-61795a9a169c response_code = 200 uri = /vpc-routes
24382025-01-18T05:42:32.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60369 req_id = 9f1063d2-8dd8-4e34-be55-e910cb5e6ef9 response_code = 200 uri = /vpc-routes
24392025-01-18T05:42:32.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48966 req_id = 990d0467-777a-44e5-a96d-1403a4b42d8e response_code = 200 uri = /v2p
24402025-01-18T05:42:32.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35244 req_id = 62e4e5c3-bcc3-4da9-a3a1-7ee2423f15d8 response_code = 200 uri = /network-bootstore-config
24412025-01-18T05:42:33.062ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
24422025-01-18T05:42:33.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34687 req_id = 8e222564-0bc8-4e6e-9553-5ce0980cfa36 response_code = 204 uri = /eip-gateways
24432025-01-18T05:42:33.071ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
24442025-01-18T05:42:33.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60369 req_id = 98840dc3-2d06-4c32-b66a-331c3799e11c response_code = 204 uri = /eip-gateways
24452025-01-18T05:42:33.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60369 req_id = ce7d7a93-2b58-497c-bea9-bc299cf5160a response_code = 204 uri = /vpc-routes
24462025-01-18T05:42:33.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54594
24472025-01-18T05:42:33.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54594 req_id = b8b8e1ce-618e-4b78-8fc1-73cc1ded1229 response_code = 200 uri = /v2p
24482025-01-18T05:42:33.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34687 req_id = 9654ae82-af85-451b-8f91-75070d4c7f97 response_code = 204 uri = /vpc-routes
24492025-01-18T05:42:33.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33868
24502025-01-18T05:42:33.149ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24512025-01-18T05:42:33.186ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24522025-01-18T05:42:33.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90471 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33868 req_id = 587247ac-6b39-4e88-b058-85a34ea968ce response_code = 204 uri = /switch-ports
24532025-01-18T05:42:33.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61340
24542025-01-18T05:42:33.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43113
24552025-01-18T05:42:33.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43113 req_id = 19a550bc-9337-43db-a042-ae458d76c579 response_code = 200 uri = /v2p
24562025-01-18T05:42:33.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33868 req_id = 65b2e1c9-e5ba-483a-80c5-2d017b9b4884 response_code = 200 uri = /network-bootstore-config
24572025-01-18T05:42:33.240ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24582025-01-18T05:42:33.282ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24592025-01-18T05:42:33.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95437 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61340 req_id = 2828e3b9-d0ac-45fb-a19d-352fb6c382bf response_code = 204 uri = /switch-ports
24602025-01-18T05:42:33.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61340 req_id = 8de83a6a-8518-436f-90df-33d842c34c94 response_code = 200 uri = /network-bootstore-config
24612025-01-18T05:42:42.660ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8447 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 272912b9-f790-4ae3-8cbd-6f0ba46133e2 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
24622025-01-18T05:42:44.757ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58703
24632025-01-18T05:42:44.757ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58703 req_id = 15105ce0-31fd-4d0d-90da-9c536ced2075 response_code = 200 uri = /baseboard
24642025-01-18T05:43:02.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51049
24652025-01-18T05:43:02.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51049 req_id = 48215156-a059-4f51-9c57-d58641eefa7d response_code = 200 uri = /vpc-routes
24662025-01-18T05:43:02.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41405
24672025-01-18T05:43:02.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41405 req_id = e9049a11-3cfe-4f91-8b9e-da9efcfb0727 response_code = 200 uri = /vpc-routes
24682025-01-18T05:43:02.629ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
24692025-01-18T05:43:02.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51049 req_id = 81eda781-7194-4b24-a321-3436ac57a6d0 response_code = 204 uri = /eip-gateways
24702025-01-18T05:43:02.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51049 req_id = 57af4c21-3a1d-47a3-9430-791f7ac410b8 response_code = 204 uri = /vpc-routes
24712025-01-18T05:43:02.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45864
24722025-01-18T05:43:02.660ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24732025-01-18T05:43:02.714ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24742025-01-18T05:43:02.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45864 req_id = fc8e173d-00d8-48e4-bf30-4490e0bd3db4 response_code = 204 uri = /switch-ports
24752025-01-18T05:43:02.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57981
24762025-01-18T05:43:02.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45864 req_id = 45f2bf58-8b5d-4de7-a81e-fad49ed9e167 response_code = 200 uri = /network-bootstore-config
24772025-01-18T05:43:02.796ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
24782025-01-18T05:43:02.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41405 req_id = ebc79020-d344-4c77-9a0e-bede202b7bed response_code = 204 uri = /eip-gateways
24792025-01-18T05:43:02.796ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24802025-01-18T05:43:02.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41405 req_id = b934217e-2182-4e1e-81e6-aa549a39a626 response_code = 204 uri = /vpc-routes
24812025-01-18T05:43:02.842ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24822025-01-18T05:43:02.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59902
24832025-01-18T05:43:02.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59902 req_id = b3a4d66a-6597-4483-9d1f-dd57066351e5 response_code = 200 uri = /v2p
24842025-01-18T05:43:02.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34788
24852025-01-18T05:43:02.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34788 req_id = 318f10de-2bd7-4018-81ce-c090ef97155c response_code = 200 uri = /vpc-routes
24862025-01-18T05:43:02.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61757
24872025-01-18T05:43:02.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61757 req_id = 125324ca-9e7d-4b29-a743-db9d7bede00a response_code = 200 uri = /v2p
24882025-01-18T05:43:02.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57981 req_id = 2eba7db2-e20e-49b0-9f09-936ebc4de073 response_code = 204 uri = /switch-ports
24892025-01-18T05:43:02.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57981 req_id = 210a780f-2fa4-4454-b098-43bc1133ddff response_code = 200 uri = /network-bootstore-config
24902025-01-18T05:43:02.922ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
24912025-01-18T05:43:02.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34788 req_id = 66b11b62-cc96-43e8-9c06-3cae9179cf4a response_code = 204 uri = /eip-gateways
24922025-01-18T05:43:02.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34788 req_id = 2f76370c-b4e9-4ea5-a6f4-44194cb3e167 response_code = 204 uri = /vpc-routes
24932025-01-18T05:43:03.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61630
24942025-01-18T05:43:03.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61630 req_id = 3945a5fa-64e5-4c27-b9cc-866e2f4f25a5 response_code = 200 uri = /v2p
24952025-01-18T05:43:03.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36841
24962025-01-18T05:43:03.044ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24972025-01-18T05:43:03.083ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24982025-01-18T05:43:03.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36841 req_id = 31a93950-daec-4692-88cf-ce30b5ae9844 response_code = 204 uri = /switch-ports
24992025-01-18T05:43:03.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36841 req_id = fa53ff92-18fb-4ee3-8ac3-900c09920043 response_code = 200 uri = /network-bootstore-config
25002025-01-18T05:43:12.659ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7017 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 5c08675b-5ab8-425a-99ab-ed5ecb842ec7 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
25012025-01-18T05:43:14.790ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33943
25022025-01-18T05:43:14.790ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33943 req_id = 010f7b55-9f22-4867-a522-056a7167c138 response_code = 200 uri = /baseboard
25032025-01-18T05:43:32.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60511
25042025-01-18T05:43:32.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60511 req_id = 61ddc28a-218c-4acb-af11-01276ea9e64e response_code = 200 uri = /vpc-routes
25052025-01-18T05:43:32.640ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
25062025-01-18T05:43:32.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60511 req_id = b3d25cca-b250-45c8-88e3-50ef13b15fc9 response_code = 204 uri = /eip-gateways
25072025-01-18T05:43:32.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60511 req_id = 6c081614-3a2b-422d-8d07-4e0c781b2897 response_code = 204 uri = /vpc-routes
25082025-01-18T05:43:32.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57116
25092025-01-18T05:43:32.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57116 req_id = 06fa4b05-6a43-4de5-8f46-a9e6dab6d4e9 response_code = 200 uri = /vpc-routes
25102025-01-18T05:43:32.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59507
25112025-01-18T05:43:32.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59507 req_id = 11df69ea-5bb3-43c7-aecf-f7f2498b89b4 response_code = 200 uri = /v2p
25122025-01-18T05:43:32.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
25132025-01-18T05:43:32.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57116 req_id = 72771aa0-2a3f-4a66-a332-928d40666861 response_code = 204 uri = /eip-gateways
25142025-01-18T05:43:32.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62401
25152025-01-18T05:43:32.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62401 req_id = c543875d-0cc7-4388-a84b-0eff093de992 response_code = 200 uri = /v2p
25162025-01-18T05:43:32.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57116 req_id = 22cc317e-606d-409e-b895-b9490658cf5f response_code = 204 uri = /vpc-routes
25172025-01-18T05:43:33.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44863
25182025-01-18T05:43:33.008ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25192025-01-18T05:43:33.008ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25202025-01-18T05:43:33.008ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-zones.json file = common/src/ledger.rs:177
25212025-01-18T05:43:33.009ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-zones.json file = common/src/ledger.rs:177
25222025-01-18T05:43:33.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52224
25232025-01-18T05:43:33.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25242025-01-18T05:43:33.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25252025-01-18T05:43:33.019ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-zones.json file = common/src/ledger.rs:177
25262025-01-18T05:43:33.019ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-zones.json file = common/src/ledger.rs:177
25272025-01-18T05:43:33.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45535
25282025-01-18T05:43:33.024ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25292025-01-18T05:43:33.024ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417
25302025-01-18T05:43:33.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 677 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45535 req_id = d09fc91c-5260-4a5e-a9c8-9f3973a6e99a response_code = 200 uri = /vpc-routes
25312025-01-18T05:43:33.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51463
25322025-01-18T05:43:33.029ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25332025-01-18T05:43:33.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61456
25342025-01-18T05:43:33.041ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25352025-01-18T05:43:33.041ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417
25362025-01-18T05:43:33.051ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
25372025-01-18T05:43:33.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5523 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45535 req_id = 60b42f34-8e4f-4069-8f43-306aeb3cb682 response_code = 204 uri = /eip-gateways
25382025-01-18T05:43:33.072ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25392025-01-18T05:43:33.072ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3
25402025-01-18T05:43:33.081ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25412025-01-18T05:43:33.091ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25422025-01-18T05:43:33.091ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3
25432025-01-18T05:43:33.110ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25442025-01-18T05:43:33.110ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175
25452025-01-18T05:43:33.128ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25462025-01-18T05:43:33.128ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175
25472025-01-18T05:43:33.157ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25482025-01-18T05:43:33.157ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_18259e54-9e24-4df6-8524-340cf6c3dae0
25492025-01-18T05:43:33.161ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25502025-01-18T05:43:33.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132401 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51463 req_id = 717cc116-2eef-45fd-ab6b-67f3e2aca52d response_code = 204 uri = /switch-ports
25512025-01-18T05:43:33.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5551 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51463 req_id = f942497b-08ec-445b-890e-cc568ec6c3ca response_code = 200 uri = /network-bootstore-config
25522025-01-18T05:43:33.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43048
25532025-01-18T05:43:33.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43048 req_id = 2d129ec6-807a-4dd7-b8fa-9a212395025d response_code = 200 uri = /v2p
25542025-01-18T05:43:33.173ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25552025-01-18T05:43:33.173ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_18259e54-9e24-4df6-8524-340cf6c3dae0
25562025-01-18T05:43:33.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48096
25572025-01-18T05:43:33.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57862
25582025-01-18T05:43:33.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1086 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45535 req_id = 42a441c8-2692-43a8-92d2-3f01bbf57757 response_code = 204 uri = /vpc-routes
25592025-01-18T05:43:33.193ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25602025-01-18T05:43:33.193ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25612025-01-18T05:43:33.193ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25622025-01-18T05:43:33.193ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25632025-01-18T05:43:33.193ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25642025-01-18T05:43:33.193ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25652025-01-18T05:43:33.193ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25662025-01-18T05:43:33.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 755 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48096 req_id = 14e4e567-1ae5-49ba-adbd-284cefbe0f2a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25672025-01-18T05:43:33.198ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25682025-01-18T05:43:33.198ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d55380f8-3d86-4c31-b244-3f6e51844733
25692025-01-18T05:43:33.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41598
25702025-01-18T05:43:33.213ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25712025-01-18T05:43:33.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25722025-01-18T05:43:33.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25732025-01-18T05:43:33.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25742025-01-18T05:43:33.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25752025-01-18T05:43:33.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25762025-01-18T05:43:33.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25772025-01-18T05:43:33.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 752 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41598 req_id = 35b5584c-1e2a-422e-b77f-afaef2b3928e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25782025-01-18T05:43:33.213ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25792025-01-18T05:43:33.213ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25802025-01-18T05:43:33.213ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/config/omicron-zones.json file = common/src/ledger.rs:177
25812025-01-18T05:43:33.218ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25822025-01-18T05:43:33.218ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d55380f8-3d86-4c31-b244-3f6e51844733
25832025-01-18T05:43:33.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25842025-01-18T05:43:33.228ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/config/omicron-zones.json file = common/src/ledger.rs:177
25852025-01-18T05:43:33.235ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25862025-01-18T05:43:33.235ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed
25872025-01-18T05:43:33.250ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fce5e22-dd7b-4e66-a770-f8a29f4d2417 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25882025-01-18T05:43:33.250ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4fce5e22-dd7b-4e66-a770-f8a29f4d2417
25892025-01-18T05:43:33.271ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25902025-01-18T05:43:33.271ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed
25912025-01-18T05:43:33.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37788
25922025-01-18T05:43:33.291ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25932025-01-18T05:43:33.291ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3
25942025-01-18T05:43:33.299ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25952025-01-18T05:43:33.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 263456 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61456 req_id = cef77056-9e25-4401-a0a6-130e5295438f response_code = 204 uri = /switch-ports
25962025-01-18T05:43:33.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 629 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61456 req_id = ab51794d-52a8-4393-a569-186b3f55cc1b response_code = 200 uri = /network-bootstore-config
25972025-01-18T05:43:33.306ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25982025-01-18T05:43:33.306ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26
25992025-01-18T05:43:33.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35498
26002025-01-18T05:43:33.320ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 906df158-6cd2-4600-aea5-ceb32fa11fcd, kind: Service { id: 1aa463d5-7355-427d-b304-9ceac16b2a98 }, name: Name("external-dns-1aa463d5-7355-427d-b304-9ceac16b2a98"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 201])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d3c96dab-1bb2-4ba3-9e66-f500a76d3d51, kind: Service { id: 8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a }, name: Name("external-dns-8c0bccd4-0e5e-4b84-8abe-deb4b6f9b71a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 632dba1f-cad8-4627-89a1-a0d07ed68c1a, kind: Service { id: a030d6fe-5525-4fd9-b798-deef6a379607 }, name: Name("nexus-a030d6fe-5525-4fd9-b798-deef6a379607"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8e3c364f-81e8-400d-a030-07e488d82c60, kind: Service { id: cfc229a4-62cc-4318-9a2b-bd982a26b2cc }, name: Name("nexus-cfc229a4-62cc-4318-9a2b-bd982a26b2cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a99e0e69-e73d-41ae-b9cf-7fce15351e51, kind: Service { id: dc75c5f5-6608-453d-8b53-d1945633bfdb }, name: Name("nexus-dc75c5f5-6608-453d-8b53-d1945633bfdb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26012025-01-18T05:43:33.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26022025-01-18T05:43:33.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26032025-01-18T05:43:33.321ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26042025-01-18T05:43:33.321ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26052025-01-18T05:43:33.321ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26062025-01-18T05:43:33.321ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26072025-01-18T05:43:33.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 876 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35498 req_id = 1663222b-f89a-488a-837b-b675fd7700af response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26082025-01-18T05:43:33.324ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26092025-01-18T05:43:33.324ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26
26102025-01-18T05:43:33.341ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26112025-01-18T05:43:33.341ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cb543c1b-d520-4525-93a9-0809c84c04cd
26122025-01-18T05:43:33.344ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26132025-01-18T05:43:33.353ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 16bb833e-d265-4e47-8c19-1cb9a8fa2175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26142025-01-18T05:43:33.354ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_16bb833e-d265-4e47-8c19-1cb9a8fa2175
26152025-01-18T05:43:33.369ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26162025-01-18T05:43:33.369ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cb543c1b-d520-4525-93a9-0809c84c04cd
26172025-01-18T05:43:33.393ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 18259e54-9e24-4df6-8524-340cf6c3dae0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26182025-01-18T05:43:33.393ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_18259e54-9e24-4df6-8524-340cf6c3dae0
26192025-01-18T05:43:33.406ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26202025-01-18T05:43:33.406ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_719280f2-3e89-4055-a81d-4f9adba21825
26212025-01-18T05:43:33.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130609 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37788 req_id = b866135c-0e11-4081-9bd2-f96cf2c5cdfc response_code = 204 uri = /switch-ports
26222025-01-18T05:43:33.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37788 req_id = bd4c65e0-f7d3-495b-ad47-2179764331d5 response_code = 200 uri = /network-bootstore-config
26232025-01-18T05:43:33.422ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26242025-01-18T05:43:33.422ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_719280f2-3e89-4055-a81d-4f9adba21825
26252025-01-18T05:43:33.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 419397 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44863 req_id = 37820ad3-0560-42a1-af1f-a6668a55b64d response_code = 200 uri = /inventory
26262025-01-18T05:43:33.436ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d55380f8-3d86-4c31-b244-3f6e51844733 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26272025-01-18T05:43:33.436ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d55380f8-3d86-4c31-b244-3f6e51844733
26282025-01-18T05:43:33.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 433829 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52224 req_id = 966f347a-42a8-47ea-bbac-6f672e370b94 response_code = 200 uri = /inventory
26292025-01-18T05:43:33.459ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd4f6a2e-c7eb-469f-bd80-c35295e612ed (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26302025-01-18T05:43:33.459ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bd4f6a2e-c7eb-469f-bd80-c35295e612ed
26312025-01-18T05:43:33.481ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b7babb3e-ef5b-474b-b57e-4a826283aa26 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26322025-01-18T05:43:33.481ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b7babb3e-ef5b-474b-b57e-4a826283aa26
26332025-01-18T05:43:33.503ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cb543c1b-d520-4525-93a9-0809c84c04cd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26342025-01-18T05:43:33.504ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cb543c1b-d520-4525-93a9-0809c84c04cd
26352025-01-18T05:43:33.525ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 719280f2-3e89-4055-a81d-4f9adba21825 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26362025-01-18T05:43:33.525ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_719280f2-3e89-4055-a81d-4f9adba21825
26372025-01-18T05:43:33.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 345863 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57862 req_id = e9e4da58-a096-4e10-8038-ec447d2e92df response_code = 200 uri = /inventory
26382025-01-18T05:43:42.660ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8047 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = d9737820-4bfc-44e7-9144-5b3fe761720f response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
26392025-01-18T05:43:44.823ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42176
26402025-01-18T05:43:44.823ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42176 req_id = 382637ad-2cc3-4dc0-9504-d76bee7d92d4 response_code = 200 uri = /baseboard
26412025-01-18T05:44:02.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38815
26422025-01-18T05:44:02.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38815 req_id = 13c62c5e-c421-4d15-af57-7b4923b59519 response_code = 200 uri = /vpc-routes
26432025-01-18T05:44:02.458ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
26442025-01-18T05:44:02.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38815 req_id = 3d3c82b2-9c4d-4282-a875-bf66a48c39ae response_code = 204 uri = /eip-gateways
26452025-01-18T05:44:02.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38815 req_id = 4cefcdc8-98a2-41c5-aed9-e23d9786710c response_code = 204 uri = /vpc-routes
26462025-01-18T05:44:02.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42634
26472025-01-18T05:44:02.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42634 req_id = 7e4a596c-2f1e-4d9a-b56d-b6f885cfd7b0 response_code = 200 uri = /vpc-routes
26482025-01-18T05:44:02.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42960
26492025-01-18T05:44:02.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42960 req_id = 8876fa03-af06-4328-aeb3-af10cab060b3 response_code = 200 uri = /v2p
26502025-01-18T05:44:02.543ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
26512025-01-18T05:44:02.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42634 req_id = a1c7e46a-9d55-4ad4-81a2-85962d65c714 response_code = 204 uri = /eip-gateways
26522025-01-18T05:44:02.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42634 req_id = 075f1067-0d40-4864-a888-d35f1bd23144 response_code = 204 uri = /vpc-routes
26532025-01-18T05:44:02.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38329
26542025-01-18T05:44:02.602ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26552025-01-18T05:44:02.642ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26562025-01-18T05:44:02.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117719 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38329 req_id = a6cd0ca6-e5b1-4730-8fb6-dcabea718c88 response_code = 204 uri = /switch-ports
26572025-01-18T05:44:02.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35813
26582025-01-18T05:44:02.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59707
26592025-01-18T05:44:02.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35813 req_id = 97510aa8-d3bd-4b53-b0bd-ea9f573b7418 response_code = 200 uri = /v2p
26602025-01-18T05:44:02.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38329 req_id = 869b5237-3318-4aa4-9426-25ea3c8cbf6d response_code = 200 uri = /network-bootstore-config
26612025-01-18T05:44:02.721ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26622025-01-18T05:44:02.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26632025-01-18T05:44:02.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100307 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59707 req_id = 14e0b5c8-081a-49d5-9e71-f14f166cf5e8 response_code = 204 uri = /switch-ports
26642025-01-18T05:44:02.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59707 req_id = b8c76056-350b-4b1c-8887-4aeef99c1b0f response_code = 200 uri = /network-bootstore-config
26652025-01-18T05:44:02.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41446
26662025-01-18T05:44:02.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41446 req_id = fe0b0645-16bf-47f7-aed7-5bcb5c3f3a88 response_code = 200 uri = /vpc-routes
26672025-01-18T05:44:02.861ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
26682025-01-18T05:44:02.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41446 req_id = 77a64a9c-6d94-42f6-83ae-e236c4e819d1 response_code = 204 uri = /eip-gateways
26692025-01-18T05:44:02.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41446 req_id = 51f25568-313b-474d-b350-39d6805cd22e response_code = 204 uri = /vpc-routes
26702025-01-18T05:44:02.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61958
26712025-01-18T05:44:02.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61958 req_id = 6f930a1b-6822-4ee4-bc0a-a2f583b6197b response_code = 200 uri = /v2p
26722025-01-18T05:44:02.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63083
26732025-01-18T05:44:02.959ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26742025-01-18T05:44:02.996ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26752025-01-18T05:44:03.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96576 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63083 req_id = ab9732ed-a432-401b-80d0-0993588a8aa7 response_code = 204 uri = /switch-ports
26762025-01-18T05:44:03.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63083 req_id = c550e7e4-60ff-4178-a63a-191366e578d7 response_code = 200 uri = /network-bootstore-config
26772025-01-18T05:44:12.660ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7477 local_addr = [fd00:1122:3344:101::1]:64085 method = GET remote_addr = [fd00:1122:3344:101::d]:50288 req_id = 809d4863-f6e6-40eb-bc51-6b22efb78183 response_code = 200 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c uri = /bcda1f83-6e29-4607-a063-c64866d2cd5c
26782025-01-18T05:44:14.857ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35797
26792025-01-18T05:44:14.857ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35797 req_id = 314d32aa-fd10-4fea-bc26-ddc2d12a0a2e response_code = 200 uri = /baseboard
26802025-01-18T05:44:16.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54294
26812025-01-18T05:44:16.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54294 req_id = 2959b304-521a-4c5f-8182-9c4a49492963 response_code = 200 uri = /v2p
26822025-01-18T05:44:16.326ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(2238233) }
26832025-01-18T05:44:16.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 828 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54294 req_id = 19e2206c-c01a-4b06-9fec-7cd1b90132aa response_code = 204 uri = /v2p
26842025-01-18T05:44:16.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40887
26852025-01-18T05:44:16.411ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5afcb059-671c-4173-93ec-a121bfbbba4a, kind: Instance { id: a8345cbd-dabf-4e39-8731-c4f6919ec8a3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2238233), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5afcb059-671c-4173-93ec-a121bfbbba4a, kind: Instance { id: a8345cbd-dabf-4e39-8731-c4f6919ec8a3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2238233), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5afcb059-671c-4173-93ec-a121bfbbba4a, kind: Instance { id: a8345cbd-dabf-4e39-8731-c4f6919ec8a3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2238233), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(2238233))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5afcb059-671c-4173-93ec-a121bfbbba4a, kind: Instance { id: a8345cbd-dabf-4e39-8731-c4f6919ec8a3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2238233), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 1e3733c1-a9ef-42b7-b6a7-6ff97cd70f14, slot: 0, read_only: false, vcr_json: .., name: "disk-3960027700e" }], boot_settings: Some(InstanceBootSettings { order: [1e3733c1-a9ef-42b7-b6a7-6ff97cd70f14] }), cloud_init_bytes: Some(..) } instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 metadata = InstanceMetadata { silo_id: a68f0851-0f9c-4fe9-9237-144ec164f840, project_id: 5d4c75af-1ea7-4f0a-b047-64d4b0f21ed9 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-18T05:44:16.399996242Z }
26862025-01-18T05:44:16.411ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 migration_id = None propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
26872025-01-18T05:44:16.412ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 migration_id = None propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5afcb059-671c-4173-93ec-a121bfbbba4a, kind: Instance { id: a8345cbd-dabf-4e39-8731-c4f6919ec8a3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2238233), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5afcb059-671c-4173-93ec-a121bfbbba4a, kind: Instance { id: a8345cbd-dabf-4e39-8731-c4f6919ec8a3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2238233), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5afcb059-671c-4173-93ec-a121bfbbba4a, kind: Instance { id: a8345cbd-dabf-4e39-8731-c4f6919ec8a3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2238233), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(2238233))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5afcb059-671c-4173-93ec-a121bfbbba4a, kind: Instance { id: a8345cbd-dabf-4e39-8731-c4f6919ec8a3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2238233), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 1e3733c1-a9ef-42b7-b6a7-6ff97cd70f14, slot: 0, read_only: false, vcr_json: .., name: "disk-3960027700e" }], boot_settings: Some(InstanceBootSettings { order: [1e3733c1-a9ef-42b7-b6a7-6ff97cd70f14] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-18T05:44:16.399996242Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26882025-01-18T05:44:16.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 14053 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40887 req_id = 3f79f605-c585-45e1-b43d-da5226e7e33f response_code = 200 uri = /vmms/6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
26892025-01-18T05:44:16.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36971
26902025-01-18T05:44:16.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36971 req_id = 6caa38bd-a2f3-484f-99af-74a39f8850d6 response_code = 200 uri = /vmms/6f1ce69a-b8ad-40ff-95bd-77bd0c09b936/state
26912025-01-18T05:44:16.520ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 2238233 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26922025-01-18T05:44:16.520ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26932025-01-18T05:44:16.558ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 file = illumos-utils/src/zone.rs:325 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
26942025-01-18T05:44:16.582ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 file = illumos-utils/src/zone.rs:363 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
26952025-01-18T05:44:16.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63761
26962025-01-18T05:44:16.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63761 req_id = cdf035e2-297d-4459-b2e8-8fe227fd2f95 response_code = 200 uri = /vpc-routes
26972025-01-18T05:44:16.616ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {5afcb059-671c-4173-93ec-a121bfbbba4a: {10.151.1.176: {b3a39e23-37f3-44f7-a746-8c21e691f960}, 10.151.1.175: {b3a39e23-37f3-44f7-a746-8c21e691f960}}} }
26982025-01-18T05:44:18.214ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
26992025-01-18T05:44:18.214ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 zone file = illumos-utils/src/running_zone.rs:488 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 zone = oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27002025-01-18T05:44:18.408ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936") failed: Property not found. retry in 28.06354ms file = illumos-utils/src/svc.rs:42 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 zone = oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27012025-01-18T05:44:18.445ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936") failed: Property not found. retry in 72.864123ms file = illumos-utils/src/svc.rs:42 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 zone = oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27022025-01-18T05:44:18.549ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936") failed: Property not found. retry in 259.876747ms file = illumos-utils/src/svc.rs:42 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 zone = oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27032025-01-18T05:44:18.827ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936") failed: Property not found. retry in 590.781004ms file = illumos-utils/src/svc.rs:42 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 zone = oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27042025-01-18T05:44:19.430ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936") failed: Property not found. retry in 616.170707ms file = illumos-utils/src/svc.rs:42 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 zone = oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27052025-01-18T05:44:20.057ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936") failed: Property not found. retry in 1.310060756s file = illumos-utils/src/svc.rs:42 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 zone = oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27062025-01-18T05:44:21.377ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936") failed: Property not found. retry in 1.396432499s file = illumos-utils/src/svc.rs:42 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 zone = oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27072025-01-18T05:44:22.783ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936") failed: Property not found. retry in 1.007128424s file = illumos-utils/src/svc.rs:42 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 zone = oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27082025-01-18T05:44:23.820ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 file = sled-agent/src/instance.rs:2068 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27092025-01-18T05:44:23.830ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27102025-01-18T05:44:23.868ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27112025-01-18T05:44:24.025ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27122025-01-18T05:44:24.025ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
27132025-01-18T05:44:24.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7412010 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63761 req_id = 74ab5b62-a494-459c-9219-3f2f52a3ef29 response_code = 204 uri = /eip-gateways
27142025-01-18T05:44:24.026ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-18T05:44:24.026100489Z } file = sled-agent/src/instance.rs:781 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27152025-01-18T05:44:24.026ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-18T05:44:24.026100489Z } propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27162025-01-18T05:44:24.026ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-18T05:44:24.026100489Z }, migration_in: None, migration_out: None }
27172025-01-18T05:44:24.045ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-18T05:44:24.045846984Z } file = sled-agent/src/instance.rs:781 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27182025-01-18T05:44:24.045ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-18T05:44:24.045846984Z } propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27192025-01-18T05:44:24.045ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-18T05:44:24.045846984Z }, migration_in: None, migration_out: None }
27202025-01-18T05:44:24.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63761 req_id = 72fb7971-6bed-4684-86a1-26f2b33b4530 response_code = 204 uri = /vpc-routes
27212025-01-18T05:44:32.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51969
27222025-01-18T05:44:32.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 709 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51969 req_id = 8dd5391b-eafe-4afb-8703-99897ba1b8fb response_code = 200 uri = /vmms/6f1ce69a-b8ad-40ff-95bd-77bd0c09b936/state
27232025-01-18T05:44:32.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52083
27242025-01-18T05:44:32.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52083 req_id = 6348c219-c717-4309-bc77-73cdcc329708 response_code = 200 uri = /vpc-routes
27252025-01-18T05:44:32.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60216
27262025-01-18T05:44:32.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60216 req_id = e8bd3899-d3db-4f15-868f-428b8504ab00 response_code = 200 uri = /vmms/6f1ce69a-b8ad-40ff-95bd-77bd0c09b936/state
27272025-01-18T05:44:32.812ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {5afcb059-671c-4173-93ec-a121bfbbba4a: {10.151.1.176: {b3a39e23-37f3-44f7-a746-8c21e691f960}, 10.151.1.175: {b3a39e23-37f3-44f7-a746-8c21e691f960}}} }
27282025-01-18T05:44:32.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52083 req_id = 90c10f59-7e4d-4ab6-a781-8708ecb2e428 response_code = 204 uri = /eip-gateways
27292025-01-18T05:44:32.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33445
27302025-01-18T05:44:32.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33445 req_id = 016e7902-3d51-4d27-ba58-3325cc998c23 response_code = 200 uri = /vpc-routes
27312025-01-18T05:44:32.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52083 req_id = 65e7c220-aed2-4a40-b822-bbcf42b5efae response_code = 204 uri = /vpc-routes
27322025-01-18T05:44:32.862ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {5afcb059-671c-4173-93ec-a121bfbbba4a: {10.151.1.175: {b3a39e23-37f3-44f7-a746-8c21e691f960}, 10.151.1.176: {b3a39e23-37f3-44f7-a746-8c21e691f960}}} }
27332025-01-18T05:44:32.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33445 req_id = 971e005b-d0b5-463b-aade-e41c94999f53 response_code = 204 uri = /eip-gateways
27342025-01-18T05:44:32.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33445 req_id = 2d94e122-b504-43a3-9500-2070a3f3a474 response_code = 204 uri = /vpc-routes
27352025-01-18T05:44:32.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41238
27362025-01-18T05:44:32.892ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27372025-01-18T05:44:32.934ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27382025-01-18T05:44:33.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108913 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41238 req_id = e52d6bf0-104f-44ee-b281-dfa0a07b7e8c response_code = 204 uri = /switch-ports
27392025-01-18T05:44:33.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45035
27402025-01-18T05:44:33.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60738
27412025-01-18T05:44:33.001ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27422025-01-18T05:44:33.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41238 req_id = cc349b52-3a40-481d-b1e5-0b470c097b34 response_code = 200 uri = /network-bootstore-config
27432025-01-18T05:44:33.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45035 req_id = 1a228342-5133-42f4-8b12-6b552aa3d5a9 response_code = 200 uri = /v2p
27442025-01-18T05:44:33.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45960
27452025-01-18T05:44:33.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45960 req_id = 039a837f-4916-44cb-8432-3a03153761c0 response_code = 200 uri = /v2p
27462025-01-18T05:44:33.043ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27472025-01-18T05:44:33.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48467
27482025-01-18T05:44:33.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48467 req_id = 81df5a18-5a3a-4cac-9fd7-cdf378b4aef6 response_code = 200 uri = /vmms/6f1ce69a-b8ad-40ff-95bd-77bd0c09b936/state
27492025-01-18T05:44:33.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101644 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60738 req_id = 650c8810-f6a3-4be4-9faf-143772526419 response_code = 204 uri = /switch-ports
27502025-01-18T05:44:33.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60738 req_id = ef501531-f0da-4f6d-9a8a-9910d129cc61 response_code = 200 uri = /network-bootstore-config
27512025-01-18T05:44:33.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50371
27522025-01-18T05:44:33.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50371 req_id = ad1dc0a1-af45-4073-97f2-4f037e7a70ea response_code = 200 uri = /vpc-routes
27532025-01-18T05:44:33.198ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {5afcb059-671c-4173-93ec-a121bfbbba4a: {10.151.1.175: {b3a39e23-37f3-44f7-a746-8c21e691f960}, 10.151.1.176: {b3a39e23-37f3-44f7-a746-8c21e691f960}}} }
27542025-01-18T05:44:33.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50371 req_id = 82e6c050-65fc-4cfe-9130-8bb2b3096b68 response_code = 204 uri = /eip-gateways
27552025-01-18T05:44:33.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50371 req_id = 3f9ff98f-68fe-48e4-9c17-8964cb53e49c response_code = 204 uri = /vpc-routes
27562025-01-18T05:44:33.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65093
27572025-01-18T05:44:33.258ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27582025-01-18T05:44:33.296ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27592025-01-18T05:44:33.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92823 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65093 req_id = 7e778125-f848-4a07-8e03-a77fbeb6ae10 response_code = 204 uri = /switch-ports
27602025-01-18T05:44:33.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65093 req_id = d1ffb080-5926-4849-b955-6c422813a858 response_code = 200 uri = /network-bootstore-config
27612025-01-18T05:44:33.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49527
27622025-01-18T05:44:33.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49527 req_id = 437e05fc-0f95-44a6-a86c-e548a8943731 response_code = 200 uri = /v2p
27632025-01-18T05:44:34.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52030
27642025-01-18T05:44:34.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2895 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52030 req_id = 85bdfe48-0f53-48af-9ca5-609a8abe0127 response_code = 200 uri = /vmms/6f1ce69a-b8ad-40ff-95bd-77bd0c09b936/state
27652025-01-18T05:44:34.606ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-18T05:44:34.606900564Z } file = sled-agent/src/instance.rs:781 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27662025-01-18T05:44:34.606ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-18T05:44:34.606900564Z } propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27672025-01-18T05:44:34.606ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-18T05:44:34.606900564Z }, migration_in: None, migration_out: None }
27682025-01-18T05:44:34.643ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-18T05:44:34.643812494Z } file = sled-agent/src/instance.rs:781 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27692025-01-18T05:44:34.643ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-18T05:44:34.643812494Z } propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27702025-01-18T05:44:34.643ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27712025-01-18T05:44:34.643ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27722025-01-18T05:44:34.644ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27732025-01-18T05:44:34.644ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 12286060641247065423 n_samples = 6 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
27742025-01-18T05:44:34.644ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/0ef62e45-6587-4c56-80fb-d82ceac2b8d7/debug/bundle/zone", "/pool/int/8e47fb17-0da5-4fab-894c-91c2bd15e95c/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/4fce5e22-dd7b-4e66-a770-f8a29f4d2417/crypt/debug", "/pool/ext/f8d5fd20-fc8e-486a-89bc-9f6483a0f3c3/crypt/debug", "/pool/ext/16bb833e-d265-4e47-8c19-1cb9a8fa2175/crypt/debug", "/pool/ext/18259e54-9e24-4df6-8524-340cf6c3dae0/crypt/debug", "/pool/ext/d55380f8-3d86-4c31-b244-3f6e51844733/crypt/debug", "/pool/ext/bd4f6a2e-c7eb-469f-bd80-c35295e612ed/crypt/debug", "/pool/ext/b7babb3e-ef5b-474b-b57e-4a826283aa26/crypt/debug", "/pool/ext/cb543c1b-d520-4525-93a9-0809c84c04cd/crypt/debug", "/pool/ext/719280f2-3e89-4055-a81d-4f9adba21825/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27752025-01-18T05:44:34.644ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 18233750865760113355 n_samples = 6 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
27762025-01-18T05:44:35.266ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936", bundle_id: 563b1f8c-682c-44dd-9fcf-8c7ce5c53e14 }, time_created: 2025-01-18T05:44:34.644987512Z, version: 0, cause: TerminatedInstance }
27772025-01-18T05:44:35.266ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 file = sled-agent/src/instance.rs:1314 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27782025-01-18T05:44:37.023ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27792025-01-18T05:44:37.039ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(2238233), kind: System }
27802025-01-18T05:44:37.039ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(2238233), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27812025-01-18T05:44:37.040ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-18T05:44:37.040278051Z }, migration_in: None, migration_out: None }
27822025-01-18T05:44:37.063ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-18T05:44:37.040278051Z }, migration_in: None, migration_out: None }
27832025-01-18T05:44:37.070ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = a8345cbd-dabf-4e39-8731-c4f6919ec8a3 propolis_id = 6f1ce69a-b8ad-40ff-95bd-77bd0c09b936
27842025-01-18T05:44:37.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49975
27852025-01-18T05:44:37.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49975 req_id = 9b311f9d-5758-4f2a-b041-912196cd08e4 response_code = 200 uri = /vpc-routes
27862025-01-18T05:44:37.456ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {5afcb059-671c-4173-93ec-a121bfbbba4a: {10.151.1.175: {b3a39e23-37f3-44f7-a746-8c21e691f960}, 10.151.1.176: {b3a39e23-37f3-44f7-a746-8c21e691f960}}} }
27872025-01-18T05:44:37.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49975 req_id = 016e433a-a10b-4f88-b8f6-73b57594e156 response_code = 204 uri = /eip-gateways
27882025-01-18T05:44:37.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49975 req_id = 0b311096-e5b3-4185-aedb-b88bc9c9745c response_code = 204 uri = /vpc-routes
27892025-01-18T05:44:37.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60550
27902025-01-18T05:44:37.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60550 req_id = 66fae991-9fe3-416b-a29d-9643958b49ff response_code = 200 uri = /v2p
27912025-01-18T05:44:37.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36417
27922025-01-18T05:44:37.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36417 req_id = 40df6609-1e7f-4377-b863-d22f74376342 response_code = 200 uri = /v2p
27932025-01-18T05:44:37.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61865
27942025-01-18T05:44:37.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61865 req_id = 8647f628-4500-4932-8d6b-ab69dd8d94e8 response_code = 200 uri = /vpc-routes
27952025-01-18T05:44:37.932ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
27962025-01-18T05:44:37.932ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c
27972025-01-18T05:44:37.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61865 req_id = e9337a01-16f4-4821-98ac-52a2d106ad64 response_code = 204 uri = /eip-gateways
27982025-01-18T05:44:37.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61865 req_id = 2a289250-e047-4072-a2ac-fae6ce5fa0fd response_code = 204 uri = /vpc-routes
27992025-01-18T05:44:38.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54207
28002025-01-18T05:44:38.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54207 req_id = e1594be0-989b-467b-b8c2-a78593718369 response_code = 200 uri = /vpc-routes
28012025-01-18T05:44:38.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = bcda1f83-6e29-4607-a063-c64866d2cd5c values = ExternalIpGatewayMap { mappings: {} }
28022025-01-18T05:44:38.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54207 req_id = e49ce3a3-eaad-4971-99bf-c6a2384917ff response_code = 204 uri = /eip-gateways
28032025-01-18T05:44:38.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54207 req_id = 494c4252-5eff-479f-84cc-ed0d87b708cf response_code = 204 uri = /vpc-routes